Multimodal Interaction

3 Credits · Level: Graduate

This course explores how interactants integrate an array of visual and auditory resources, including gestures, facial expressions, physical materials, space, images, and sounds, to pursue social actions. We will survey multimodal research on video-recorded interactions in a variety of settings (e.g., casual gatherings, service encounters, health care, education, entertainment, etc.). Through this process, we will build skills for collecting, transcribing, editing, analyzing, and presenting multimodal data. In addition to taking part in reading discussions, analyses, and data sessions, students will conduct independent projects on multimodal interaction based on their own or publicly available data.