Sem:Multimodal Interaction

3 Credits · Level: Graduate

This course is dedicated to exploring the intricate ways in which co-present interactants integrate an array of communicative resources, including voice qualities, gestures and gesticulation, facial expressions, eye gaze, body postures, etc., to pursue various social actions in their ongoing discourse. We will survey research on multimodality and examine video recordings of naturally occurring interactions in a variety of cultures. Through this process, we will build skills for collecting, transcribing, editing, analyzing, and presenting video data and using digital tools for effectively working with multimodal data. In addition to taking part in reading discussions, analyses, and data sessions, students will conduct independent projects on multimodal interaction based on their own data or data from archived sources.