Computational Multimedia: Sensing, Representation, and Synthesis

3 credits · Graduate

This course takes the form of a survey of computational media sensing, representation and synthesis, organised around the human senses (sight, hearing, etc.) and the corresponding physical phenomena. For each medium, we will investigate the physics of the medium, the psychophysics of human perception, the details of machine perception, and applications of both sensing and synthesis to computational tools and systems. The theoretical and practical knowledge gained in this course will enable students to understand the implications of human sensory systems and perception on the design of digital sensors, data representations (sampling, compression, encoding, and storage), synthesis models and techniques, and displays. This course includes lectures, practical exploration of media and tools, reading assignments, seminar presentations and a final course project focused on a particular aspect of computational media.