CS 6674
Multimodal Computer Vision
Multimodal representations are reshaping computer vision, driving advances in both understanding and generation across a wide range of perceptual tasks. This research-oriented course explores computer vision techniques that integrate images with additional modalities such as language and 3D geometry for addressing challenges in both analysis and synthesis tasks. Possible topics include visual grounding, multimodal alignment, and text-guided generation and editing over multiple 2D and 3D representations.
Topics
- Analyze state-of-the-art multimodal techniques and understand their architectures and capabilities.
- Identify open challenges in the field of multimodal computer vision.
- Design deep learning pipelines that combine multiple modalities for addressing a research-oriented problem in computer vision.
Official roster learning outcomes
Sources
- Course catalogue ↗2026-2027
- Catalogue entry ↗
Catalogue variants
- Multimodal Computer Vision · 3.0 · Graduate