Generative AI Models in Theory and Practice

3 credits · Graduate School

Transformer models are finding wide application (NLP, audio analysis or "textless NLP", computer vision, and more) and are achieving state of the art performance across multiple tasks. In this course we will discuss the theoretical underpinnings of transformers, cover the skills and tools needed to use transformers, and gain hands-on experience. Students will be assigned two papers to present over the semester, complete self-guided training using the Huggingface.co training material, and will apply a transformer-based model to solve a research problem. FALL [3]