Introduction to Using Generative AI

(3 Credit Hours) · Undergraduate

CSE 10124 is a technical elective course in the Computer Science and Engineering program at the University of Notre Dame. Over the course of the semester, students will build and train, from scratch, a large-language model (LLM) similar to GPT2. Along the way students will learn the fundamentals of generative ai, including topics such as: the transformer architecture, pre-training dynamics, SFT and RLHF, RAG, and agentic harnesses and workflows. Students will build examples of all topics from scratch. Experience in programming (python particularly) is not required but highly recommended.