Large Language Models: Foundations and Algorithms

3 Credits.

The course, an introduction to the foundations of large language models, is a coherent mix of theory and practice. Topics include: Empirical Risk Minimization, Gradient methods (GD, SGD, Adam, etc), Language Models Architectures (Transformers, State Space Models), Scaling Theory.