everything.study
MATH 5211

Reading Course

0.5 credits · Graduate

Fall 2025 · Large Language Models

Topics

  • NLP and self-supervised pretraining
  • BERT
  • generative language models
  • training at scale and long sequences
  • prompt design and learning
  • instruction alignment
  • human preferences and RLHF
  • prefilling and decoding
  • efficient inference and inference-time scaling.

Readings

  • Textbook: Tong Xiao and Jingbo Zhu, Foundations of Large Language Models; no edition or publication year specified.
Sources