Introduction to Large Language Models

3 credits

Introduces the principles, theoretical foundations, and applications of large language models (LLMs) with a focus on electrical and computer engineering contexts. Topics include architecture design, training and fine-tuning methods, evaluation metrics, information-theoretic and scaling law analyses, ethical considerations, and applications to engineering domains. Prerequisite: either E E 344, E E 345, or equivalent; and either E E 241, CSE 163, or equivalent.