everything.study
CDS 185

Foundations of Algorithmic Decision-Making: Online Learning, Reinforcement Learning, and beyond

9 units (3-3-3) | third term

From game-playing agents to Large Language Models, Reinforcement Learning (RL) has become the engine behind many of the most significant breakthroughs in modern AI. This course provides a rigorous introduction to the mathematical foundations of algorithmic decision-making, moving from multi-armed bandits to reinforcement learning and concluding with special topics on how these principles are applied at scale to AI models and complex high-dimensional problems like robotics. Through a mixture of mathematical analysis and algorithmic implementation, students will gain the tools to both understand and develop the next generation of decision-making agents. The course expects students to be comfortable with probability, linear algebra, and basic optimization.

Prerequisites & course information

Prerequisites: CS/CNS/EE/IDS 155, EE/CMS/CNS/CS/IDS 181, ACM/IDS 104, ACM/EE/IDS 116.

Sources
Catalogue variants