ORIE 5320
Optimization for AI
From fitting regression models to training neural networks, many problems in artificial intelligence can be cast as optimization problems. This course studies the fundamentals of optimization as they apply to artificial intelligence. Much of the focus will be on convex optimization, covering topics such as convex analysis, gradient descent for constrained and unconstrained problems, proximal gradient descent, variants of Newton’s method, and the Frank-Wolfe algorithm. The treatment will be at a fairly sophisticated level, giving sound justifications for the algorithms studied.
Topics
- Formulate and analyze unconstrained and constrained nonlinear optimization problems, identifying convexity, feasibility, and optimality conditions.
- Apply and implement first- and second-order optimization algorithms, and evaluate their convergence behavior in practice.
- Model and solve real-world applications using nonlinear optimization techniques in areas such as machine learning, engineering, and operations research.
Official roster learning outcomes
Sources
Catalogue variants
- Optimization for AI · 4.0 · Graduate
- Optimization for AI · 4.0; 3.0 · Graduate