CS 680
Introduction to Machine Learning
Winter 2026
Topics
- Supervised, unsupervised and reinforcement learning
- Bias-variance, overfitting and dimensionality
- Linear and logistic regression
- Nearest neighbours, trees and boosted predictors
- Gradient descent and stochastic gradient descent
- Regularization, sparsity, support vector machines and kernels
- Neural networks and convolution
- Autoencoders and generative models
- Attention, transformers and large language models
- Clustering, mixtures, EM and principal components
- Adversarial learning
- Privacy, fairness and interpretability
Readings
- The Elements of Statistical Learning
- Learning Theory from First Principles
- Machine Learning: A Probabilistic ApproachTitle as written on the course resource page; edition reference is ambiguous.
- Dive into Deep Learning
- Deep Learning
- All of Statistics
- Introduction to Graph Theory
- Introduction to Algorithms
- Convex Optimization
- Numerical Recipes
- Elements of Information Theory
Sources
- Course catalogue ↗2026–2027
- course_website ↗Winter 2026
- Tentative syllabus; some advanced topics are optional.