STAT 385
Introduction to Neural Networks
Winter 2026
Topics
- Predictive analytics, supervised learning and cross-validation
- Numerical overflow and underflow
- Feed-forward networks and universality
- Classification and regression architectures
- Objective functions and parameter estimation
- Gradient descent, backpropagation and Hessian computation
- Initialization and adaptive learning rates
- Regularization, augmentation and noise injection
- Recurrent and long short-term memory networks
- Convolutional networks
- Python or R implementation and applications
Readings
- Reference (not explicitly required): C. C. Aggarwal. Neural Networks and Deep Learning: A Textbook, 2nd edition. Springer, 2023.
- Reference (not explicitly required): C. M. Bishop and H. Bishop. Deep Learning: Foundations and Concepts. Springer, 2024. https://www.bishopbook.com/
Winter 2026 · STAT 385
Readings
- Neural networks and deep learning: a textbook, C.C. Aggarwal, 2nd Edition, Springer, 2023.
- Deep learning: foundations and concepts, by C.M. Bishop and H. Bishop, Springer.
Winter 2025 · MACF 491
Readings
- Neural networks and deep learning: a textbook, C.C. Aggarwal, 2nd Edition, Springer, 2023.
- Deep learning: foundations and concepts, by C.M. Bishop and H. Bishop, Springer.
Winter 2025 · STAT 385
Readings
- Neural networks and deep learning: a textbook, C.C. Aggarwal, 2nd Edition, Springer, 2023.
- Deep learning: foundations and concepts, by C.M. Bishop and H. Bishop, Springer.
Sources
- Course catalogue ↗2026–2027
- Syllabus or course outline ↗Winter 2026
- Historical course outline ↗Winter 2026
- Historical course outline ↗Winter 2025
- Historical course outline ↗Winter 2025
- Winter 2026 outline. Course header explicitly lists MACF 491, STAT 385, MAST 679. Explicitly no required text; these books will be used as references.
- Historical source. Generic Textbook/References headings remain requirement-unspecified. Bibliographic editions and years are retained as printed; source inconsistencies may remain. Automated extraction with conservative filtering; distinct bibliography strings screened for false positives; entire syllabus not manually reviewed.
- Historical source. Generic Textbook/References headings remain requirement-unspecified. Bibliographic editions and years are retained as printed; source inconsistencies may remain. Automated extraction with conservative filtering; distinct bibliography strings screened for false positives; entire syllabus not manually reviewed.
- Historical source. Generic Textbook/References headings remain requirement-unspecified. Bibliographic editions and years are retained as printed; source inconsistencies may remain. Automated extraction with conservative filtering; distinct bibliography strings screened for false positives; entire syllabus not manually reviewed.