ECE 612
Information Theory
Winter 2023
Readings
- T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, New York, 2nd Edition, 2006.
Spring 2020
Topics
- Entropy, Relative Entropy, and Mutual Information
- Asymptotic Equipartition Property
- Entropy Rates
- Data Compression
- Channel Capacity
- Differential Entropy
- Gaussian Channel
- Rate Distortion Theory
- Information Theory and Statistics (time permitting)
- Maximum Entropy (time permitting) 1
- T extbook and references
Readings
- T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, New York, 2nd Edition 2006.
Winter 2016
Readings
- T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, New York, 1991.
- R. G. Gallager, Information Theory and Reliable Communication, Wiley, New York 1968.
- J. M. Wozencraft and I. M. Jacobs, Principles of Communication Engineering, Wiley, 1965.
- R. E. Blahut, Principles and Practice of Information Theory, Addison Wesley, 1987.
Sources
- Course catalogue ↗2026–2027
- course_outline ↗Winter 2023
- course_outline ↗Spring 2020
- course_outline ↗Winter 2016
- Official public PDF outline or course description. Materials and topic extracts may be partial; consult the linked source for the full list.
- Official public PDF outline or course description. Materials and topic extracts may be partial; consult the linked source for the full list.
- Public departmental course outline. Source may be archival; no current-term assignment is implied. Bibliographic details are preserved in textbook notes.