Information Theory

Information theory is the mathematical study of the fundamental limits of information transmission (or coding) and storage (or compression). This course offers a broad introduction to information theory and its real-world applications. A subset of the following is covered: entropy and information; the asymptotic equipartition property; theoretical limits of lossless data compression and practical algorithms; communication in the presence of noise-channel coding, channel capacity; source-channel separation; Gaussian channels; Lossy data compression.