Information Theory

(3 Credits)

Mathematical information measures: entropy, relative entropy and mutual information. Asymptotic equipartition property, entropy rates of stochastic processes. Lossless source encoding theorems and source coding techniques. Channel capacity, differential entropy and the Gaussian channel. Lossy source coding rate distortion theory. Brief overview of network information theory. | Prerequisite: ECE-GY 6303 and Graduate status.