Information Theory I

4 credits

Includes entropy, mutual information, Shannon's source coding theorem, data compression to entropy limit, method of types, Huffman coding, Kraft inequality, arithmetic coding, Kolmogorov complexity, communication at channel capacity (channel coding), coding theory, introduction to modern statistical coding techniques, differential entropy, and Gaussian channels. Prerequisite: E E 505.