Information Theory

3 credits · College of Engineering catalogue

Advisory Prerequisite: ECE 501. Enforced Prerequisite: None. (3 credits) Measures of information, such as entropy, conditional entropy, mutual and directed information and Kullback-Leibler divergence; fundamental limits to the performance of communication systems, including source coding (data compression) and channel coding (reliable transmission through noisy media); elementary source and channel coding techniques; information theoretic bounds on the performance of estimation/decision systems.