Information Theory and Coding

Topics

• Entropy and mutual information
• Discrete memoryless channels and discrete memoryless sources
• Capacity-cost functions and rate-distortion functions
• Gaussian channel and source
• Source-channel coding theorem
• Linear codes
• Goppa
• Reed-Solomon
• Golay codes
• Convolutional codes
• Variable-length source coding