Information and Coding Theory

Originally developed by C.E. Shannon in the 1940s for describing bounds on information rates across telecommunication channels, information and coding theory is now employed in a large number of disciplines for modeling and analysis of problems that are statistical in nature. This course provides a general introduction to the field. Main topics include entropy, error correcting codes, source coding, data compression. Of special interest will be the connection to problems in pattern recognition. Includes a number of projects relevant to neuroscience, cognitive and linguistic sciences, and computer vision. Prerequisites: High school algebra, calculus. MATLAB or other computer experience helpful. Prior exposure to probability theory/statistics helpful.