6.441 | Spring 2010 | Graduate

Information Theory

Course Description

6.441 offers an introduction to the quantitative theory of information and its applications to reliable, efficient communication systems. Topics include mathematical definition and properties of information, source coding theorem, lossless compression of data, optimal lossless coding, noisy communication channels, …
6.441 offers an introduction to the quantitative theory of information and its applications to reliable, efficient communication systems. Topics include mathematical definition and properties of information, source coding theorem, lossless compression of data, optimal lossless coding, noisy communication channels, channel coding theorem, the source channel separation theorem, multiple access channels, broadcast channels, Gaussian noise, and time-varying channels.
Learning Resource Types
Problem Sets
Lecture Notes
An image showing a series of ones and zeros.
Binary digits are the individual pieces of data that are used to represent information. (Image by MIT OpenCourseWare.)