Information Theory | Electrical Engineering and Computer Science | MIT OpenCourseWare

Lecture Notes

6.441S16: Chapter 1: Information Measures: Entropy and Divergence

6.441S16: Chapter 10: Binary Hypothesis Testing

6.441S16: Chapter 11: Hypothesis Testing Asymptotics I

6.441S16: Chapter 12: Information Projection and Large Deviation

6.441S16: Chapter 13: Hypothesis Testing Asymptotics II

6.441S16: Chapter 14: Channel Coding

6.441S16: Chapter 15: Channel Coding: Achievability Bounds

6.441S16: Chapter 16: Linear Codes. Channel Capacity

6.441S16: Chapter 17: Channels with Input Constraints. Gaussian Channels.

6.441S16: Chapter 18: Lattice Codes (by O. Ordentlich)

6.441S16: Chapter 19: Channel Coding: Energy-Per-Bit, Continuous-Time Channels

6.441S16: Chapter 2: Information Masures: Mutual Information

6.441S16: Chapter 20: Advanced Channel Coding. Source-Channel Separation.

6.441S16: Chapter 21: Channel Coding with Feedback

6.441S16: Chapter 22: Capacity-Achieving Codes Via Forney Concatenation

6.441S16: Chapter 23: Rate-Distortion Theory

6.441S16: Chapter 24: Rate Distortion: Achievability Bounds

6.441S16: Chapter 25: Evaluating R(D). Lossy Source-Channel Separation.

6.441S16: Chapter 26: Multiple-Access Channel

6.441S16: Chapter 27: Examples of MACs. Maximal Pe and zero-Error Capacity.

6.441S16: Chapter 28: Random Number Generators

6.441S16: Chapter 3: Sufficient Statistic. Continuity of Divergence and Mutual Information.

6.441S16: Chapter 4: Extremization of Mutual Information: Capacity Saddle Point

6.441S16: Chapter 5: Single-Letterization. Probability of Error. Entropy Rate.

6.441S16: Chapter 6: Variable-Length Lossless Compression

6.441S16: Chapter 7: Fixed-length (almost lossless) compression. Slepian-Wolf problem.

6.441S16: Chapter 8: Compressing Stationary Ergodic Sources

6.441S16: Chapter 9: Universal Compression

6.441S16: Course Notes

Course Info

Instructor

Prof. Yury Polyanskiy

Departments

Electrical Engineering and Computer Science

As Taught In

Spring 2016

Level

Graduate

Topics

Learning Resource Types

Lecture Notes

Problem Sets

Download Course

MIT Open Learning

Over 2,500 courses & materials

Freely sharing knowledge with learners and educators around the world. Learn more

© 2001–2026 Massachusetts Institute of Technology

Accessibility

Creative Commons License

Terms and Conditions

Proud member of:

© 2001–2026 Massachusetts Institute of Technology