| 1 |
Introduction, Review of Random Variables, Entropy, Mutual Information, Chain Rules |
|
| 2 |
Jensen's Inequality, Data Processing Theorem, Fanos's Inequality |
PS 1 issued |
| 3 |
Markov Chain, Entropy Rate of Random Processes |
|
| 4 |
Different Types of Convergence, Asymptotic Equipartition Property (AEP), Typical Set, Joint Typicality |
PS 1 due
PS 2 issued |
| 5 |
Data Compression, Kraft Inequality, Optimal Codes |
PS 2 due |
| 6 |
Huffman Codes, Sensitivity of Distribution, Elias Code |
|
| 7 |
Gambling |
PS 3 issued |
| 8 |
Channel Capacity, Symmetric and Erasure Channels |
PS 3 due
PS 4 issued |
| 9 |
Coding Theorem |
|
| 10 |
Strong Coding Theorem |
|
| 11 |
Strong Coding Theorem (cont.) |
PS 4 due
PS 5 issued |
| 12 |
Feedback Capacity |
PS 5 due |
| 13 |
Joint Source Channel Coding |
|
| 14 |
Differential Entropy |
PS 6 issued |
| 15 |
Gaussian Channel |
|
| 16 |
Gaussian Channels: Parallel, Colored Noise, Inter-symbol Interference |
PS 6 due
PS 7 issued |
| 17 |
Maximizing Entropy |
|
| 18 |
Gaussian Channels with Feedback |
PS 7 due
PS 8 issued |
| 19 |
Fading Channels |
PS 8 due
PS 9 issued |
| 20 |
Types, Universal Source Coding, Sanov's Theorem |
PS 9 due
PS 10 issued
|
| 21 |
Multiple Access Channels |
|
| 22 |
Slepian-Wolf Coding |
PS 10 due |
| 23 |
Broadcast Channels |
|
| 24 |
Channel Side Information, Wide-band Channels |
|