Information and Entropy

Resource Index

Week #	Topics	Readings	Assignments
1	Unit 1: Bits Unit 2: Codes	Notes, Preface (PDF) Notes, Chapter 1: Bits (PDF) Notes, Chapter 2: Codes (PDF)	Problem Set 1 (PDF) Problem Set 1 Solutions (PDF)
2	Unit 3: Compression	Notes, Chapter 3: Compression (PDF)	Problem Set 2 (PDF) Problem Set 2 Solutions (PDF)
3	Unit 4: Noise and errors	Notes, Chapter 4: Noise and errors (PDF)	Problem Set 3 (PDF) Problem Set 3 Solutions (PDF)
4	Unit 5: Probability	Notes, Chapter 5: Probability (PDF)	Problem Set 4 (PDF) Problem Set 4 Solutions (PDF)
5	Unit 6: Communications	Notes, Chapter 6: Commmunications (PDF)	Problem Set 5 (PDF) Problem Set 5 Solutions (PDF)
6	Unit 7: Processes	Notes, Chapter 7: Processes (PDF)	Problem Set 6 (PDF) Problem Set 6 Solutions (PDF)
7	Unit 8: Inference	Notes, Chapter 8: Inference (PDF)	Problem Set 7 (PDF) Problem Set 7 Solutions (PDF)
8	Unit 9: Maximum Entropy	Notes, Chapter 9: Maximum Entropy (PDF)	Problem Set 8 (PDF) Problem Set 8 Solutions (PDF)
9	Quiz	-	-
10	Unit 10: Physical Systems	Notes, Chapter 10: Physical Systems (PDF)	Problem Set 9 (PDF) Problem Set 9 Solutions (PDF)
11	Unit 11: Energy	Notes, Chapter 11: Energy (PDF)	Problem Set 10 (PDF) Problem Set 10 Solutions (PDF)
12	Unit 12: Temperature	Notes, Chapter 12: Temperature (PDF)	Problem Set 11 (PDF) Problem Set 11 Solutions (PDF)
13	Unit 13: Quantum Information	Notes, Chapter 13: Quantum Information (PDF)	-
14	Final Exam	-