Information and Entropy

Units 1 & 2: Bits and Codes

Readings

• Notes, Preface (PDF)
• Notes, Chapter 1: Bits (PDF)
• Notes, Chapter 2: Codes (PDF)

Assignments

• Problem Set 1 (PDF)
• Problem Set 1 Solutions (PDF)

Resources

Technical

• Ward, S. A., and R. H. Jr. Halstead. Computation Structures. Cambridge, MA: MIT Press and McGraw-Hill, 1989. ISBN: 9780262231398. [6.004 text]
• Agarwal, Anant, and Jeffrey H. Lang. 6.002 Notes: Foundations of Analog and Digital Electronic Circuits. San Francisco, CA: Morgan Kaufmann/Elsevier, 2005. ISBN: 9781558607354.
• Boolean Algebra: There are many excellent descriptions of Boolean Algebra at various technical levels on the Web. You can find many through Google.
• Truxal, John G. The Age of Electronic Messages. Cambridge, MA: MIT Press, 1990. ISBN: 9780262701020.
  Lots of examples of codes, at an introductory level.

Historical

• George Boole (1815–1864)
• Augustus De Morgan (1806–1871)
• Wilson, Geoffrey. The Old Telegraphs. London, UK: Phillimore and Co., 1976. ISBN: 9780900592799.