Information and Entropy

The Morse telegraph.

The Morse telegraph. (Image courtesy of the U.S. National Library of Medicine.)


MIT Course Number

6.050J / 2.110J

As Taught In

Spring 2008



Cite This Course

Course Description

Course Features

Course Description

This course explores the ultimate limits to communication and computation, with an emphasis on the physical nature of information and information processing. Topics include: information and computation, digital signals, codes and compression, applications such as biological representations of information, logic circuits, computer architectures, and algorithmic information, noise, probability, error correction, reversible and irreversible operations, physics of computation, and quantum computation. The concept of entropy applied to channel capacity and to the second law of thermodynamics.

Related Content

Paul Penfield, and Seth Lloyd. 6.050J Information and Entropy, Spring 2008. (Massachusetts Institute of Technology: MIT OpenCourseWare), (Accessed). License: Creative Commons BY-NC-SA

For more information about using these materials and the Creative Commons license, see our Terms of Use.