### Readings

- Notes, Chapter 8: Inference (PDF)
- Jaynes, E. T. “Information Theory and Statistical Mechanics (PDF - 2.1 MB).”
*Physical Review*106 (May 15, 1957): 620–630.

### Assignments

- Problem Set 7 (PDF)
- Problem Set 7 Solutions (PDF)
- Begin Quiz Review

### Resources

#### Technical

The person most responsible for use of maximum entropy principles in various fields of science is Edwin T. Jaynes (July 5, 1922 – April 30, 1998).

- Jaynes, E. T. “Information Theory and Statistical Mechanics (PDF - 2.1 MB).”
*Physical Review*106 (May 15, 1957): 620–630.

This is the seminal paper which really started the modern use of the Principle of Maximum Entropy in physics. - ———. “Information Theory and Statistical Mechanics II (PDF - 3.6 MB).”
*Physical Review*108 (October 15, 1957): 171–190.

Continuation of the previous reference.

#### Historical

Jaynes knew, of course, about Thomas Bayes and when on sabbatical in England sought out and photographed the Bayes tombstone.

#### Books

- The philosophy of assuming maximum uncertainty is discussed in Chapter 3 of Tribus, M.
*Thermostatics and Thermodynamics*. Princeton, NJ: D. Van Nostrand Co, Inc., 1961. - Another good explanation, in terms of estimating probabilities of an unfair die is in Jaynes, E. T. “Information Theory and Statistical Mechanics (PDF).” In
*Statistical Physics*. Brandeis Summer Institute 1962. New York, NY: W. A. Benjamin, Inc., 1963. pp. 181–218. - Personal history by Jaynes, Edwin T. “Where Do We Stand on Maximum Entropy? (PDF - 2.5 MB)” In
*The Maximum Entropy Formalism*. Edited by Raphael D. Levine and Myron Tribus. Cambridge, MA: MIT Press, 1978. pp. 15–118. ISBN: 9780262120807.