- Watch the Lecture 16: Markov Chains - I Videoby Prof. Tsitsiklis (00:52:06)
Lecture 16 Video
- Review the Lecture 16: Markov Chains - I Slides (PDF)
- Read Sections 7.1–7.2 in the textbook
Recitation Problems and Recitation Help Videos
Review the recitation problems in the PDF file below and try to solve them on your own. Two of the problems have an accompanying video where a teaching assistant solves the same problem.
Recitation Help Videos
|PROBLEM #||PROBLEM TITLE||PROBLEM SOLVED BY|
|1||Setting Up a Markov Chain (00:10:36) |
Setting Up a Markov Chain
|3||Markov Chain Practice 1 (00:11:41) |
Markov Chain Practice 1
Review the tutorial problems in the PDF file below and try to solve them on your own.