Lecture Topics

Lecture Activities
 Watch the Lecture 16 Video by Prof. Tsitsiklis (00:52:06)
 Review the Lecture 16: Markov Chains  I Slides (PDF)
 Read Sections 7.1–7.2 in the textbook
Recitation Problems and Recitation Help Videos
Review the recitation problems in the PDF file below and try to solve them on your own. Two of the problems have an accompanying video where a teaching assistant solves the same problem.
Recitation Help Videos
PROBLEM #  PROBLEM TITLE  PROBLEM SOLVED BY 

1  Setting Up a Markov Chain  Jimmy Li 
3  Markov Chain Practice 1  Qing He 
Tutorial Problems
Review the tutorial problems in the PDF file below and try to solve them on your own.
 Tutorial 9 Problems (PDF) Do ONLY Problems 1 and 2
 Tutorial 9 Solutions (PDF)