- Watch the Lecture 18 Video by Prof. Tsitsiklis (00:51:50)
- Review the Lecture 18: Markov Chains - III Slides (PDF)
- Read Section 7.4 in the textbook
Review the recitation problems in the PDF file below and try to solve them on your own.
Tutorial Problems and Tutorial Help Videos
Review the tutorial problems in the PDF file below and try to solve them on your own. One of the problems has an accompanying video where a teaching assistant solves the same problem.
Tutorial Help Videos
|PROBLEM #||PROBLEM TITLE||PROBLEM SOLVED BY|
|2||Mean First Passage and Recurrence Times||Kuang Xu|