Probabilistic Systems Analysis and Applied Probability

Lecture 18: Markov Chains - III

« Previous | Next »

Lecture Topics

Review of steady-state behavior Probability of blocked phone calls Calculating absorption probabilities Calculating expected time to absorption

Lecture Activities

• Watch the Lecture 18 Video by Prof. Tsitsiklis (00:51:50)
• Review the Lecture 18: Markov Chains - III Slides (PDF)
• Read Section 7.4 in the textbook

Recitation Problems

Review the recitation problems in the PDF file below and try to solve them on your own.

• Recitation 19 Problems (PDF)
• Recitation 19 Solutions (PDF)

Tutorial Problems and Tutorial Help Videos

Review the tutorial problems in the PDF file below and try to solve them on your own. One of the problems has an accompanying video where a teaching assistant solves the same problem.

• Tutorial 10 Problems (PDF) Do ONLY Problems 2 and 3
• Tutorial 10 Solutions (PDF)

Tutorial Help Videos

PROBLEM #	PROBLEM TITLE	PROBLEM SOLVED BY
2	Mean First Passage and Recurrence Times	Kuang Xu

« Previous | Next »