Probabilistic Systems Analysis and Applied Probability

Lecture 17: Markov Chains - II

« Previous | Next »

Lecture Topics

Review Steady-state behavior Steady-state convergence theorem Balance equations Birth-death process

Lecture Activities

• Watch the Lecture 17 Video by Prof. Tsitsiklis (00:51:25)
• Review the Lecture 17: Markov Chains - II Slides (PDF)
• Read Section 7.3 in the textbook

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

• Tutorial 9 Problems (PDF) Do ONLY Problem 3
• Tutorial 9 Solutions (PDF)

Problem Set and Solutions

Work the problems on your own and check your answers when you’re done. Problem set 8 covers Lectures 16 and 17.

• Problem Set 8 (PDF)
• Problem Set 8 Solutions (PDF)

« Previous | Next »