6.041SC | Fall 2013 | Undergraduate

Probabilistic Systems Analysis and Applied Probability

Unit III: Random Processes

Lecture 17: Markov Chains - II

« Previous | Next »

Lecture Topics

  • Review
  • Steady-state behavior
    • Steady-state convergence theorem
    • Balance equations
  • Birth-death process

Lecture Activities

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

Problem Set and Solutions

Work the problems on your own and check your answers when you’re done. Problem set 8 covers Lectures 16 and 17.

« Previous | Next »

Course Info

As Taught In
Fall 2013
Learning Resource Types
Lecture Videos
Recitation Videos
Problem Sets with Solutions
Exams with Solutions