6.041SC | Fall 2013 | Undergraduate
Probabilistic Systems Analysis and Applied Probability
Unit III: Random Processes

Lecture 17: Markov Chains - II

« Previous | Next »

Lecture Topics

  • Review
  • Steady-state behavior
    • Steady-state convergence theorem
    • Balance equations
  • Birth-death process

Lecture Activities

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

Problem Set and Solutions

Work the problems on your own and check your answers when you’re done. Problem set 8 covers Lectures 16 and 17.

« Previous | Next »

Course Info
As Taught In
Fall 2013
Learning Resource Types
theaters Lecture Videos
theaters Recitation Videos
assignment_turned_in Problem Sets with Solutions
grading Exams with Solutions