6.041SC | Fall 2013 | Undergraduate

Probabilistic Systems Analysis and Applied Probability

Unit III: Random Processes

Lecture 16: Markov Chains - I

« Previous | Next »

Lecture Topics

  • Checkout counter example
  • Markov process definition
  • n-step transition probabilities
  • Classification of states

Lecture Activities

Recitation Problems and Recitation Help Videos

Review the recitation problems in the PDF file below and try to solve them on your own. Two of the problems have an accompanying video where a teaching assistant solves the same problem.

Recitation Help Videos

PROBLEM # PROBLEM TITLE PROBLEM SOLVED BY
1 Setting Up a Markov Chain Jimmy Li
3 Markov Chain Practice 1 Qing He

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

« Previous | Next »

Course Info

As Taught In
Fall 2013
Learning Resource Types
Lecture Videos
Recitation Videos
Problem Sets with Solutions
Exams with Solutions