6.041SC | Fall 2013 | Undergraduate
Probabilistic Systems Analysis and Applied Probability
Unit III: Random Processes

Lecture 16: Markov Chains - I

« Previous | Next »

Lecture Topics

  • Checkout counter example
  • Markov process definition
  • n-step transition probabilities
  • Classification of states

Lecture Activities

Recitation Problems and Recitation Help Videos

Review the recitation problems in the PDF file below and try to solve them on your own. Two of the problems have an accompanying video where a teaching assistant solves the same problem.

Recitation Help Videos

PROBLEM # PROBLEM TITLE PROBLEM SOLVED BY
1 Setting Up a Markov Chain Jimmy Li
3 Markov Chain Practice 1 Qing He

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

« Previous | Next »

Course Info
As Taught In
Fall 2013
Learning Resource Types
theaters Lecture Videos
theaters Recitation Videos
assignment_turned_in Problem Sets with Solutions
grading Exams with Solutions