6.041SC | Fall 2013 | Undergraduate

Probabilistic Systems Analysis and Applied Probability

Resource Index

Lecture 16: Markov Chains - I

Description: In this lecture, the professor discussed Markov process definition, n-step transition probabilities, and classification of states.

Instructor: John Tsitsiklis

Course Info

As Taught In
Fall 2013
Learning Resource Types
Lecture Videos
Recitation Videos
Problem Sets with Solutions
Exams with Solutions