6.041SC | Fall 2013 | Undergraduate

Probabilistic Systems Analysis and Applied Probability

Resource Index

Lecture 16: Markov Chains - I

Description: In this lecture, the professor discussed Markov process definition, n-step transition probabilities, and classification of states.

Instructor: John Tsitsiklis

Course Info

Fall 2013
Exam Solutions
Exams
Lecture Videos
Problem Set Solutions
Problem Sets
Problem-solving Videos