Lecture 16: Markov Chains I

Description: In this lecture, the professor discussed Markov process definition, n-step transition probabilities, and classification of states.

Instructor: John Tsitsiklis

Transcript

Lecture Slides

Instructor:	Prof. John Tsitsiklis
Course Number:	6.041 6.431
Departments:	Electrical Engineering and Computer Science
As Taught In:	Fall 2010
Level:	Undergraduate

Problem Sets with Solutions

Exams with Solutions

Lecture Videos