# Lecture 16: Markov Chains I

Description: In this lecture, the professor discussed Markov process definition, n-step transition probabilities, and classification of states.

Instructor: John Tsitsiklis

Transcript
Lecture Slides

#### Learning Resource Types

assignment_turned_in Problem Sets with Solutions