Video Lectures

Lecture 19: Countable-state Markov Processes

Description: Markov processes with countable state-spaces are developed in terms of the embedded Markov chain. The steady-state process probabilities and the steady-state transition probabilities are treated.

Instructor: Prof. Robert Gallager

Lecture Slides
Countable-state Markov Processes ( PDF)

Course Info

Learning Resource Types

assignment_turned_in Problem Sets with Solutions
grading Exams with Solutions
menu_book Online Textbook
theaters Lecture Videos