Video Lectures

Lecture 17: Countable-state Markov Chains

Description: This lecture begins with a discussion of convergence WP1 related to a quiz problem. Then positive and null recurrence, steady state, birth-death chains, and reversibility are covered.

Instructor: Prof. Robert Gallager

Transcript
Lecture Slides
Countable-state Markov Chains ( PDF)

Course Info

Learning Resource Types

assignment_turned_in Problem Sets with Solutions
grading Exams with Solutions
menu_book Online Textbook
theaters Lecture Videos