6.262 | Spring 2011 | Graduate

Discrete Stochastic Processes

Video Lectures

Lecture 17: Countable-state Markov Chains

Description: This lecture begins with a discussion of convergence WP1 related to a quiz problem. Then positive and null recurrence, steady state, birth-death chains, and reversibility are covered.

Instructor: Prof. Robert Gallager

Countable-state Markov Chains (PDF)

Course Info

As Taught In
Spring 2011
Learning Resource Types
Problem Sets with Solutions
Exams with Solutions
Online Textbook
Lecture Videos