6.262 | Spring 2011 | Graduate

Discrete Stochastic Processes

Video Lectures

Lecture 19: Countable-state Markov Processes

Description: Markov processes with countable state-spaces are developed in terms of the embedded Markov chain. The steady-state process probabilities and the steady-state transition probabilities are treated.

Instructor: Prof. Robert Gallager

Countable-state Markov Processes (PDF)

Course Info

As Taught In
Spring 2011
Learning Resource Types
Problem Sets with Solutions
Exams with Solutions
Online Textbook
Lecture Videos