Video Lectures
Lecture 9: Markov Rewards and Dynamic Programming
Description: This lecture covers rewards for Markov chains, expected first passage time, and aggregate rewards with a final reward. The professor then moves on to discuss dynamic programming and the dynamic programming algorithm.
Instructor: Prof. Robert Gallager
Course Info
Instructor
Departments
As Taught In
Spring
2011
Level
Course Info
Instructor
Departments
As Taught In
Spring
2011
Level
Topics
Learning Resource Types
grading
Exam Solutions
grading
Exams
theaters
Lecture Videos
menu_book
Open Textbooks
assignment_turned_in
Problem Set Solutions
assignment
Problem Sets