Like differential equations, Markov matrices describe changes over time. Once again, the eigenvalues and eigenvectors describe the long term behavior of the system. In this session we also learn about Fourier series, which describe periodic functions as points in an infinite dimensional vector space.
Lecture 24: Markov Matrices; Fourier Series
Problem Solving: Markov Matrices
Work the problems on your own and check your answers when you're done.