18.445 | Spring 2015 | Graduate

Introduction to Stochastic Processes

Syllabus

Course Meeting Times

Lectures: 2 sessions / week, 1.5 hours / session

Prerequisites

18.440 Probability and Random Variables or 6.041SC Probabilistic Systems Analysis and Applied Probability

Description

This course is an introduction to Markov chains, random walks, martingales, and Galton-Watsom tree. The course requires basic knowledge in probability theory and linear algebra including conditional expectation and matrix.

Levin, David Asher, Y. Peres, and Elizabeth L. Wilmer. Markov Chains and Mixing Times. American Mathematical Society, 2008. ISBN: 9780821847398. [Preview with Google Books]

Williams, D. Probability with Martingales. Cambridge University Press, 1991. ISBN: 9780387985091.

Brémaud, Pierre. Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues. Springer, 2008. ISBN: 9780387985091. [Preview with Google Books]

Assignments and Exams

There are 5 homework assignments, 1 midterm exam, and final exam. The midterm and the final exams are closed book, closed notes, and no calculators.

Grading

ACTIVITIES PERCENTAGES
Assignments 50% (10% each)
Midterm Exam 15%
Final Project 35%

Course Info

Instructor
Departments
As Taught In
Spring 2015
Level
Learning Resource Types
Lecture Notes
Problem Sets with Solutions