Video Lectures


Lecture 1: Introduction

Go to this video


Lecture 2: The Simple Pendulum

Go to this video


Lecture 3: Optimal Control of the Double Integrator

Go to this video


Lecture 4: Optimal Control of the Double Integrator (cont.)

Go to this video


Lecture 5: Numerical Optimal Control (Dynamic Programming)

Go to this video


Lecture 6: Acrobot and Cart-pole

Go to this video


Lecture 7: Swing-up Control of Acrobot and Cart-pole Systems

Go to this video


Lecture 8: Dynamic Programming (DP) and Policy Search

Go to this video


Lecture 9: Trajectory Optimization

Go to this video


Lecture 10: Trajectory Stabilization and Iterative Linear Quadratic Regulator

Go to this video


Lecture 11: Walking

Go to this video


Lecture 12: Walking (cont.)

Go to this video


Lecture 13: Running

Go to this video


Lecture 14: Feasible Motion Planning

Go to this video


Lecture 15: Global Policies from Local Policies

Go to this video


Lecture 16: Introducing Stochastic Optimal Control

Go to this video


Lecture 17: Stochastic Gradient Descent

Go to this video


Lecture 18: Stochastic Gradient Descent 2

Go to this video


Lecture 19: Temporal Difference Learning

Go to this video


Lecture 20: Temporal Difference Learning with Function Approximation

Go to this video


Lecture 21: Policy Improvement

Go to this video


Lecture 22: Actor-critic Methods

Go to this video


Lecture 23: Case Studies in Computational Underactuated Control

Go to this video