Homework problems were taken from the course textbook:
Bertsekas, Dimitri P. Dynamic Programming and Optimal Control, Volume I. 3rd ed. Athena Scientific, 2005. ISBN: 9781886529267.
———. Dynamic Programming and Optimal Control, Volume II: Approximate Dynamic Programming. 4th ed. Athena Scientific, 2012. ISBN: 9781886529441.
Errata (PDF)
Approximate dynamic programming online chapter (
PDF - 2.1MB)
Course assignments.
| ASSN # |
PROBLEMS |
| 1 |
Volume I: 1.3, 1.22, 1.23, 2.1 |
| 2 |
2.7, 3.1, 4.1, 4.4 |
| 3 |
4.16, 4.20, 4.21, 4.24 |
| 4 |
5.2, 5.5, 5.7, 5.8, 5.16, 6.2 (ignore OLFC part) |
| 5 |
7.4, 7.5, 7.7, 7.8a |
| 6 |
7.17, 7.18, 7.23, 7.25 |
| 7 |
Volume II: 2.9, 2.11 |
| 8 |
3.2, 3.13 |
| 9 |
3.6, 6.4 of the online chapter |