18.S096 | January IAP 2023 | Undergraduate

Matrix Calculus for Machine Learning and Beyond

Lecture 8 Part 2: Automatic Differentiation on Computational Graphs

Description: Complicated computational processes can be expressed as “graphs” of computational steps that flow from inputs to outputs. Forward- and reverse-mode automatic differentiation (AD) traverse in opposite directions, giving very different algorithms.

Instructors: Alan Edelman, Steven G. Johnson

Course Info

January IAP 2023
Editable Files
Instructor Insights
Lecture Notes
Lecture Videos
Problem Set Solutions
Problem Sets
Readings