18.S096 | January IAP 2023 | Undergraduate

Matrix Calculus for Machine Learning and Beyond

Lecture 8 Part 2: Automatic Differentiation on Computational Graphs

Description: Complicated computational processes can be expressed as “graphs” of computational steps that flow from inputs to outputs. Forward- and reverse-mode automatic differentiation (AD) traverse in opposite directions, giving very different algorithms.

Instructors: Alan Edelman, Steven G. Johnson

Course Info

Departments
As Taught In
January IAP 2023
Learning Resource Types
Lecture Videos
Lecture Notes
Problem Sets with Solutions
Readings
Instructor Insights