18.S096 | January IAP 2023 | Undergraduate

Matrix Calculus for Machine Learning and Beyond

Lecture 7 Part 1: Derivatives of Random Functions

Description: Even if a function f is stochastic (has random numbers in it), we can still define a derivative “on average” (whose expectation value is the derivative of the expectation value of f), for example, for stochastic gradient descent in machine learning.

Instructors: Alan Edelman, Steven G. Johnson

Course Info

Departments
As Taught In
January IAP 2023
Learning Resource Types
Lecture Videos
Lecture Notes
Readings
Instructor Insights
Editable Files
Problem Sets
Problem Set Solutions