18.S096 | January IAP 2023 | Undergraduate

Matrix Calculus for Machine Learning and Beyond

Lecture 7 Part 1: Derivatives of Random Functions

Description: Even if a function f is stochastic (has random numbers in it), we can still define a derivative “on average” (whose expectation value is the derivative of the expectation value of f), for example, for stochastic gradient descent in machine learning.

Instructors: Alan Edelman, Steven G. Johnson

Course Info

January IAP 2023
Editable Files
Instructor Insights
Lecture Notes
Lecture Videos
Problem Set Solutions
Problem Sets
Readings