Lec 07. Scaling Rules for Optimization
This video explores neural computation from a spectral perspective, discusses feature learning and hyperparameter transfer, and presents scaling rules for transferring hyperparameters across network width and depth.
Course Info
Instructors
Departments
As Taught In
Fall
2024
Level
Learning Resource Types
notes
Lecture Notes
theaters
Lecture Videos
assignment
Problem Sets
grading
Projects with Examples
auto_stories
Readings
