Lec 20. Scaling Laws
This video covers scaling laws in neural architectures, including power laws, their limitations, theoretical foundations, and the concept of critical batch size.
Course Info
Instructors
Departments
As Taught In
Fall
2024
Level
Learning Resource Types
notes
Lecture Notes
theaters
Lecture Videos
assignment
Problem Sets
grading
Projects with Examples
auto_stories
Readings