6.7960 | Fall 2024 | Undergraduate, Graduate

Deep Learning

Lec 20. Scaling Laws

This video covers scaling laws in neural architectures, including power laws, their limitations, theoretical foundations, and the concept of critical batch size.

Learning Resource Types
Lecture Notes
Lecture Videos
Problem Sets
Projects with Examples
Readings