6.7960 | Fall 2024 | Undergraduate, Graduate

Deep Learning

Lec 20. Scaling Laws

This video covers scaling laws in neural architectures, including power laws, their limitations, theoretical foundations, and the concept of critical batch size.

Lecture Notes
Lecture Videos
Problem Sets
Projects with Examples
Readings