Notes

Occasional writing on machine learning, interpretability, and the mathematics underneath both. RSS at /rss.xml.

When Bigger Models Generalize Better: The Double Descent Phenomenon

6 min readmachine-learning, generalization, theory

Classical bias-variance theory says oversized models memorize and fail to generalize. A closed-form linear regression result shows exactly why deep learning breaks that rule.