Preetum Nakkiran

I'm a 5th-year PhD student at Harvard, in the Theory of Computation and ML Theory Groups, advised by Madhu Sudan and Boaz Barak.

I'm currently trying to understand why deep learning works. I do theory by doing experiments.

[publications]     [CV]     [twitter]     preetum@cs.harvard.edu

News:

Recent Invited Talks

I'm happy to speak about my works and interests. Currently, I will likely speak about The Deep Bootstrap, Distributional Generalization, or musings about scaling.

Research

I take a scientific approach to machine learning— trying to advance understanding through basic experiments and foundational theory.

See [publications] for full list of papers.

Machine Learning Theory

Theory

Machine Learning

Deep Double Descent
Dynamics of SGD
Gauss's Principle of Least Action

About Me

I did my undergrad in EECS at UC Berkeley. I'm broadly interested in theory and science.

In the past, I have interned at OpenAI (with Ilya Sutskever) Google Research (with Raziel Alvarez), Google Brain (with Behnam Neyshabur, Hanie Sedghi), and have also done research in error-correcting codes, distributed storage, and cryptography. I am partially supported by a Google PhD Fellowship, and I am grateful for past support from NSF GRFP.

See also my old website for more. This version borrowed in part from Luca Trevisan and Jon Barron.

What People are Saying

a "high-level" scientist   —colleague (ML)

makes plots and draws lines through them
            —colleague (TCS)

has merits that outweigh flaws   —reviewer 2