Andrej KarpathyIntermediateFeatured
Neural Networks: Zero to Hero
Andrej Karpathy's from-scratch course. YouTube lectures plus notebooks for micrograd, makemore, and GPT.
Duration15+ hours
PriceFree
FormatVideo
LevelIntermediate
What you'll learn
- Backprop by writing a tiny autograd
- Language models from bigrams to transformers
- Tokenization and a GPT trained from scratch
- Exercises attached to each lecture
About this course
A free course that builds neural nets in code, from autograd to a GPT. Official hub: karpathy.ai/zero-to-hero.html. Notebooks live in the nn-zero-to-hero GitHub repo. We are not affiliated with Andrej Karpathy.
Prerequisites
Python and a willingness to pause the video and type.