- Starter AI
- Posts
- Deep Dive: Building GPT from scratch - part 2
Hello and welcome back to the Deep Dive into GPTs series on Starter AI. It’s Miko again, and today we’re continuing learning from Andrej Karpathy.
Last week, in part 1 of the series, we learned what a neural network was, and we followed Andrej’s explanation to calculate the gradients by hand. Today, we’re building up on that to finish up the implementation of micrograd. Buckle up, it’s going to be super fun!
Also, did you hear that Andrej quit OpenAI (again!) to work on some of his own projects? Looking forward to seeing what comes out of it!
Andrej’s tweet on Valentine’s day
Good luck to you, Andrej, and for us, let’s get learning!