Deep Dive: Building GPT from scratch - part 7

Sponsored by

Hello and welcome back to the series on Starter AI. It’s Miko again, from vaguely spring-like London.

Today, we’re back from the side quests, and we’re finally finishing up makemore. We’ll complicate the architecture and then  have an epiphany that the resulting code looks very much like WaveNet from the 2016 DeepMind paper. The lecture is shorter than usual, at just under an hour. Let’s do it!