Building Your Own Songwriter: Write a Song Like Ed-Sheeran With nanoGPT

Quickly train a baby GPT to generate Ed Sheeran-style music.

Ed Sheeran teaching baby GPT how to compose cheesy love songs. Image generated with Dall-E 2.

Recently I watched the tutorial Let’s build GPT: from scratch, in code, spelled out by Andrej Kapathy, in which he walks through the process of constructing a baby GPT model, also known as nanoGPT, from the ground up and explains what is going…