Natural Language Processing

Text Classification using Transformers

Build a Transformer from scratch

Vatsal Saglani
7 min readMar 12, 2021

--

Source: Pixabay

1. Coding Transformer network in PyTorch

In this part, we will try to understand the Encoder-Decoder architecture of the Multi-Head Self-Attention Transformer network with some code in PyTorch. There won’t be any theory…

--

--

Vatsal Saglani

GenAI Developer, Software Engineer, Programmer & Deep Learning professional. https://vatsalsaglani.vercel.app