Transformer

We start with the main NLP tasks and the architectures used before Transformers. We then look at why recurrent networks struggle with long dependencies, how attention works, and how it leads to the Transformer architecture.