Course 02
Transformer architecture
- Thursday, 29 October 2026
- 12:15 – 13:45
- Online
On the programme
- 01Attention approximation
- 02MHA, MQA, GQA
- 03Position embeddings (regular, learned)
- 04RoPE and applications
- 05Transformer-based architectures
- 06BERT and its derivatives