Lecture 21 (13/05/2021, 2.5 hours): attention and Transformers

Introduction to the attention in deep learning: motivation, attention scores, approaches. The Transformer architecture. Introduction to BERT.