Lecture 12 (14/04/2023, 4.5 hours): neural language modeling, the attention mechanism, the Transformer

Neural language modeling. Context2vec. Neural language models with BiLSTMs. Contextualized word representations. Introduction to the attention. Introduction to the Transformer architecture.