Lecture 19 (07/05/2020, Google meet, 3 hours): Transformer (2/2) and BERT

The Transformer's encoder and decoder. Positional embeddings. BERT. Notebooks on BERT. Sense embeddings with WordNet and SemCor.