Lecture 22 (17/05/2021, 2.15 hours): BERT, GLUE and SuperGLUE benchmarks, Word Sense Disambiguation

Byte Pair Encodings (BPEs). BERT. RoBERTa. XLM-R. Evaluation: GLUE and SuperGLUE benchmarks. 

Introduction to Natural Language Understanding (NLU): Word Sense Disambiguation, Semantic Role Labeling, Semantic Parsing. Lexical substitution.