Ready? Set? GO!!!

Amazing news! This year we will work on developing our own, next-generation Large Language Model! Register here to attend the class! IMPORTANT: we will start on March 6 (February: no lecture, will be at AAAI).

 

Lecture 24 (31/05/2024, 4h): Machine Translation and closing

Foundations of sequence-to-sequence models and their use within Huggingface.

Introduction to machine translation (MT) and history of MT. Overview of statistical MT. Beam search for decoding. Introduction to neural machine translation: the encoder-decoder neural architecture. The BLEU evaluation score. Performances and recent improvements. Neural MT: the encoder-decoder architecture; Attention in NMT.

Lecture 22 (24/05/2024, R+P): Introduction to Entity Linking and Relation Extraction

 Introduction to Entity Linking. Datasets, approaches. NER+ED. ExtEnD. BLINK. GENRE. EntQA. ReLiK. Introduction to Relation Extraction. Generative RE. REBEL. ReLiK (again!).

Lecture 23 (30/05/2024, Sc): Introduction to Text Summarization

Text Summarization. Datasets, approaches. Extractive vs. abstractive summarization. Evaluation. ROUGE and its limitations. Factuality evaluation of summarization.