Lecture 24 (31/05/2024): Machine Translation and closing

Foundations of sequence-to-sequence models and their use within Huggingface.

Introduction to machine translation (MT) and history of MT. Overview of statistical MT. Beam search for decoding. Introduction to neural machine translation: the encoder-decoder neural architecture. The BLEU evaluation score. Performances and recent improvements. Neural MT: the encoder-decoder architecture; Attention in NMT.

Lecture 23 (30/05/2024): Introduction to Text Summarization

Text Summarization. Datasets, approaches. Extractive vs. abstractive summarization. Evaluation. ROUGE and its limitations. Factuality evaluation of summarization.