Lecture 2: morphological analysis and language models

We continued our introduction to regular expressions in Perl. We also introduced finite state transducers for encoding the lexicon and orthographic rules. Today's lecture is about language models. We discussed the importance of language models and how we can approximate real language with them. We introduced N-gram models (unigrams, bigrams, trigrams), together with their probability modeling and issues.