Probabilistic Models and Language Models
Overview
In this part, we introduce the concept of language models. We start by discussing probabilities and predictions, and then move on to probability distributions and probabilistic models. We then discuss the work that led to the development of language models and introduce a specific language model called the word n-gram language model.
The chapters in this part are as follows.
- Probabilities and Predictions introduces the concept of probabilities and outlines the possibility of making predictions based on data.
- Probability Distributions and Probabilistic Models outlines the idea of patterns emerging from large amounts of data through discussing probability distributions and the law of large numbers, and presents the term probabilistic model.
- Towards Language Models defines the term “language model” and presents some of the foundational work that led to the development of language models.
- Word n-gram Language Model introduces a specific language model called the word n-gram language model.