A Language Model From 34 Years Ago
An overview of Statistical Language Models
Statistical Language Models (SLMs) were a game-changer in the 1990s for natural language processing and information retrieval tasks.
The core idea behind SLMs was to predict the next word based on the most recent context, using the Markov assumption which refers to the simplification that the probability of a word occurring in a sequence depends only on…
Keep reading with a 7-day free trial
Subscribe to Text Generation to keep reading this post and get 7 days of free access to the full post archives.