Text Generation

Text Generation

Share this post

Text Generation
Text Generation
A Language Model From 34 Years Ago

A Language Model From 34 Years Ago

An overview of Statistical Language Models

Iulia Brezeanu's avatar
Iulia Brezeanu
Mar 24, 2024
∙ Paid
2

Share this post

Text Generation
Text Generation
A Language Model From 34 Years Ago
Share
open book lot

Statistical Language Models (SLMs) were a game-changer in the 1990s for natural language processing and information retrieval tasks.

The core idea behind SLMs was to predict the next word based on the most recent context, using the Markov assumption which refers to the simplification that the probability of a word occurring in a sequence depends only on…

Keep reading with a 7-day free trial

Subscribe to Text Generation to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Donato Riccio
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share