Text Generation

Text Generation

Share this post

Text Generation
Text Generation
Optimize your RAG pt.1 - Data ingestion

Optimize your RAG pt.1 - Data ingestion

Advanced data ingestion techniques for RAG

Iulia Brezeanu's avatar
Iulia Brezeanu
Jan 17, 2024
∙ Paid
1

Share this post

Text Generation
Text Generation
Optimize your RAG pt.1 - Data ingestion
1
Share
Naive RAG flowchart

The naive RAG flowchart is made out of three main steps. First, external data is split into chunks of text, where each partition is tokenized and transformed into a vectorial representation using an embedding model.

Text Generation is a reader-supported publication. To receive new posts and support my work, consider becoming a free or…

Keep reading with a 7-day free trial

Subscribe to Text Generation to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Donato Riccio
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share