Ingestion pipeline

An ingestion pipeline is the process that loads source content, cleans and parses it, splits it into chunks, generates embeddings and writes the results into an index for later retrieval.

Ingestion pipeline sits in the Retrieval & memory part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called data ingestion, indexing pipeline.