Multimodal RAG

Multimodal RAG is retrieval-augmented generation over sources that include images, tables, audio or video as well as text, retrieving the relevant items and passing them to a multimodal model.

Multimodal RAG sits in the Retrieval & memory part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.