Embedding quantization

Embedding quantization is storing embedding values at lower numeric precision, such as 8-bit integers or single bits, to reduce memory use and speed up search at some cost to accuracy.

Embedding quantization sits in the Retrieval & memory part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called binary quantization, scalar quantization.