Quantization

Quantization is a technique that stores a model's weights, and sometimes activations, with lower numerical precision, such as 8-bit or 4-bit numbers, reducing memory use and speeding up inference.

Quantization sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Model quantization.