Grouped-query attention

Grouped-query attention is a transformer attention variant in which several query heads share the same key and value heads, reducing memory use during inference with little loss in quality.

Grouped-query attention sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called GQA, Multi-query attention.