PagedAttention

PagedAttention is a memory management technique for the KV cache, introduced with vLLM, that stores attention data in fixed-size blocks like virtual memory pages to reduce waste and serve more requests at once.

PagedAttention sits in the Infrastructure part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.