Throughput

Throughput is the total amount of work an AI system completes in a given time, such as requests or tokens processed per second across all users, reflecting capacity rather than single-request speed.

Throughput sits in the Infrastructure part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.