Load balancing

Load balancing is distributing incoming requests across multiple servers or model instances so no single one is overwhelmed, improving throughput, reliability and response times.

Load balancing sits in the Infrastructure part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Load balancer.