AI gateway

An AI gateway is a proxy between applications and model providers that centralizes access to multiple models, adding features such as key management, routing, fallbacks, caching, cost tracking and logging.

AI gateway sits in the Infrastructure part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called LLM gateway, LLM proxy.