Model serving

Model serving is the infrastructure and software that host a trained model and expose it to applications, usually through an API, handling requests, scaling, batching and monitoring in production.

Model serving sits in the Infrastructure part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.