LLMOps

LLMOps is the adaptation of MLOps to applications built on large language models, covering prompt and model versioning, evaluation, cost and latency monitoring, tracing and safe deployment.

LLMOps sits in the Infrastructure part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.