Eval harness

An eval harness is software that runs a set of evaluation cases against a model or AI system, collects the outputs, applies scoring and reports results so tests can be repeated automatically.

Eval harness sits in the Evaluation & safety part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Evaluation harness, Evaluation framework.