Human evaluation

Human evaluation is the assessment of AI outputs by people, who rate or compare responses on criteria such as accuracy, helpfulness and tone, often serving as the reference for automated metrics.

Human evaluation sits in the Evaluation & safety part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Human review, Human rating.