Calibration

Calibration is how closely a model's stated confidence matches its actual accuracy, so a well-calibrated model that reports 80 percent confidence on a set of answers is right about 80 percent of the time.

Calibration sits in the Evaluation & safety part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Model calibration.