Pass@k

Pass@k is a code evaluation metric giving the probability that at least one of k generated solutions to a problem passes its tests, commonly reported as pass@1 for single attempts.

Pass@k sits in the Evaluation & safety part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.