Sampling

Sampling is the process of choosing each next token randomly according to the model's predicted probabilities, often shaped by settings such as temperature, top-p, and top-k.

Sampling sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Decoding, Token sampling.