Top-k sampling

Top-k sampling is a text generation method that restricts the choice of each next token to the k most probable candidates, then samples among them.

Top-k sampling sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Top-k.