Constrained decoding

Constrained decoding is a generation method that restricts which tokens a model may choose at each step so the output is guaranteed to follow a grammar, schema or regular expression.

Constrained decoding sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called grammar-constrained decoding, guided generation.