Vocabulary

A vocabulary is the fixed set of tokens a tokenizer and language model can recognize and produce, each mapped to a unique numeric ID.

Vocabulary sits in the Prompting & context part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called tokenizer vocabulary, vocab.