Next-token prediction

Next-token prediction is the training objective in which a language model learns to predict the most likely next token given all the tokens before it. Repeating this step generates text.

Next-token prediction sits in the Foundations part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Causal language modeling.