Masked language modeling

Masked language modeling is a training objective in which some tokens in a sentence are hidden and the model learns to predict them from surrounding context. It is used to train models such as BERT.

Masked language modeling sits in the Foundations part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called MLM.