Decoder-only transformer

A decoder-only transformer is a transformer that uses only the decoder stack with causal attention, generating text left to right. Most large language models use this design.

Decoder-only transformer sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Causal transformer.