Self-attention

Self-attention is a form of attention in which each element of a sequence, such as a token, looks at all other elements of the same sequence to decide which ones matter for its meaning.

Self-attention sits in the Foundations part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Scaled dot-product attention.