Rotary position embedding

Rotary position embedding is a method for encoding token positions in a transformer by rotating query and key vectors, helping models handle relative positions. It is widely used in modern language models.

Rotary position embedding sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called RoPE.