Layer normalization

Layer normalization is a technique that rescales the values within each individual example across a layer's features. It is standard in transformer models because it does not depend on batch size.

Layer normalization sits in the Foundations part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called LayerNorm, RMSNorm.