Residual connection

A residual connection is a shortcut that adds a layer's input directly to its output, letting information and gradients bypass the layer. It makes very deep networks, including transformers, much easier to train.

Residual connection sits in the Foundations part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Skip connection, ResNet.