Adam

Adam is a popular optimization algorithm that adapts the learning rate for each parameter using running averages of past gradients and their squares. It is widely used to train deep neural networks.

Adam sits in the Foundations part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Adam optimizer, AdamW.