Test-time compute

Test-time compute is the computation a model spends while answering, rather than during training. Letting a model reason longer or sample more candidate answers at this stage can improve accuracy.

Test-time compute sits in the Models part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.

Also called Inference-time compute, Inference-time scaling.