Glossary · Infrastructure
Time to first token
Time to first token is the delay between sending a prompt to a language model and receiving the first piece of its response, which largely determines how fast a streaming answer feels.
Time to first token sits in the Infrastructure part of the Agentik {OS} glossary, which defines the words used to build and run AI agent systems.
Also called TTFT.