← Back to the AI Glossary 📖 Infrastructure & Ops

Cold Start

The extra delay before an AI system responds to its very first request in a while, as opposed to already-active requests that benefit from a "warmed up" system.

Serverless or infrequently-used AI deployments are especially prone to noticeable cold starts, which is one reason a first request can feel slower than the rest.
One of 60 free AI glossary terms
Plain-language definitions for the AI jargon you'll actually run into — no email needed, ever, for this section.
Browse the Full Glossary →
More in Infrastructure & Ops
Latency
The delay between sending a request to an AI model and receiving a response — lower latenc...
Inference
The process of actually running a trained AI model to generate a response — as opposed to...
Model Serving
The infrastructure and software responsible for actually running a trained model and handl...
GPU (Graphics Processing Unit)
Specialised computer hardware, originally built for video game graphics, that turned out t...