← Back to the AI Glossary 📖 Infrastructure & Ops

On-Device AI

Running an AI model directly on a phone, laptop, or other local device, rather than sending requests to a server over the internet.

On-device AI is typically smaller and less capable than cloud models, but it's faster, works offline, and keeps data from ever leaving the device.
One of 60 free AI glossary terms
Plain-language definitions for the AI jargon you'll actually run into — no email needed, ever, for this section.
Browse the Full Glossary →
More in Infrastructure & Ops
Prompt Caching
A technique where an AI provider temporarily stores parts of a prompt it has seen before,...
Inference
The process of actually running a trained AI model to generate a response — as opposed to...
API (Application Programming Interface)
A defined way for one piece of software to talk to another — in AI, it's how developers se...
Latency
The delay between sending a request to an AI model and receiving a response — lower latenc...