A technique where an AI provider temporarily stores parts of a prompt it has seen before, so repeated or similar requests process faster and cheaper.
This is especially useful for apps that reuse the same long instructions or documents across many separate requests.
One of 60 free AI glossary terms
Plain-language definitions for the AI jargon you'll actually run into — no email needed, ever, for this section.
Browse the Full Glossary →