← Back to the AI Glossary 📖 Infrastructure & Ops

Model Serving

The infrastructure and software responsible for actually running a trained model and handling incoming requests to it in production.

This is a distinct discipline from training a model — a lab can build a brilliant model that still needs careful engineering to serve reliably at scale.
One of 60 free AI glossary terms
Plain-language definitions for the AI jargon you'll actually run into — no email needed, ever, for this section.
Browse the Full Glossary →