Concept

Inference

Running a trained model to produce an output.

In practice

Every generation request to a model API performs inference.

Why it matters

Use the term as an operating concept, not jargon. Ask what it changes in cost, quality, evidence, latency, security or user experience.

Back to glossary →