Concept

Token

A unit of text processed by a model; it does not map exactly to a word.

In practice

The same sentence may use different token counts across languages.

Why it matters

Use the term as an operating concept, not jargon. Ask what it changes in cost, quality, evidence, latency, security or user experience.

Back to glossary →