Skip to content

Glossary / Artificial intelligence

Token

Also called: AI token

A token is the small piece of text, a word or part of a word, that an AI reads and produces. It is its unit of measurement.

An LLM does not read whole words. It cuts the text into tokens: a short word is worth one, a long word is worth several. Model limits and prices are expressed in this unit. A long prompt uses more of them.

Each model has a context window, which is the maximum number of tokens it can process at once, question and answer included. AI services bill by the number of tokens read and written.

An example

A fifty-page contract exceeds the limit of a small model. It has to be split, or you have to switch to a model able to read more in one go.

AR Digital’s advice

Send the model what the task needs, not the whole file. The answers are better and the bill is lighter.

AR Digital / Contact

A project behind this word?

Thirty minutes, by video call or at the agency, to go from the definition to your own case. We tell you frankly what we would do, at what price and with what funding.

Radu Ulea, founder of AR Digital

Radu Ulea

Founder, AR Digital

“We tell you what works, what doesn’t, and what it costs. Then we do it.”

hello@ardigital.eu