Skip to the content
AI and Cybersecurity Learning and Practice Center Test automation Open the Learning Center

Glossary

Token

The unit a language model reads and writes: a character, part of a word, a whole word or a punctuation mark. Prices and usage limits are counted in tokens.

OpenAI's rule of thumb for English is about four characters, or three quarters of a word, per token, and it varies by model and language. Token budgets are one of the usage ceilings OWASP asks for on agents.

Open the glossary in the Learning Center