Definition

Language models break text into tokens. A token is often a short word or part of a word. Tokens measure how much text a model can read at once and what a request costs when billed by usage.

For logins and access, token means something else: a digital key, similar to a password, with which a program or a person identifies itself. Like passwords, such tokens do not belong in a chat.

More terms

All terms