# token (0-token.org) A token is a piece or unit of something larger. People talk about tokens at arcades, tokens of appreciation, or tokens as symbols that stand for something else. ## What a model may hear - text unit for models (natural language processing): split text into pieces for processing and count them for limits and billing - cryptographic token (security and authentication): treat it as a secret string for proving identity or accessing systems - blockchain token (cryptocurrency and web3): assume discussion of digital assets, smart contracts, or decentralized finance - programming token (compilers and parsers): break code into lexical units like keywords, operators, and identifiers - API rate limit (cloud services): track consumption quotas and throttle or charge based on usage ## Where people and models part ways - Says: "I ran out of tokens" Means: I need more arcade credits or my game subscription ended May be taken as: the model thinks you hit a text length limit or API quota Say instead: "I need more credits for my game subscription" - Says: "Send me a token for my birthday" Means: A small gift or symbolic gesture May be taken as: the model generates a cryptographic string or cryptocurrency Say instead: "Send me a small gift or symbolic gesture for my birthday" - Says: "How many tokens is this essay" Means: How many words or pages May be taken as: the model counts text units in its own format, giving a number that confuses the person Say instead: "How many words is this essay, in standard word count" - Says: "I bought some tokens" Means: Got arcade coins or loyalty points May be taken as: the model assumes cryptocurrency investment or trading Say instead: "I bought some arcade coins or loyalty points" ## Tips - Say 'word count' or 'character count' instead of 'token count' when you mean traditional measures - Add 'arcade' or 'game' before 'token' when you mean entertainment credits - Say 'security token' or 'password token' when you mean authentication, not cryptocurrency - Specify 'cryptocurrency token' or 'blockchain token' when you mean digital assets - Use 'symbol' or 'gesture' instead of 'token' when you mean something sentimental ## Often confused with - coin: physical currency, not a text unit - word: human-readable unit, not model-specific fragments - credential: always about identity, never about text or crypto assets - voucher: redeemable for goods, not processed by language models - NFT: a specific blockchain asset, not a general unit - ticket: entry or access pass, not a parsing unit