How Models Work
Token
Definition
The basic unit of text a model reads and writes. Sometimes a full word, sometimes part of a word. 'ChatGPT is smart' is roughly 5 tokens.
Why it matters
Tokens directly affect cost (API pricing is per-token) and capability (context window size is measured in tokens).