A token is the small chunk of text an AI model breaks language into, often smaller than a single word. When a chatbot answers a question, the model generates these tokens one at a time. Cloud providers and chipmakers argue that even pricier GPUs still pay off as long as the cost of processing one token keeps falling, and that math sits at the center of the AI capex case.