Tokens are not words. LLMs cut text into sub-word pieces, which is why GPT-5, Claude and Gemini read Italian, Japanese and Arabic almost as fluently as English.
Home
