Lesson 436 of 1455
What a Token Actually Is (And Why It Matters for Your Prompts)
AI doesn't read words — it reads tokens. Knowing the difference makes you a better prompter.
Builders · AI Foundations · ~24 min read
What a Token Actually Is (And Why It Matters for Your Prompts)
AI doesn't read words — it reads tokens. Knowing the difference makes you a better prompter.
What to actually do
- English averages ~0.75 words per token
- Numbers, code, and rare words use way more tokens
- Long prompts = real cost; concise prompts = real savings
Key terms in this lesson
The big idea: AI thinks in tokens, not words. Once you see the split, you write better prompts.
Practice this safely
Try this with a school, hobby, or family example where the stakes are low. Use the AI output as a draft you can question, not as the final answer.
- 1Ask AI to explain tokens in plain language, then underline anything that sounds uncertain or too broad.
- 2Give it one detail from "What a Token Actually Is (And Why It Matters for Your Prompts)" and ask for two possible next steps plus one reason each step might be wrong.
- 3Check tokenization against a trusted source, teacher, adult, expert, or original document before you use it.
End-of-lesson quiz
Check what stuck
8 questions · Score saves to your progress.
Lesson help
Questions are best handled with a grown-up here.
For this age range, Tendril keeps freeform AI chat paused until parent/guardian consent and child-safe moderation are fully verified. Use the quiz, notes, and related lessons below, or ask a parent, guardian, teacher, or librarian to work through the question with you.
Progress saved locally in this browser. Sign in to sync across devices.
Related lessons
Keep going
Builders · 40 min
Why AI 'Forgets' Halfway Through a Long Chat
AI has a memory limit called the context window. Hitting it explains a LOT of weird behavior.
Creators · 9 min
AI Tokenization Byte Fallback: How Vocabularies Handle the Unknown
AI can explain AI tokenizer byte fallback and vocabulary trade-offs, but the production tokenizer choice is a data and modeling decision.
Creators · 11 min
How AI Models See Text: Tokens, Context, and Why It Matters
A practical understanding of tokens that changes how you prompt and budget.