AI picks each word by guessing which is most likely to come next.
7 min · Reviewed 2026
The big idea
AI writes one word at a time. For each word, it guesses which word is most likely to come next.
Some examples
After 'peanut butter and...' AI strongly guesses 'jelly.'
After 'I love...' the next word could be many things.
Each guess is a probability, like a weather forecast.
AI usually picks the highest one, but sometimes it explores.
Try it!
Type 'peanut butter and' to AI. Watch it pick 'jelly' (most of the time). Now type 'I love' — the answers will be very different each time.
End-of-lesson check
15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-explorers-foundations-AI-and-the-confidence-percent-r9a5
When an AI writes a sentence, how does it decide what word to put down next?
It looks up the complete sentence in a giant library of existing text
It asks a human for permission before writing each word
It guesses which word is most likely to come next based on what it has seen before
It randomly picks any word from a list
If you type 'I love' into an AI, why do you get very different answers each time?
The AI is broken and gives random answers
The AI only gives different answers on weekends
Many different words can reasonably follow 'I love,' so the AI picks from several likely options
The AI forgot what you typed and makes up new responses
What does the lesson compare probability to in order to help you understand it?
A rolling dice
A weather forecast
A coin flip
A deck of cards
What does 'next-token prediction' mean in simple words?
Predicting which computer key will be pressed next
Planning an entire story before writing it
Guessing the next word that will come after the current one
Remembering all the words in a sentence
If an AI says a word has a 90% probability of being next, what does that tell you?
The word has no chance of being chosen
The word is very likely to be chosen but not certain
The word will definitely be chosen
The word has been chosen already
The lesson says AI 'usually picks the highest' probability but 'sometimes it explores.' What does 'explores' mean here?
The AI stops writing and takes a break
The AI goes to a website to learn new words
The AI searches the internet for answers
The AI sometimes picks a less likely word to keep things interesting
A student says, 'AI must know what it wants to say before it starts writing.' Based on what you learned, is this true?
Yes, AI plans out its entire response before writing any words
No, AI decides each word one at a time, not knowing the full sentence ahead of time
Yes, but only for short sentences
No, AI never writes anything
What would happen if you typed 'The sky is' into an AI?
The AI would guess likely words to follow, like 'blue' or 'cloudy'
The AI would refuse to answer because the sentence is incomplete
The AI would write a completely random sentence about anything
The AI would ask you to finish the sentence
Why is it important that AI 'guesses' rather than 'knows' the correct answer?
Guessing is faster than knowing
There is no difference between guessing and knowing
Guessing means AI can be wrong, but knowing means AI is always right
AI doesn't truly understand—it uses patterns to make predictions, which can sometimes be wrong
What kind of 'model' is a language model like the one described in the lesson?
A system that has learned patterns from lots of text data
A person who speaks multiple languages
A physical computer inside a robot
A small toy that scientists play with
If you wanted the AI to write something very creative and surprising, what might you want it to do more often?
Pick more words with lower probability (explore more)
Stop writing after the first word
Always pick the highest probability word
Copy exactly what other websites write
Based on what you learned, which sentence best describes how AI generates text?
AI thinks of a whole story, then types it out all at once
AI writes one word, then uses that to guess the next, then uses that to guess the next, and so on
AI asks a human what to write, then types it
AI copies sentences from books it has memorized
Why might two different people get different responses from the same AI when typing the same prompt?
The AI is broken for one person
The AI doesn't really work
The AI might choose different words from among several likely options, or its settings might vary
One person is lying about what the AI said
What does it mean that AI writes by 'guessing the most likely next word, again and again'?
AI guesses randomly and never learns
AI only guesses once and then stops
AI makes one big guess about the whole story
AI guesses word by word, each new guess building on the previous words
A friend says, 'AI knows exactly what it's going to say before it starts writing.' Why is this misleading?
AI is too dumb to plan ahead
AI decides each word one at a time based on probability, not from a pre-planned message