Loading lesson…
Asking a model to 'think step by step' makes it better at hard problems. Here is why, and when it fails.
Chain-of-thought (CoT) prompting is the discovery that LLMs are often wildly better at multi-step problems when asked to reason aloud rather than answer in one shot. Wei et al. (2022) documented this effect across math, logic, and commonsense reasoning.
Without CoT:
Q: If I have 5 apples and buy 3 more,
then eat 2, how many do I have?
A: 6
With CoT:
Q: (same)
A: Let me think step by step.
Start with 5 apples. Buy 3 more → 5 + 3 = 8.
Eat 2 → 8 - 2 = 6. The answer is 6.CoT looks verbose but consistently improves correctness on multi-step problemsSince 2024, models like OpenAI's o1, o3, Claude with extended thinking, and DeepSeek-R1 have been explicitly trained to reason for a long time before answering. Test-time compute is now a core axis of capability, distinct from parameter scaling.
| Standard CoT (prompted) | Trained reasoning model |
|---|---|
| Works at inference only | Baked into training |
| Quality depends on the prompt | Robust to prompt wording |
| Limited by context length | Long internal deliberation |
| Can be coaxed to faster | Explicitly uses more compute per query |
Chain-of-thought prompting significantly improves the ability of large language models to perform complex reasoning.
— Wei et al., Chain-of-Thought Prompting (2022)
The big idea: making thinking visible usually makes thinking better. But visible is not the same as faithful — and that distinction matters.
15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-creators-chain-of-thought
What is the core idea behind "Chain-of-Thought Mechanics"?
Which term best describes a foundational idea in "Chain-of-Thought Mechanics"?
A learner studying Chain-of-Thought Mechanics would need to understand which concept?
Which of these is directly relevant to Chain-of-Thought Mechanics?
Which of the following is a key point about Chain-of-Thought Mechanics?
Which of these does NOT belong in a discussion of Chain-of-Thought Mechanics?
Which statement is accurate regarding Chain-of-Thought Mechanics?
Which of these does NOT belong in a discussion of Chain-of-Thought Mechanics?
What is the key insight about "Faithfulness is an open question" in the context of Chain-of-Thought Mechanics?
What is the recommended tip about "Ground your practice in fundamentals" in the context of Chain-of-Thought Mechanics?
Which statement accurately describes an aspect of Chain-of-Thought Mechanics?
What does working with Chain-of-Thought Mechanics typically involve?
Which of the following is true about Chain-of-Thought Mechanics?
Which best describes the scope of "Chain-of-Thought Mechanics"?
Which section heading best belongs in a lesson about Chain-of-Thought Mechanics?