Context Window Discipline: What Fits in AI's Memory
Pasting a 50-page document plus your question often gets a worse answer than pasting just the relevant 2 pages.
17 min · Reviewed 2026
The big idea
Models have a 'context window' — how much text they can read at once. Modern Claude and GPT can hold 200k+ tokens, but performance degrades the more junk is in there. Curating the context (only what matters) beats dumping everything in.
Some examples
You paste a whole textbook to ask one question — Claude misses the answer that was on page 4.
You paste only chapters 3 and 4 — Claude nails it.
You include 10 PDFs of documentation — the model gets confused which one matters.
You include only the 1 PDF that's relevant + a clear question — the model is sharp.
Try it!
Take a long document and a question about it. First, ask with the whole doc. Then, ask with only the section you think is relevant. Compare quality.
End-of-lesson check
15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-builders-prompting-context-window-discipline-r8a8-teen
What is a context window in an AI language model?
The maximum amount of text the model can read and consider at one time when generating a response
The amount of memory required to install the model on a computer
The time period during which the model was trained on data
The space where the model stores its training data for reference
A student pastes an entire 300-page history textbook into a prompt and asks when World War II ended. The AI gives a confusing or incorrect answer. What is the most likely reason?
The textbook contains contradictory information that confused the AI
The AI was not trained on history topics
The relevant information is buried in too much irrelevant text, making it harder for the model to identify
The model cannot read more than 100 pages at once
What skill does the lesson compare to effective prompting with context curation?
Being a translator, who converts information between languages
Being a librarian, who carefully selects relevant materials for a query
Being a packrat, who saves everything just in case
Being a detective, who investigates all available evidence
What is meant by 'context curation' in AI prompting?
Expanding your context window by upgrading your AI subscription
Writing longer and more detailed prompts to give the AI more information
Storing useful AI responses for future conversations
Carefully selecting only the most relevant information to include in your prompt
You have a 50-page research paper and want to ask about the methodology section. What is the best prompting approach?
Ask the question first without any document, then paste the paper
Paste only the methodology section along with your question
Paste all 50 pages so the AI has full context
Copy the abstract and conclusion, skipping the middle sections
What does the term 'needle in a haystack' refer to in AI prompting?
When important information gets lost in a large amount of irrelevant text
When an AI is searching for a specific word in its training data
When you ask an AI to find a physical needle in real life
When the AI provides an answer that is completely wrong
A developer includes 10 different PDF documentation files in their prompt but gets confused answers from the AI. What likely went wrong?
The AI cannot read PDF files properly
The documentation files are too old for the AI to understand
The AI needs all 10 files to give any answer at all
The AI got confused trying to determine which documentation was relevant to the question
Modern AI models like Claude and GPT can handle 200,000+ tokens. Why is still important to limit what you paste?
Modern models cannot actually read that many tokens accurately
Tokens beyond 200,000 cause the AI to crash
The 200,000 token limit only applies to output, not input
Even within the token limit, performance degrades when irrelevant information dilutes the relevant content
What happens when you ask an AI about a document after pasting only the relevant section versus pasting the entire document?
The answers are identical because the AI reads everything equally well
The relevant section alone never produces correct answers
The answer is usually sharper and more accurate with just the relevant section
The entire document always produces better answers because it has more information
If you paste a whole textbook to ask one question, what is the AI likely to do?
Refuse to answer because the textbook is too long
Miss the answer that was in an earlier section because it got lost in the text
Read the entire textbook perfectly and find the exact answer
Only answer questions about the first chapter
Which statement best describes the relationship between context size and answer quality in AI prompting?
Answer quality is completely unrelated to how much context you provide
More context always produces better answers regardless of relevance
Less context always produces wrong answers
More context only helps when it is all relevant; mixed relevant and irrelevant context often hurts
What should you do before pasting a long document into an AI prompt?
Paste everything because the AI will automatically find what matters
Identify and paste only the sections most likely to contain the answer to your question
Delete all formatting and only paste plain text
Copy only the title and first paragraph
Why might an AI give a worse answer when you include documentation files that don't relate to your question?
The unrelated files create noise that makes it harder for the model to identify what actually matters
The AI cannot read more than one file at a time
The AI becomes overloaded and stops processing entirely
Including multiple files always makes the AI slower but not less accurate
What is the key difference between a librarian approach and a packrat approach to AI prompting?
A librarian selects only relevant information; a packrat includes everything available
A librarian uses technical terms; a packrat uses simple language
A librarian writes longer prompts; a packrat writes shorter ones
A librarian asks yes/no questions; a packrat asks open-ended questions
When would pasting an entire document be appropriate?
Only when the document is shorter than 10 pages
When your question genuinely requires understanding the whole document, such as summarizing it
Never, because you should always paste only partial sections