Kevin Roose@kevinroose
NYT tech columnist; Hard Fork podcast
Journalism research with LLMsContradiction-hunting
Representative of Kevin's reporting threads — using Claude to interrogate a 200-page SEC filing for claims that contradict public statements, then verifying each in the original source.
“The model is a junior researcher who never gets tired — and never knows when it's wrong.”
How to replicate
- 1.Upload the long document (filing, transcript, report) to Claude.
- 2.Provide the public narrative you want to stress-test, in 3 bullet points.
Prompt template
Here is the public narrative: <3 bullets>. Here is the document: <paste or upload>. List every claim in the document that contradicts, qualifies, or complicates each bullet. For each, give the page number and quote the exact sentence. If nothing contradicts a bullet, say so. Do not paraphrase.
Pitfall
Publishing a contradiction without verifying the page. Models hallucinate citations at a steady rate — every lead is unverified until your eyes hit the source.
What you'll learn
- •How to use an LLM as a tireless first-pass reader
- •Why page-number verification is non-negotiable
- •How to turn long documents into structured leads
- •Where journalistic judgment is still irreplaceable
#journalism#research#fact-check