AI and Counterfactual History Prompts: Pressure-Testing Causation

End-of-lesson check

15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-creators-research-AI-and-counterfactual-history-prompts-r13a7-creators

1. What is a counterfactual in historical analysis?

   1. A hypothetical scenario that changes one key event to test whether the claimed outcome still occurs
   2. A primary source document from the time period being studied
   3. A chronological listing of events in the order they actually happened
   4. A statistical model that predicts future trends based on past data

2. Why is a causal claim considered only as strong as its counterfactual?

   1. Because AI cannot generate counterfactuals for weak causal claims
   2. Because counterfactuals reveal whether the cause was truly necessary for the outcome
   3. Because academic journals require counterfactuals for publication
   4. Because causal claims without counterfactuals are automatically rejected by historians

3. Which task can AI reliably perform when working with counterfactuals?

   1. Proving that the counterfactual actually happened
   2. Constructing alternative scenarios with one variable changed
   3. Locating primary source documents that support the counterfactual
   4. Determining whether a counterfactual is historically plausible

4. What does it mean to 'stress-test' a causal chain?

   1. Examining each link in the causal reasoning to see if it holds under alternative conditions
   2. Comparing the cost of different research methods
   3. Applying pressure to historical documents to reveal hidden text
   4. Testing how much weight historical evidence can support

5. A researcher claims that 'World War I began because of the assassination of Archduke Franz Ferdinand.' Which question represents a proper counterfactual test of this claim?

   1. What if the assassination had never occurred—would the war have still happened?
   2. Who else was assassinated in Europe during that period?
   3. How many soldiers died in World War I?
   4. What were the economic consequences of the war?

6. What fundamental limitation does AI have when generating counterfactual scenarios?

   1. AI cannot process text longer than 500 words
   2. AI cannot generate fictional scenarios
   3. AI cannot access any historical information
   4. AI cannot determine whether the counterfactual is actually plausible in historical context

7. Why should AI counterfactuals not be used as the basis for published historical arguments?

   1. They are protected by copyright law
   2. They require payment to access
   3. They are always completely inaccurate
   4. They rest on training-data patterns rather than archival evidence

8. What is historiography?

   1. A type of historical document from the Ottoman Empire
   2. The process of archiving physical documents
   3. The study of how history is written and the methods historians use
   4. A statistical technique for analyzing population data

9. When AI constructs a counterfactual, what does it identify as necessary for that counterfactual to work?

   1. Exactly what will happen in the future
   2. What conditions would have to be true for the alternative scenario to make sense
   3. How many words are in the counterfactual narrative
   4. Which sources were used to train the AI model

10. A student uses AI to generate a counterfactual about the American Civil War and then cites the AI output as evidence in a school report. What is the primary concern with this approach?

    1. AI outputs are not archival evidence and should not replace primary source research
    2. AI outputs are always wrong about historical events
    3. AI outputs must be longer than 1,000 words to be credible
    4. Students are not allowed to use AI for any school assignments

11. What does it mean that AI counterfactuals 'sound rigorous' but may lack substance?

    1. They use very long and complicated sentences
    2. They cite many sources that do not exist
    3. They are well-written and confident but not based on actual evidence
    4. They are always shorter than human-written text

12. Which of the following is an example of pressure-testing a causal claim using a counterfactual?

    1. Writing a summary of what happened
    2. Removing the hypothesized cause from the scenario and tracing what happens next
    3. Memorizing the dates of important historical events
    4. Reading a textbook chapter about the event

13. The lesson notes that AI can list historians who have made similar counterfactual moves. What is the purpose of knowing this?

    1. To prove that those historians were wrong
    2. To avoid reading any other historical sources
    3. To copy the exact wording those historians used
    4. To understand that counterfactual reasoning has scholarly precedent and credibility

14. What distinguishes a valid counterfactual from pure speculation?

    1. A valid counterfactual is written by professional historians
    2. A valid counterfactual uses more words than speculation
    3. A valid counterfactual is grounded in evidence about what was historically possible
    4. A valid counterfactual is always published in journals

15. Why can AI generate compelling counterfactual narratives without understanding history?

    1. AI has read all historical archives and remembers them perfectly
    2. AI is sentient and experiences historical events
    3. AI is programmed with absolute historical truths
    4. AI recognizes patterns in how humans write about history and replicates those patterns