IBM Watson on Jeopardy, 2011

End-of-lesson check

15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-history-watson-2011-builders

1. In what year did IBM's Watson compete on the game show Jeopardy?

   1. 2013
   2. 2015
   3. 2009
   4. 2011

2. Which two champion Jeopardy players did Watson compete against?

   1. Ken Jennings and James Holzhauer
   2. Brad Rutter and James Holzhauer
   3. Ken Jennings and Brad Rutter
   4. Ken Jennings and Matt Jackson

3. Which of the following best describes the type of AI system Watson was?

   1. A simple rule-based chatbot
   2. A massive ensemble of classical NLP techniques
   3. A neural network trained on game show data
   4. An early example of generative AI

4. What was unusual about Watson's answer in a US Cities category clue?

   1. It named a fictional city
   2. It answered Toronto, which is in Canada
   3. It answered a city that didn't exist
   4. It refused to answer because it was uncertain

5. How many POWER7 cores did Watson run on during the Jeopardy matches?

   1. 10,000 cores
   2. 2,880 cores
   3. 500 cores
   4. 1,000 cores

6. What problem did Watson sometimes exhibit during gameplay that revealed a limitation?

   1. Refusing to buzz in
   2. Speaking the questions aloud
   3. Repeating an opponent's wrong answer
   4. Inventing new categories

7. After the Jeopardy matches, what industry did IBM immediately try to apply Watson's technology to?

   1. Social media
   2. Healthcare and medicine
   3. Financial services
   4. Video gaming

8. What happened to IBM's Watson Health division by 2022?

   1. Watson Health won a medical breakthrough award
   2. Watson Health merged with a pharma company
   3. IBM sold much of Watson Health
   4. Watson Health became the company's main product

9. What did Ken Jennings write on his Final Jeopardy answer sheet?

   1. The machines have won
   2. I for one welcome our new computer overlords
   3. AI will save humanity
   4. Watson is our friend

10. What was the main reason Watson struggled with Jeopardy's clues?

    1. The buzzer system was unfair
    2. Clues use puns, misdirection, and implicit category knowledge
    3. The judges spoke too quickly
    4. The questions were too easy

11. What did Watson's odd betting behavior reveal about its decision-making?

    1. Its confidence calculus didn't always reflect common sense
    2. It was programmed to lose on purpose
    3. It didn't understand money
    4. It was trying to entertain viewers

12. What is the name of the question-answering technology that Watson used?

    1. BERT
    2. DeepBlue
    3. DeepQA
    4. TensorFlow

13. What fundamental lesson does the Watson story illustrate about AI?

    1. AI can solve any problem if given enough data
    2. Winning a game show and transforming medicine are very different problems
    3. Neural networks are always better than classical AI
    4. Game shows are the best test of AI capability

14. What was wrong with Watson's hardware setup in terms of its processing power?

    1. Nothing—it was massively powerful with thousands of cores
    2. It used standard laptop processors
    3. It used outdated 1990s technology
    4. It ran on a single slow processor

15. Why did hospitals find Watson Health tools difficult to use?

    1. The system was too expensive
    2. Results were underwhelming and hard to integrate into workflows
    3. The technology was too simple
    4. The AI gave too many answers