AI and Supervising an Agent: When to Let It Run

End-of-lesson check

15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-builders-agentic-AI-and-supervising-an-agent-r12a4-teen

1. Which sentence best captures the main idea of 'AI and Supervising an Agent: When to Let It Run'?

   1. Agents and chatbots are the same thing in every way
   2. Agents should always run without limits or oversight
   3. Tools and goals are unnecessary for agent design
   4. Agents make mistakes that cost money or break things — knowing when to supervise vs let it go is the new skill.

2. Which of the following is part of 'Some examples'?

   1. Claude Code's 'plan mode' = AI proposes, you approve.
   2. Skip every form of evaluation
   3. Avoid taking any actions in the world
   4. Use the most expensive model regardless of fit

3. Which of the following is part of 'The rule'?

   1. New agent = full supervision; trusted agent = approved plans; never = blanket trust.
   2. Approve all actions automatically
   3. Always run with no oversight
   4. Run unbounded retries on any error

4. Which of the following is part of 'You did it!'?

   1. Run unbounded retries on any error
   2. Ignore cost when scaling
   3. Hide tool calls from the operator
   4. You just learned the safety habit professional agent users are still developing.

5. What is 'supervision' in this context?

   1. A reason to skip all logging
   2. A trick to bypass approvals
   3. A way to disable the agent's tools
   4. A core concept covered in AI and Supervising an Agent: When to Let It Run

6. What is 'oversight' in this context?

   1. A way to disable the agent's tools
   2. A trick to bypass approvals
   3. A reason to skip all logging
   4. A core concept covered in AI and Supervising an Agent: When to Let It Run

7. What is 'risk' in this context?

   1. A trick to bypass approvals
   2. A way to disable the agent's tools
   3. A reason to skip all logging
   4. A core concept covered in AI and Supervising an Agent: When to Let It Run

8. What does it mean to 'supervise' an AI agent well?

   1. Never let it run without you watching
   2. Set goals and guardrails, then review checkpoints and outcomes
   3. Watch every keystroke in real time
   4. Disable its tools entirely

9. Which signal best tells you an agent is stuck in a runaway loop?

   1. It keeps repeating the same tool call with no new progress
   2. It asks one clarifying question
   3. It returns a short summary and stops
   4. It finishes the task in one step

10. Which is the best way to think about an agent's 'autonomy level'?

    1. Autonomy does not affect risk
    2. It is a slider from suggestion only, to ask-then-act, to act-then-report, to fully autonomous
    3. It depends only on the model size
    4. It is binary — fully autonomous or not

11. An agent quietly retries a failed payment 50 times overnight. What design principle was missing?

    1. More creative prompting
    2. A bigger context window
    3. A larger model
    4. Bounded retries with human notification on repeated failure

12. Why does an AI agent need 'tools' such as a browser, calendar, or code runner?

    1. Tools replace the need for any prompts
    2. Tools shrink the context window
    3. Tools let the agent take actions in the world instead of only producing text
    4. Tools make the model speak more naturally

13. What is the safest first place to deploy a brand new agent?

    1. On a public server with no auth
    2. Inside a critical billing system
    3. Production, against real customers
    4. A sandbox or low-stakes task with reversible actions

14. Why does a multi-agent system sometimes outperform a single agent on complex jobs?

    1. More agents always means more accuracy
    2. Multiple agents always cost less
    3. Single agents cannot use tools
    4. Specialized roles can divide work and check each other

15. What does an 'eval' for an agent measure?

    1. The exact wording of every prompt
    2. The temperature setting
    3. Whether the agent reliably completes a defined task end to end
    4. How polite the model sounds