The premise
Pure engagement optimization in recommendation AI predictably promotes harmful content; better systems require explicit harm-reduction trade-offs.
What AI does well here
- Define harm categories explicitly (self-harm content, eating disorders, extremism) and de-promote them
- Trade off engagement for user wellbeing on identified harm vectors
- Maintain human review of edge-case content rather than pure-AI moderation
- Surface metrics tracking both engagement AND user wellbeing
What AI cannot do
- Eliminate all harm without sacrificing some engagement
- Substitute pure-AI moderation for human judgment on novel cases
- Make recommendation systems neutral (they always have values)
End-of-lesson check
10 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-ethics-safety-AI-recommendation-amplification-adults
What is the main idea of "AI Recommendation Systems: When Engagement Optimization Harms Users"?
- Recommendation AI optimized for engagement can promote harmful content. Designing systems that resist this requires deliberate trade-offs.
- Use AI as the final authority for the whole decision
- Avoid checking the answer once it sounds polished
- Focus only on speed instead of judgment
Which concept is most central to "AI Recommendation Systems: When Engagement Optimization Harms Users"?
- engagement optimization
- recommendation AI
- harm reduction
- trade-offs
Which use of AI fits this topic best?
- Eliminate all harm without sacrificing some engagement
- Let the AI decide what matters without your review
- Define harm categories explicitly (self-harm content, eating disorders, extremism) and de-promote them
- Use the answer before checking whether it fits the situation
Which limitation should you watch for in this topic?
- Define harm categories explicitly (self-harm content, eating disorders, extremism) and de-promote them
- Explain the topic in plain language
- Organize a draft for human review
- Eliminate all harm without sacrificing some engagement
What should a careful learner remember about "Recommendation system harm-reduction audit"?
- Use "Recommendation system harm-reduction audit" as a reminder to verify the AI output before anyone relies on it.
- Skip the context so the tool can guess faster
- Treat the output as private even after sharing it online
- Use the answer without checking the source
You want to use AI after this lesson. What is the safest next step?
- Act immediately because the AI answer is written clearly
- AI cannot make the human values or safety decision for you.
- Hide uncertainty so the final answer looks cleaner
- Use private or sensitive details before checking permission
How should AI output about recommendation AI be treated?
- As proof that no other source is needed
- As a replacement for context, consent, or expert review
- As a draft or helper output that still needs human judgment and verification
- As something that becomes correct when it sounds confident
Name one way to verify an AI answer about recommendation AI.
Which action would help you apply "AI Recommendation Systems: When Engagement Optimization Harms Users" responsibly?
- Substitute pure-AI moderation for human judgment on novel cases
- Use the tool to avoid thinking through the tradeoff
- Keep going even if the output conflicts with a trusted source
- Trade off engagement for user wellbeing on identified harm vectors
Which choice is a bad use of AI for this lesson?
- Substitute pure-AI moderation for human judgment on novel cases
- Define harm categories explicitly (self-harm content, eating disorders, extremism) and de-promote them
- Ask for a plain-language explanation of engagement optimization
- Compare the answer with a trusted source