When AI Predicts Child Welfare Risk

Some states use AI to predict which families need child protective services attention. The use is deeply controversial.

Allegheny County (Pittsburgh) uses an AI tool. Critics found it disproportionately flags families in poverty — even when child welfare isn't actually at risk.

Three concerns

• Poverty and risk get conflated
• Once flagged, families face real consequences
• Hard to challenge or appeal an algorithm

The big idea: Predictive child welfare AI affects the most vulnerable families. The systems need careful oversight.

Practice this safely

Try this with a school, hobby, or family example where the stakes are low. Use the AI output as a draft you can question, not as the final answer.

1. 1Ask AI to explain predictive risk modeling in plain language, then underline anything that sounds uncertain or too broad.
2. 2Give it one detail from "When AI Predicts Child Welfare Risk" and ask for two possible next steps plus one reason each step might be wrong.
3. 3Check child welfare against a trusted source, teacher, adult, expert, or original document before you use it.