logo

This website uses cookies to ensure you get the best experience on our website.

Read through the Privacy Policy to understand better

 Go Back

Child welfare algorithm faces Justice Department scrutiny

By SALLY HO and GARANCE BURKE - Jan 31, 2023, 10:03 PM ET
Last Updated - Aug 06, 2024, 03:26 AM EDT
AI_image
The interest from federal civil rights attorneys comes after an AP investigation revealed potential bias and transparency issues surrounding the increasing use of algorithms within the troubled child welfare system in the U.S. While some see such opaque tools as a promising way to help overwhelmed social workers predict which children may face harm, others say their reliance on historical data risks automating past inequalities

The Justice Department has been scrutinizing a controversial artificial intelligence tool used by a Pittsburgh-area child protective services agency following concerns that the tool could lead to discrimination against families with disabilities, The Associated Press has learned

PITTSBURGH (AP) — The Justice Department has been scrutinizing a controversial artificial intelligence tool used by a Pittsburgh-area child protective services agency following concerns that the tool could lead to discrimination against families with disabilities, The Associated Press has learned. 

The interest from federal civil rights attorneys comes after an AP investigation revealed potential bias and transparency issues surrounding the increasing use of algorithms within the troubled child welfare system in the U.S. While some see such opaque tools as a promising way to help overwhelmed social workers predict which children may face harm, others say their reliance on historical data risks automating past inequalities. 

Sponsored

Several civil rights complaints were filed in the fall about the Allegheny Family Screening Tool, which is used to help social workers decide which families to investigate, AP has learned. The pioneering AI program is designed to assess a family’s risk level when they are reported for child welfare concerns in Allegheny County.  

Two sources said that attorneys in the Justice Department’s Civil Rights Division cited the AP investigation when urging them to submit formal complaints detailing their concerns about how the algorithm could harden bias against people with disabilities, including families with mental health issues.  

By continuing to use this site, you agree to our terms and conditions
Sponsored
Sponsored
Sponsored
Our Offices
  • 10kInfo, Inc.
    13555 SE 36th St
    Bellevue, WA 98006
    Phone: +1 (425) 414-0184
  • 10kInfo Data Solutions, Pvt Ltd.
    Claywork Create
    11 km, Arakere Bannerghatta Rd, Omkar Nagar, Arekere,
    Bengaluru, Karnataka 560076
    Phone: +91 80 4902 2100
4.2 20250324