{"id":603573,"date":"2023-01-31T21:00:00","date_gmt":"2023-02-01T03:00:00","guid":{"rendered":"https:\/\/news.sellorbuyhomefast.com\/index.php\/2023\/01\/31\/child-welfare-algorithm-faces-justice-department-scrutiny\/"},"modified":"2023-01-31T21:00:00","modified_gmt":"2023-02-01T03:00:00","slug":"child-welfare-algorithm-faces-justice-department-scrutiny","status":"publish","type":"post","link":"https:\/\/newsycanuse.com\/index.php\/2023\/01\/31\/child-welfare-algorithm-faces-justice-department-scrutiny\/","title":{"rendered":"Child welfare algorithm faces Justice Department scrutiny"},"content":{"rendered":"
\n
\n
\n
\n

SALLY HO and GARANCE BURKE<\/span>,\u00a0Associated Press<\/span><\/p>\n

\n

This is a carousel. Use Next and Previous buttons to navigate<\/p>\n

\n
\n\"FILE<\/picture>
1of<\/span>11<\/span>FILE – Case work supervisor Jessie Schemm looks over the first screen of software used by workers who field calls at an intake call screening center for the Allegheny County Children and Youth Services, in Penn Hills, Pa. The Justice Department has been scrutinizing a controversial artificial intelligence tool used by a Pittsburgh-area child protective services agency following concerns that it could result in discrimination against families with disabilities, The Associated Press has learned.<\/span>Keith Srakocic\/AP<\/span><\/figcaption><\/figure>\n<\/p><\/div>\n
    \n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n
  • <\/svg><\/li>\n<\/ul>\n<\/section>\n

    PITTSBURGH (AP) \u2014 The Justice Department has been scrutinizing a controversial artificial intelligence tool used by a Pittsburgh-area child protective services agency following concerns that the tool could lead to discrimination against families with disabilities, The Associated Press has learned.<\/p>\n

    The interest from federal civil rights attorneys comes after an AP investigation revealed potential bias and transparency issues surrounding the increasing use of algorithms within the troubled child welfare system in the U.S. While some see such opaque tools as a promising way to help overwhelmed social workers predict which children may face harm, others say their reliance on historical data risks automating past inequalities.<\/p>\n

    \n

    Several civil rights complaints were filed in the fall about the Allegheny Family Screening Tool, which is used to help social workers decide which families to investigate, AP has learned. The pioneering AI program is designed to assess a family\u2019s risk level when they are reported for child welfare concerns in Allegheny County.<\/p>\n

    Two sources said that attorneys in the Justice Department\u2019s Civil Rights Division cited the AP investigation when urging them to submit formal complaints detailing their concerns about how the algorithm could harden bias against people with disabilities, including families with mental health issues.<\/p>\n

    A third person told AP that the same group of federal civil rights attorneys also spoke with them in November as part of a broad conversation about how algorithmic tools could potentially exacerbate disparities, including for people with disabilities. That conversation explored the design and construction of Allegheny\u2019s influential algorithm, though the full scope of the Justice Department\u2019s interest is unknown.<\/p>\n

    All three sources spoke to AP on the condition of anonymity, saying the Justice Department asked them not to discuss the confidential conversations. Two said they also feared professional retaliation.<\/p>\n

    Wyn Hornbuckle, a Justice Department spokesman, declined to comment.<\/p>\n

    Algorithms use pools of information to turn data points into predictions, whether that\u2019s for online shopping, identifying crime hotspots or hiring workers. Many agencies in the U.S. are considering adopting such tools as part of their work with children and families.<\/p>\n

    Though there\u2019s been widespread debate over the moral consequences of using artificial intelligence in child protective services, the Justice Department\u2019s interest in the Allegheny algorithm marks a significant turn toward possible legal implications.<\/p>\n

    Robin Frank, a veteran family law attorney in Pittsburgh and vocal critic of the Allegheny algorithm, said she also filed a complaint with the Justice Department in October on behalf of a client with an intellectual disability who is fighting to get his daughter back from foster care. The AP obtained a copy of the complaint, which raised concerns about how the Allegheny Family Screening Tool assesses a family\u2019s risk.<\/p>\n

    \u201cI think it\u2019s important for people to be aware of what their rights are and to the extent that we don\u2019t have a lot of information when there seemingly are valid questions about the algorithm, it\u2019s important to have some oversight,\u201d Frank said.<\/p>\n

    Mark Bertolet, spokesman for the Allegheny County Department of Human Services, said by email that the agency had not heard from the Justice Department and declined interview requests.<\/p>\n

    \u201cWe are not aware of any concerns about the inclusion of these variables from research groups\u2019 past evaluation or community feedback on the (Allegheny Family Screening Tool),\u201d the county said, describing previous studies and outreach regarding the tool.<\/p>\n

    Child protective services workers can face critiques from all sides. They are assigned blame for both over-surveillance and not giving enough support to the families who land in their view. The system has long been criticized for disproportionately separating Black, poor, disabled and marginalized families and for insufficiently addressing \u2013 let alone eradicating \u2013 child abuse and deaths.<\/p>\n

    Supporters see algorithms as a data-driven solution to make the system both more thorough and efficient, saying child welfare officials should use all tools at their disposal to make sure children aren\u2019t maltreated.<\/p>\n

    Critics worry that delegating some of that critical work to AI tools powered by data collected largely from people who are poor can bake in discrimination against families based on race, income, disabilities or other external characteristics.<\/p>\n

    The AP\u2019s previous story highlighted data points used by the algorithm that can be interpreted as proxies for race. Now, federal civil rights attorneys have been considering the tool\u2019s potential impacts on people with disabilities.<\/p>\n

    The Allegheny Family Screening Tool was specifically designed to predict the risk that a child will be placed in foster care in the two years after the family is investigated. The county said its algorithm has used data points tied to disabilities in children, parents and other members of local households because they can help predict the risk that a child will be removed from their home after a maltreatment report. The county added that it has updated its algorithm several times and has sometimes removed disabilities-related data points.<\/p>\n

    Using a trove of detailed personal data and birth, Medicaid, substance abuse, mental health, jail and probation records, among other government data sets, the Allegheny tool’s statistical calculations help social workers decide which families should be investigated for neglect \u2013 a nuanced term that can include everything from inadequate housing to poor hygiene, but is a different category from physical or sexual abuse, which is investigated separately in Pennsylvania and is not subject to the algorithm.<\/p>\n

    The algorithm-generated risk score on its own doesn\u2019t determine what happens in the case. A child welfare investigation can result in vulnerable families receiving more support and services, but it can also lead to the removal of children for foster care and ultimately, the termination of parental rights.<\/p>\n

    \n The county has said that algorithms provide a scientific check on call center workers\u2019 personal biases. County officials further underscored that hotline workers determine what happens with a family\u2019s case and can always override the tool\u2019s recommendations. The tool is also only applied to the beginning of a family\u2019s potential involvement with the child-welfare process; a different social worker conducts the investigations afterward.<\/p>\n

    The Americans with Disabilities Act prohibits discrimination on the basis of disability, which can include a wide spectrum of conditions, from diabetes, cancer and hearing loss to intellectual disabilities and mental and behavioral health diagnosis like ADHD, depression and schizophrenia.<\/p>\n

    The National Council on Disability has noted that a high rate of parents with disabilities receive public benefits including food stamps, Medicaid, and Supplemental Security Income, a Social Security Administration program that provides monthly payments to adults and children with a disability.<\/p>\n

    Allegheny\u2019s algorithm, in use since 2016, has at times drawn from data related to Supplemental Security Income as well as diagnoses for mental, behavioral and neurodevelopmental disorders, including schizophrenia or mood disorders, AP found.<\/p>\n

    The county said that when the disabilities data is included, it \u201cis predictive of the outcomes\u201d and \u201cit should come as no surprise that parents with disabilities \u2026 may also have a need for additional supports and services.\u201d The county added that there are other risk assessment programs that use data about mental health and other conditions that may affect a parent\u2019s ability to safely care for a child.<\/p>\n

    Emily Putnam-Hornstein and Rhema Vaithianathan, the two developers of Allegheny\u2019s algorithm and other tools like it, deferred to Allegheny County\u2019s answers about the algorithm\u2019s inner workings. They said in an email that they were unaware of any Justice Department scrutiny relating to the algorithm.<\/p>\n

    The AP obtained records showing hundreds of specific variables that are used to calculate the risk scores for families who are reported to child protective services, including the public data that powers the Allegheny algorithm and similar tools deployed in child welfare systems elsewhere in the U.S.<\/p>\n

    The AP\u2019s analysis of Allegheny\u2019s algorithm and those inspired by it in Los Angeles County, California, Douglas County, Colorado, and in Oregon reveals a range of controversial data points that have measured people with low incomes and other disadvantaged demographics, at times evaluating families on race, zip code, disabilities and their use of public welfare benefits.<\/p>\n

    Since the AP\u2019s investigation published, Oregon dropped its algorithm due to racial equity concerns and the White House Office of Science and Technology Policy emphasized that parents and social workers needed more transparency about how government agencies were deploying algorithms as part of the nation\u2019s first \u201cAI Bill of Rights.\u201d<\/p>\n

    The Justice Department has shown a broad interest in investigating algorithms in recent years, said Christy Lopez, a Georgetown University law professor who previously led some of the Justice Department\u2019s civil rights division litigation and investigations.<\/p>\n

    In a keynote about a year ago, Assistant Attorney General Kristen Clarke warned that AI technologies had \u201cserious implications for the rights of people with disabilities,\u201d and her division more recently issued guidance to employers saying using AI tools in hiring could violate the Americans with Disabilities Act.<\/p>\n

    \u201cIt appears to me that this is a priority for the division, investigating the extent to which algorithms are perpetuating discriminatory practices,\u201d Lopez said of the Justice Department scrutiny of Allegheny\u2019s tool.<\/p>\n

    Traci LaLiberte, a University of Minnesota expert on child welfare and disabilities, said the Justice Department’s inquiry stood out to her, as federal authorities have largely deferred to local child welfare agencies.<\/p>\n

    LaLiberte has published research detailing how parents with disabilities are disproportionately affected by the child welfare system. She challenged the idea of using data points related to disabilities in any algorithm because, she said, that assesses characteristics people can\u2019t change, rather than their behavior.<\/p>\n

    \u201cIf it isn\u2019t part of the behavior, then having it in the (algorithm) biases it,\u201d LaLiberte said.<\/p>\n

    ___<\/p>\n

    Burke reported from San Francisco.<\/p>\n

    ___<\/p>\n

    This story, supported by the Pulitzer Center on Crisis Reporting, is part of an ongoing Associated Press series, \u201cTracked,\u201d that investigates the power and consequences of decisions driven by algorithms on people\u2019s everyday lives.<\/p>\n

    ____<\/p>\n

    Follow Sally Ho and Garance Burke on Twitter at @_sallyho and @garanceburke. Contact AP\u2019s global investigative team at In***********<\/span>@**<\/span>.org<\/span> or https:\/\/www.ap.org\/tips\/<\/a><\/p>\n<\/p><\/div>\n<\/section>\n<\/div>\n

    Read More<\/a>
    \n By SALLY HO and GARANCE BURKE, Associated Press<\/p>\n","protected":false},"excerpt":{"rendered":"

    SALLY HO and GARANCE BURKE,\u00a0Associated Press Jan. 31, 2023Updated: Feb. 1, 2023 12:16\u00a0a.m. This is a carousel. Use Next and Previous buttons to navigate 1of11FILE – Case work supervisor Jessie Schemm looks over the first screen of software used by workers who field calls at an intake call screening center for the Allegheny County Children […]<\/p>\n","protected":false},"author":1,"featured_media":603574,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1153,534,67090],"tags":[],"class_list":["post-603573","post","type-post","status-publish","format-standard","has-post-thumbnail","category-child","category-financial","category-welfare"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/603573","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=603573"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/603573\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/603574"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=603573"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=603573"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=603573"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}