They give recommendations that make future violence seem more predictable than it is.
(excerpt from The New York Times July 17 2019)
Risk assessments are virtually useless for identifying who will commit violence if released pretrial. Consider the pre-eminent risk assessment tool on the market today, the Public Safety Assessment, or P.S.A., adopted in New Jersey, Kentucky and various counties across the country. In these jurisdictions, the P.S.A. assesses every person accused of a crime and flags them as either at risk for “new violent criminal activity” or not. A judge sees whether the person has been flagged for violence and, depending on the jurisdiction, may receive an automatic recommendation to release or detain.
We can’t end mass incarceration without first changing what happens before trial. On any given day, the United States incarcerates nearly half a million people who have only been accused of a crime and await their day in court.
In response, many cities and counties have started to use algorithms that try to predict people’s future criminal behavior, known as risk assessments. As researchers in the fields of sociology, data science and law, we believe pretrial risk assessment tools are fundamentally flawed. They give judges recommendations that make future violence seem more predictable and more certain than it actually is. In the process, risk assessments may perpetuate the misconceptions and fears that drive mass incarceration.
More than 30 years ago, the Supreme Court affirmed in United States v. Salerno that “liberty is the norm, and detention prior to trial or without trial is the carefully limited exception.” In practice, the opposite is true. The United States accounts for only 4 percent of the global population, but 20 percent of the global pretrial jail population. Current pretrial incarceration rates defy all historical norms. There are more legally innocent people behind bars in America today than there were convicted people in jails and prisons in 1980.
One judge explained his thinking to us. “You don’t want to be the judge that releases someone,” he said, who “goes out and does something horrible.” This fear has led judges to systematically overestimate pretrial violence. Violent crime is quite rare. Even in cities with high crime rates and high rates of pretrial release, it’s uncommon for someone to commit violence while awaiting trial.
Take Washington, for instance. The district releases 94 percent of people accused of a crime. Only 2 percent of those people are arrested for a violent crime while on release. But even though rates of pretrial violence are in the single digits across the country, it’s common for states to lock up 30 percent or more of the people awaiting trial.
To fix this, jurisdictions across the country have embraced algorithmic risk assessments. The hope is that these tools can harness big data to help judges make more informed, accurate decisions, thereby reducing jail populations while maintaining public safety.
By crunching large volumes of criminal history data, risk assessment algorithms try to calculate a person’s risk of future violence based on patterns of how often people with similar characteristics were arrested for a violent crime in the past. Different algorithms draw on different personal characteristics, like prior convictions, length of current employment or even ZIP code. Some even consider whether a person owns or rents a home or has a cellphone.
Algorithmic risk assessments are touted as being more objective and accurate than judges in predicting future violence. Across the political spectrum, these tools have become the darling of bail reform. But their success rests on the hope that risk assessments can be a valuable course corrector for judges’ faulty human intuition.
When it comes to predicting violence, risk assessments offer more magical thinking than helpful forecasting. We and other researchers have written a statement about the fundamental technical flaws with these tools.
Risk assessments are virtually useless for identifying who will commit violence if released pretrial. Consider the pre-eminent risk assessment tool on the market today, the Public Safety Assessment, or P.S.A., adopted in New Jersey, Kentucky and various counties across the country. In these jurisdictions, the P.S.A. assesses every person accused of a crime and flags them as either at risk for “new violent criminal activity” or not. A judge sees whether the person has been flagged for violence and, depending on the jurisdiction, may receive an automatic recommendation to release or detain.
Risk assessments’ simple labels obscure the deep uncertainty of their actual predictions. Largely because pretrial violence is so rare, it is virtually impossible for any statistical model to identify people who are more likely than not to commit a violent crime.
Facebook Comments