Research Suggests that Forensic Psychological Examinations are Unreliable and Biased

Concerns have been raised about inconsistent and unreliable results, which may lead to injustices in sentencing or even wrongful convictions.

Peter Simons
6
686

Forensic psychology plays an important role in many court cases. However, concerns have been raised about inconsistent and unreliable results, which may lead to injustices in sentencing or even wrongful convictions.

In a new article published in Translational Issues in Psychological Science, researchers studied such forensic evaluations, and their results suggested that these examinations are unreliable and biased. Individual evaluators often disagree on the results, and the authors raise concerns about the lack of independence of forensic psychologists from the side retaining them.

Photo Credit: “Courtroom” by Ian Jedd, Flickr

Forensic psychological evaluation is used for numerous reasons. Psychologists may attempt to evaluate someone’s risk for violence, mental state at the time of a crime, or competency to stand trial, for instance. These results can be useful for determining everything from the appropriate sentencing for a crime, to the possibility of conditional release from prison, to child custody requirements. However, if these assessments are biased or unreliable, they could lead to “arbitrary or unjust legal outcomes [… and] diminish confidence in psychological expertise within the legal system.”

“Independent evaluators tend to disagree in approximately 25%-35% of sanity cases… and almost half (45%) of conditional release cases,” the authors write. “That is, in at least one out of every four cases (and possibly up to half the time), the result of a forensic evaluation is unreliable and lacks objectivity.”

There are numerous reasons for this problem. For one, there are hundreds of potential ways to evaluate psychological state, and many of those methods rely on an expert opinion on case history reports and interviews—which are methods at risk for bias and could be considered to lack objectivity. In fact, one large international study found that 26% of evaluators used clinical history without using a single objective measure.

Additionally, the authors identify that many states do not require special certification to perform these examinations—meaning that psychologists may lack the relevant training to objectively evaluate these issues.

“Studies assessing the thoroughness, relevance, and accuracy of the reports forensic clinicians submit to the court regularly find them deficient,” they write. “Competency evaluators’ reports in Utah failed to incorporate legally relevant aspects of competency and failed to adequately describe the reasoning underlying their final forensic opinion.”

Another critical issue is a lack of independence. The authors of the article cite numerous studies indicating that forensic evaluators are far more likely to find results in favor of the side retaining them.

For instance, the authors discuss one commonly used measure of an individual’s violent or dangerous tendencies, which requires that the evaluator selects a set of normative scores. The evaluator then compares the subject’s scores to the normative scores. However, in a study cited by the authors, researchers found that evaluators used very different normative scores based on whether they were retained by the prosecution or the defense.

In fact, 94% of the evaluations conducted by state-retained psychologists used norms “that makes the examinee seem more risky, as compared to routine sample norms,” while only 33% of psychologists retained by the subject themselves used this type of norm. That is, people who did not retain their own evaluator were far more likely to be graded harshly on this measure than people who hired their own psychological evaluator.

The authors suggest numerous improvements to counteract these sources of bias, such as:

  • Mandating specific training requirements for forensic evaluators
  • The use of several independent evaluators (Only 10 states require more than one)
  • The use of standardized, structured measures whenever possible
  • Requiring written justifications of reasoning and choice of evaluation measure
  • The use of blinded expert evaluators (unaware of which side retained their services)

Additionally, the researchers argue that more research needs to be done to clarify which evaluation measures are most reliable and objective. In the meantime, the authors call for reforms to the legal system. They write, “Policy and practice changes are needed to improve the reliability of forensic opinions.”

 

****

Guarnera, L. A., Murrie, D. C., & Boccaccini, M. T. (2017). Why do forensic experts disagree? Sources of unreliability and bias in forensic psychology evaluations. Translational Issues in Psychological Science, 3(2), 143-152. http://dx.doi.org/10.1037/tps0000114 (Abstract)

Support MIA

Enjoyed what you just read? Consider a donation to help us continue to produce content, provide up-to-date research news, offer continuing education courses, and continue building a community for exploring alternatives to the current paradigm of mental health. All donations are tax deductible.

$
Select Payment Method
Loading...
Personal Info

Credit Card Info
This is a secure SSL encrypted payment.

Donation Total: $20.00

6 COMMENTS

  1. How can aggression and violence be accurately assessed unless their is a fastidious catalogue of all prescription psychotropic medications, with dates, changes in drug/s dosages and comprehensive analysis of prescription drug induced AKATHISIA with its profound agitation, aggression, violence against self and/or against others?

    The same is of fundamental importance in achieving accuracy and justice in the coroner’s court.
    Evidence that this has even been considered is rarely seen.

    TRM 123. Retired Consultant Physician.

  2. WHAT INFORMATION IS MISSING…?

    https://www.irishtimes.com/news/crime-and-law/courts/criminal-court/woman-deemed-unfit-to-stand-trial-for-murder-of-man-1.3152495?mode=amp

    AKATHISIA.

    In April 1984 I had to practically break into a Psychiatric Unit in Western Ireland – nursing staff had been told not to admit me.

    A day or two previously I had been given a first time injection of Depixol at twice the introductory dose, and released into the community. The lead up to this injection is Missing from the Records.

    The Discharge Summary states the cause of this hospitalization to be a “Pre Psychotic Episode”. It Was Not – it was acute AKATHISIA. I’d had two Suicide attempts previously in the same state.

    I left hospital of my own free will within 48hrs. The Prognosis stated “..we expect to see this gentleman back in the near future”

    After this hospitalisation I stopped drugs suitable for Severe Mental Illness – and this was my last hospitalisation.

  3. Missing the #1 reason these evaluations are unreliable – they are relying on subjective “diagnoses” and sketchy “objective” tests that aren’t the least bit objective, because they’re “measuring” things like risk of violence that are not actually measurable in any real sense. Admitting this will help us realize that the courtroom is a place of moral judgment, not medical, except as far as medical expertise can objectively shed light on guilt or innocence. As such, psychological/psychiatric pseudo-experts should not be considered to provide valid testimony, and the judge should consider the case on more objective facts. For instance, instead of testimony on whether someone is “mentally ill,” why not hear testimony from people who know the person in question as to his/her volatility/violence potential in their direct observation? A person’s actions are a much better predictor of their future actions than some “expert” who barely knows the person and tosses a few Mickey-Mouse “tests” at them.

  4. the image here is one of Philip Guston’s artworks not as written. he happens to be one of my most favorite of all artists of all time . . .he is definitely a study in overcoming obstacles and excellence in his field inspite of finding his father dead from suicide and then his older brother died too. he rose to be a prominent abstract expressionist and later a figurative painter using his personal history to the world. his father was a trash collector so often there are discarded shoes in the trash.