I have a hard time believing what some attorneys testify to during trials. Well, I guess they aren’t officially testifying, but they are stating their opinion on the matter, and end their pontification with a seldomly agreed to, “Do you agree?”
Recently I was testifying in court, and I was asked by the prosecuting attorney if I agreed with the following statement:
Since all the quality assurance requirements were met, the results must be valid.
I replied with a statement to the negative. The attorney then asked if I was aware that another forensic scientist employed by the police routinely testifies that the regulations relating to this type of testing require the following things. The the attorney listed a series of regulatory requirements. I replied I was aware of those requirements.
I was finally asked if all those requirements were in place. I stated there was nothing to indicate they were not.
The unasked question of course was that if all the requirements are in place, does that guarantee accurate and reliable results. My answer being “no”, the inference being that the un-named police scientist routinely answers “yes”.
I really don’t know if there is a police scientist who testifies that way. If there is, I wonder if they truly believe it. If there is, I wonder about their training and understanding of their role in the criminal justice system.
A forensic scientist performs scientific testing to investigate legal questions. First and foremost that scientist should be concerned with the scientific aspects of their job. Any scientist who believes that reliable results can be obtained by merely meeting the legal requirements of a testing procedure is either grossly under-educated, or a biased witness.
Regulatory requirements are put in place by politicians (sometimes with input from scientists, sometimes without). Science is the pursuit of the truth. I find it hard to believe that any scientist would agree that politicians can legislate and regulate truth. Unfortunately for some, reality is not determined by the democratic process.
State imposed regulations related to scientific testing are only minimum requirements, there help ensure the reliability of the results. If results are going to be valid, they must meet the state minimum regulatory requirements — true. But just because testing meets the regulatory requirements doesn’t mean the results are scientifically reliable — they must also meet the acceptable practices of the relevant scientific community.
That doesn’t even take into account errors that can occur that would never be detectable even with the best QA system.
A scientist should never let a politician tell them what makes for valid or reliable test results. Scientists should be concerned about the scientific validity and reliability of their opinion first, and then make sure legal requirements are met. Politicians can make rules about what are legal requirements.
As a forensic scientist, my job is to explain the science related to my opinion. I let the lawyers and the judge worry about the legality.
A valid forensic scientific conclusion also meets legal requirements. A conclusion that meets legal requirements is not neccisarily scientifically valid.
As soon as a forensic scientist accepts the legal requirements as the minimum requirements for scientifically valid testing, they stop being forensic scientists, and become Scientific Forensicists.

[…] supposed the Reverse CSI Effect could be a problem, especially if you have a Scientific Forensicist […]