Discussion on how to implement a verbal scale in a forensic laboratory: Benefits, pitfalls and suggestions to avoid misunderstandings.

In a recently published guideline for evaluative reporting in forensic science, the European Network of Forensic Science Institutes (ENFSI) recommended the use of the likelihood ratio for the measurement of the value of forensic results. As a device to communicate the probative value of the results, the ENFSI guideline mentions the possibility to define and use a verbal scale, which should be unified within a forensic institution. This paper summarizes discussions held between scientists of our institution to develop and implement such a verbal scale. It intends to contribute to general discussions likely to be faced by any forensic institution that engages in continuous monitoring and improving of their evaluation and reporting format. We first present published arguments in favour of the use of such verbal qualifiers. We emphasise that verbal qualifiers do not replace the use of numbers to evaluate forensic findings, but are useful to communicate the probative value, since the weight of evidence in terms of likelihood ratio are still apprehended with difficulty by both the forensic scientists, especially in the absence of hard data, and the recipient of information. We further present arguments that support the development of the verbal scale that we propose. Recognising the limits of the use of such a verbal scale, we then discuss its disadvantages: it may lead to the spurious view according to which the value of the observations made in a given case is relative to other cases. Verbal qualifiers are also prone to misunderstandings and cannot be coherently combined with other evidence. We therefore recommend not using the verbal qualifier alone in a written statement. While scientists should only report on the probability of the findings - and not on the probability of the propositions, which are the duty of the Court - we suggest showing examples to let the recipient of information understand how the scientific evidence affects the probabilities of the propositions. To avoid misunderstandings, we also advise to mention in the statement what the results do not mean. Finally, we are of the opinion that if experts were able to coherently articulate numbers, and if recipients of information could properly handle such numbers, then verbal qualifiers could be abandoned completely. At that time, numerical expressions of probative value will be appropriately understood, as other numerical measures that most of us understand without the need of any further explanation, such as expressions for length or temperature.

[1]  C. Aitken,et al.  Fibres evidence, probabilistic evaluation and collaborative test. , 2000, Forensic science international.

[2]  Franco Taroni,et al.  Statistics and the Evaluation of Evidence for Forensic Scientists , 2004 .

[3]  F Taroni,et al.  Likelihood ratio as a relevant and logical approach to assess the value of shoeprint evidence. , 2002 .

[4]  D. Stoney,et al.  Evaluation of Associative Evidence: Choosing the Relevant Question , 1984 .

[5]  Ricky Ansell,et al.  Scale of conclusions for the value of evidence , 2012 .

[6]  I. Evett,et al.  Evidence evaluation: a response to the court of appeal judgment in R v T. , 2011, Science & justice : journal of the Forensic Science Society.

[7]  F. Mosteller,et al.  Quantifying Probabilistic Expressions , 1990 .

[8]  Bernard Robertson,et al.  Extending the Confusion About Bayes , 2011 .

[9]  Ian Watkins,et al.  Perception problems of the verbal scale: A reanalysis and application of a membership function approach. , 2015, Science & justice : journal of the Forensic Science Society.

[10]  Leon Hirsch Weight Of Evidence For Forensic Dna Profiles , 2016 .

[11]  Law. Policy Executive Summary of the National Academies of Science Reports, Strengthening Forensic Science in the United States: A Path Forward , 2009 .

[12]  D. Lindley The Philosophy of Statistics , 2000 .

[13]  B. D. Gaudette The use of statistics in forensic science , 1987 .

[14]  J A Lambert,et al.  The impact of the principles of evidence interpretation on the structure and content of statements. , 2000, Science & justice : journal of the Forensic Science Society.

[15]  J A Lambert,et al.  A model for case assessment and interpretation. , 1998, Science & justice : journal of the Forensic Science Society.

[16]  C. Aitken,et al.  Expressing evaluative opinions: a position statement , 2011 .

[17]  William C. Thompson,et al.  The role of prior probability in forensic assessments , 2013, Front. Genet..

[18]  I. W. Evett,et al.  Towards a uniform framework for reporting opinions in forensic science casework , 1998 .

[19]  G. A. Brown,et al.  Standardised nomenclature in forensic science , 1987 .

[20]  W. Thompson,et al.  Interpretation of statistical evidence in criminal trials , 1987 .

[21]  G. Jackson,et al.  The scientist and the Scales of Justice , 2000 .

[22]  Marjan Sjerps,et al.  The interpretation of conventional and ?Bayesian? verbal scales for expressing expert opinion: a small experiment among jurists , 1999 .

[23]  Michael J. Saks,et al.  Communicating opinion evidence in the forensic identification sciences: Accuracy and impact , 2008 .

[24]  I W Evett,et al.  Verbal conventions for handwriting opinions. , 2000, Journal of Forensic Sciences.

[25]  L. Moxey,et al.  Perception problems of the verbal scale. , 2014, Science & justice : journal of the Forensic Science Society.

[26]  Bernard Robertson,et al.  Interpreting Evidence: Evaluating Forensic Science in the Courtroom , 1995 .

[27]  F Taroni,et al.  Equal prior probabilities: can one do any better? , 2007, Forensic science international.

[28]  P R Dear,et al.  How do parents of babies interpret qualitative expressions of probability? , 1990, Archives of disease in childhood.

[29]  Ian Watkins,et al.  The expression and interpretation of uncertain forensic science evidence: verbal equivalence, evidence strength, and the weak evidence effect. , 2013, Law and human behavior.

[30]  Ian W. Evett,et al.  Avoiding the transposed conditional , 1995 .

[31]  Ian W. Evett,et al.  Bayesian Inference and Forensic Science: Problems and Perspectives , 1987 .

[32]  C Champod,et al.  E-learning initiatives in forensic interpretation: report on experiences from current projects and outlook. , 2013, Forensic Science International.

[33]  Alex Biedermann,et al.  Inadequacies of posterior probabilities for the assessment of scientific evidence , 2005 .

[34]  Wibecke Brun,et al.  Verbal probabilities: Ambiguous, context-dependent, or both? , 1988 .

[35]  C. Champod,et al.  ENFSI guIdElINE For EvaluatIvE rEportINg IN ForENSIc ScIENcE Strengthening the Evaluation of Forensic Results across Europe ( STEOFRAE , 2015 .

[36]  A. Broeders,et al.  Some observations on the use of probability scales in forensic identification , 1999 .