The use of error and uncertainty methods in the medical laboratory

Abstract Error methods – compared with uncertainty methods – offer simpler, more intuitive and practical procedures for calculating measurement uncertainty and conducting quality assurance in laboratory medicine. However, uncertainty methods are preferred in other fields of science as reflected by the guide to the expression of uncertainty in measurement. When laboratory results are used for supporting medical diagnoses, the total uncertainty consists only partially of analytical variation. Biological variation, pre- and postanalytical variation all need to be included. Furthermore, all components of the measuring procedure need to be taken into account. Performance specifications for diagnostic tests should include the diagnostic uncertainty of the entire testing process. Uncertainty methods may be particularly useful for this purpose but have yet to show their strength in laboratory medicine. The purpose of this paper is to elucidate the pros and cons of error and uncertainty methods as groundwork for future consensus on their use in practical performance specifications. Error and uncertainty methods are complementary when evaluating measurement data.

[1]  Sten A Westgard,et al.  Quality control review: implementing a scientifically based quality control system , 2016, Annals of clinical biochemistry.

[2]  K. Weise,et al.  A Bayesian theory of measurement uncertainty , 1993 .

[3]  Ronald N. Giere,et al.  Scientific perspectivism: behind the stage door , 2009 .

[4]  S. Psillos Scientific Realism: How Science Tracks Truth , 1999 .

[5]  Eran Tal,et al.  Old and New Problems in Philosophy of Measurement , 2013 .

[6]  Werner Wosniok,et al.  A new concept to derive permissible limits for analytical imprecision and bias considering diagnostic requirements and technical state-of-the-art , 2011, Clinical chemistry and laboratory medicine.

[7]  W. Wosniok,et al.  Quantity quotient reporting. Comparison of various models , 2015, Clinical Chemistry and Laboratory Medicine.

[8]  Kenneth E. Anderson,et al.  MEASUREMENT IN SCIENCE , 1948 .

[9]  Ian Farrance,et al.  Uncertainty of Measurement: A Review of the Rules for Calculating Uncertainty Components through Functional Relationships. , 2012, The Clinical biochemist. Reviews.

[10]  Wytze P Oosterhuis,et al.  Gross overestimation of total allowable error based on biological variation. , 2011, Clinical chemistry.

[11]  Ian Farrance,et al.  Uncertainty in measurement: a review of monte carlo simulation using microsoft excel for the calculation of uncertainties through functional relationships, including uncertainties in empirically derived constants. , 2014, The Clinical biochemist. Reviews.

[12]  Raghu N. Kacker,et al.  On use of Bayesian statistics to make the Guide to the Expression of Uncertainty in Measurement consistent , 2003 .

[13]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[14]  H. Portugal,et al.  Stability study of 81 analytes in human whole blood, in serum and in plasma. , 2012, Clinical biochemistry.

[15]  G. Cembrowski,et al.  Considerations for the Implementation of Clinically Derived Quality Control Procedures , 1989 .

[16]  Thomas Streichert,et al.  Criteria for assigning laboratory measurands to models for analytical performance specifications defined in the 1st EFLM Strategic Conference , 2019 .

[17]  Anders Kallner,et al.  Is the combination of trueness and precision in one expression meaningful? On the use of total error and uncertainty in clinical chemistry , 2016, Clinical chemistry and laboratory medicine.

[18]  Stein Norheim Computer Support Simplifying Uncertainty Estimation using Patient Samples , 2008 .

[19]  C. Saegerman,et al.  Bayesian versus frequentist methods for estimating true prevalence of disease and diagnostic test performance. , 2014, Veterinary journal.

[20]  Werner Wosniok,et al.  Permissible limits for uncertainty of measurement in laboratory medicine , 2015, Clinical chemistry and laboratory medicine.

[21]  Tonks Db QUALITY CONTROL SYSTEMS IN CLINICAL CHEMISTRY LABORATORIES. , 1963 .

[22]  A. Williams What can we learn from traceability in physical measurements , 2000 .

[23]  Sverre Sandberg,et al.  Proposal for the modification of the conventional model for establishing performance specifications , 2015, Clinical chemistry and laboratory medicine.

[24]  Chester H. Page,et al.  The International Bureau of Weights and Measures, 1875-1975 , 2017 .

[25]  Bertil Magnusson,et al.  Bias in clinical chemistry. , 2014, Bioanalysis.

[26]  Thomas Streichert,et al.  Optimizing the use of the “state-of-the-art” performance criteria , 2015, Clinical chemistry and laboratory medicine.

[27]  Paulo Pereira,et al.  Part 2-ISO 15189 : 2012 “ Medical laboratories-Requirements for quality and competence ” , 2015 .

[28]  C G Fraser,et al.  Quality goals in external quality assessment are best based on biology. , 1993, Scandinavian journal of clinical and laboratory investigation. Supplementum.

[29]  J O Westgard,et al.  Criteria for judging precision and accuracy in method development and evaluation. , 1974, Clinical chemistry.

[30]  S. Westgard Utilizing global data to estimate analytical performance on the Sigma scale: A global comparative analysis of methods, instruments, and manufacturers through external quality assurance and proficiency testing programs. , 2016, Clinical biochemistry.

[31]  Hubert W Vesper,et al.  Reference materials and commutability. , 2007, The Clinical biochemist. Reviews.

[32]  Elvar Theodorsson,et al.  Validation and verification of measurement methods in clinical chemistry. , 2012, Bioanalysis.

[33]  Alex Williams Traceability and uncertainty — A comparison of their application in chemical and physical measurement , 2001 .

[34]  Rainer Macdonald Quality assessment of quantitative analytical results in laboratory medicine by root mean square of measurement deviation / Bewertung der Qualität quantitativer analytischer Ergebnisse in der Laboratoriumsmedizin anhand des quadratischen Mittelwertes der Messabweichung , 2006 .

[35]  M Hørder,et al.  Analytical goals for the acceptance of common reference intervals for laboratories throughout a geographical area. , 1988, Scandinavian journal of clinical and laboratory investigation.

[36]  Mogens Lytken Larsen,et al.  A Comparison of Analytical Goals for Haemoglobin A1c Assays Derived Using Different Strategies , 1991, Annals of clinical biochemistry.

[37]  P H Petersen,et al.  Graphical interpretation of analytical data from comparison of a field method with reference method by use of difference plots. , 1997, Clinical chemistry.

[38]  Jordi Vallverdú,et al.  Bayesians Versus Frequentists , 2016 .

[39]  G. Klee,et al.  Influence of analytical bias and imprecision on the number of false positive results using Guideline-Driven Medical Decision Limits. , 2014, Clinica chimica acta; international journal of clinical chemistry.

[40]  Sverre Sandberg,et al.  Total error vs. measurement uncertainty: the match continues , 2016, Clinical chemistry and laboratory medicine.

[41]  G. White,et al.  Uncertainty of measurement in quantitative medical testing: a laboratory implementation guide. , 2004, The Clinical biochemist. Reviews.

[42]  Luca Mari,et al.  Modelling Measurement: Error and Uncertainty , 2014 .

[43]  J O Westgard,et al.  Allowable imprecision for laboratory tests based on clinical and analytical test outcome criteria. , 1994, Clinical chemistry.

[44]  Luca Mari,et al.  Measurement, Models, and Uncertainty , 2012, IEEE Transactions on Instrumentation and Measurement.

[45]  Sverre Sandberg,et al.  Defining analytical performance specifications: Consensus Statement from the 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine , 2015, Clinical chemistry and laboratory medicine.

[46]  G A Kyriazis Contributions to the revision of the 'Guide to the expression of uncertainty in measurement' , 2015 .

[47]  James O. Westgard,et al.  Assessing quality on the Sigma scale from proficiency testing and external quality assessment surveys , 2015, Clinical chemistry and laboratory medicine.

[48]  S. Standard GUIDE TO THE EXPRESSION OF UNCERTAINTY IN MEASUREMENT , 2006 .

[49]  Bertil Magnusson,et al.  Understanding the meaning of accuracy, trueness and precision , 2007 .

[50]  Jean-Claude Libeer,et al.  Proposals for Setting Generally Applicable Quality Goals Solely Based on Biology , 1997, Annals of clinical biochemistry.

[51]  I Lira,et al.  The GUM revision: the Bayesian view toward the expression of measurement uncertainty , 2016 .

[52]  James O Westgard,et al.  Useful measures and models for analytical quality management in medical laboratories , 2016, Clinical chemistry and laboratory medicine.

[53]  David M Bunk,et al.  Roadmap for harmonization of clinical laboratory measurement procedures. , 2011, Clinical chemistry.

[54]  R. Giere Cognitive Models of Science , 1992 .

[55]  P. H. Petersen,et al.  Desirable standards for laboratory tests if they are to fulfill medical needs. , 1993, Clinical chemistry.

[56]  Ingrid Hov Odsæter,et al.  Using the likelihood ratio to evaluate allowable total error – an example with glycated hemoglobin (HbA1c) , 2015, Clinical chemistry and laboratory medicine.

[57]  R. Giere Explaining Science: A Cognitive Approach , 1991 .

[58]  C Ricós,et al.  Desirable routine analytical goals for quantities assayed in serum. Discussion paper from the members of the external quality assessment (EQA) Working Group A on analytical goals in laboratory medicine. , 1995, European journal of clinical chemistry and clinical biochemistry : journal of the Forum of European Clinical Chemistry Societies.

[59]  Paul De Bièvre On ‘trueness control materials’, better known under the multi-purpose term of ‘Certified Reference Materials’ (CRMs) , 2010 .

[60]  Elvar Theodorsson,et al.  Total error vs. measurement uncertainty: revolution or evolution? , 2016, Clinical chemistry and laboratory medicine.

[61]  C A Parvin,et al.  Quality-control (QC) performance measures and the QC planning process. , 1997, Clinical chemistry.

[62]  D. B. Tonks,et al.  Laboratory medicine: Quality Control Systems in Clinical Chemistry Laboratories , 1963 .

[63]  Walter Bich,et al.  How to revise the GUM? , 2008 .