Interpretation of EQA results and EQA-based trouble shooting

Important objectives of External Quality Assessment (EQA) is to detect analytical errors and make corrective actions. The aim of this paper is to describe knowledge required to interpret EQA results and present a structured approach on how to handle deviating EQA results. The value of EQA and how the EQA result should be interpreted depends on five key points: the control material, the target value, the number of replicates, the acceptance limits and between lot variations in reagents used in measurement procedures. This will also affect the process of finding the sources of errors when they appear. The ideal EQA sample has two important properties: it behaves as a native patient sample in all methods (is commutable) and has a target value established with a reference method. If either of these two criteria is not entirely fulfilled, results not related to the performance of the laboratory may arise. To help and guide the laboratories in handling a deviating EQA result, the Norwegian Clinical Chemistry EQA Program (NKK) has developed a flowchart with additional comments that could be used by the laboratories e.g. in their quality system, to document action against deviations in EQA. This EQA-based trouble-shooting tool has been developed further in cooperation with the External quality Control for Assays and Tests (ECAT) Foundation. This flowchart will become available in a public domain, i.e. the website of the European organisation for External Quality Assurance Providers in Laboratory Medicine (EQALM).

[1]  P. H. Petersen,et al.  Biological Variation: The Effect of Different Distributions on Estimated Within-Person Variation and Reference Change Values. , 2016, Clinical chemistry.

[2]  S. Sandberg,et al.  Quality specifications derived from objective analyses based upon clinical needs. , 1999, Scandinavian journal of clinical and laboratory investigation.

[3]  I. Penttilä,et al.  Characterisation and Evaluation of External Quality Assessment Scheme Serum , 1998, Clinical chemistry and laboratory medicine.

[4]  Sverre Sandberg,et al.  Defining analytical performance specifications: Consensus Statement from the 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine , 2015, Clinical chemistry and laboratory medicine.

[5]  V. Em,et al.  Performance characteristics of the hemoCue B-glucose analyzer using whole-blood samples , 1993 .

[6]  Sverre Sandberg,et al.  Effect of Participating in a Quality Improvement System over Time for Point-of-Care C-Reactive Protein, Glucose, and Hemoglobin Testing. , 2016, Clinical chemistry.

[7]  Sverre Sandberg,et al.  Defining analytical performance specifications 15 years after the Stockholm conference , 2015, Clinical chemistry and laboratory medicine.

[8]  Sverre Sandberg,et al.  Between-lot variation in external quality assessment of glucose: clinical importance and effect on participant performance evaluation. , 2005, Clinical chemistry.

[9]  L M Thienpont,et al.  Analytical specifications of reference methods compilation and critical discussion (from the members of the European EQA-Organizers Working Group B). , 1996, European journal of clinical chemistry and clinical biochemistry : journal of the Forum of European Clinical Chemistry Societies.

[10]  C G Fraser,et al.  Introduction: strategies to set global quality specifications in laboratory medicine. , 1999, Scandinavian journal of clinical and laboratory investigation.

[11]  W Greg Miller,et al.  Why commutability matters. , 2006, Clinical chemistry.

[12]  S. Skeie,et al.  Instruments for self-monitoring of blood glucose: comparisons of testing quality achieved by patients and a technician. , 2002, Clinical chemistry.

[13]  James O Westgard,et al.  Useful measures and models for analytical quality management in medical laboratories , 2016, Clinical chemistry and laboratory medicine.

[14]  C G Fraser,et al.  General strategies to set quality specifications for reliability performance characteristics. , 1999, Scandinavian journal of clinical and laboratory investigation.

[15]  Hubert W Vesper,et al.  Reference materials and commutability. , 2007, The Clinical biochemist. Reviews.

[16]  Richard C. Friedberg,et al.  International Organization for Standardization (ISO) 15189 , 2017, Annals of laboratory medicine.

[17]  I. A. Ismail,et al.  A comparison of statistical techniques to evaluate the performance of the Glucometer Elite blood glucose meter. , 1996, Clinical biochemistry.

[18]  P. H. Petersen,et al.  External quality assessment: currently used criteria for evaluating performance in European countries, and criteria for future harmonization. , 1996, European journal of clinical chemistry and clinical biochemistry : journal of the Forum of European Clinical Chemistry Societies.

[19]  P. H. Petersen,et al.  Analytical performance characteristics should be judged against objective quality specifications. , 1999, Clinical chemistry.

[20]  C Franzini,et al.  Analytical quality specifications for reference methods and operating specifications for networks of reference laboratories. discussion paper from the members of the external quality assessment (EQA) Working Group B1) on target values in EQAS. , 1995, European journal of clinical chemistry and clinical biochemistry : journal of the Forum of European Clinical Chemistry Societies.

[21]  C Ricós,et al.  Characterization and classification of external quality assessment schemes (EQA) according to objectives such as evaluation of method and participant bias and standard deviation. External Quality Assessment (EQA) Working Group A on Analytical Goals in Laboratory Medicine. , 1996, European journal of clinical chemistry and clinical biochemistry : journal of the Forum of European Clinical Chemistry Societies.

[22]  J. Berg,et al.  Analytical Bias Exceeding Desirable Quality Goal in 4 out of 5 Common Immunoassays: Results of a Native Single Serum Sample External Quality Assessment Program for Cobalamin, Folate, Ferritin, Thyroid-Stimulating Hormone, and Free T4 Analyses. , 2016, Clinical chemistry.

[23]  A. M. Johnson,et al.  Protein standardization V: value transfer. A practical protocol for the assignment of serum protein values from a Reference Material to a Target Material , 2008, Clinical chemistry and laboratory medicine.

[24]  Cas Weykamp,et al.  Proficiency testing/external quality assessment: current challenges and future directions. , 2011, Clinical chemistry.

[25]  G. Cembrowski,et al.  Performance characteristics of the HemoCue B-Glucose analyzer using whole-blood samples. , 1993, Archives of Pathology & Laboratory Medicine.

[26]  F. Ceriotti,et al.  Behavior of frozen serum pools and lyophilized sera in an external quality-assessment scheme. , 1995, Clinical chemistry.

[27]  S Sandberg,et al.  Patient-derived quality specifications for instruments used in self-monitoring of blood glucose. , 2001, Clinical chemistry.

[28]  P. Hyltoft Petersen,et al.  The Nordic Reference Interval Project 2000: recommended reference intervals for 25 common biochemical properties , 2004, Scandinavian journal of clinical and laboratory investigation.

[29]  P. Broughton,et al.  Methods of Assigning Accurate Values to Reference Serum. Part 2. The Use of Definitive Methods, Reference Laboratories, Transferred Values and Consensus Values , 1985, Annals of clinical biochemistry.

[30]  G. Palomaki,et al.  Comparison of fresh frozen serum to proficiency testing material in College of American Pathologists surveys: alpha-fetoprotein, carcinoembryonic antigen, human chorionic gonadotropin, and prostate-specific antigen. , 2009, Archives of pathology & laboratory medicine.

[31]  F. Sunderman,et al.  A survey of the accuracy of chemical analyses in clinical laboratories. , 1947, Manitoba medical review.

[32]  S. Sandberg,et al.  Calcium, magnesium, albumin, and total protein measurement in serum as assessed with 20 fresh-frozen single-donation sera. , 2012, Clinical chemistry.

[33]  W Greg Miller,et al.  Commutability limitations influence quality control results with different reagent lots. , 2011, Clinical chemistry.

[34]  Sverre Sandberg,et al.  The Importance of Reagent Lot Registration in External Quality Assurance/Proficiency Testing Schemes. , 2016, Clinical chemistry.

[35]  A. Killeen,et al.  Creatinine measurement: state of the art in accuracy and interlaboratory harmonization. , 2005, Archives of pathology & laboratory medicine.

[36]  C Ricós,et al.  Desirable routine analytical goals for quantities assayed in serum. Discussion paper from the members of the external quality assessment (EQA) Working Group A on analytical goals in laboratory medicine. , 1995, European journal of clinical chemistry and clinical biochemistry : journal of the Forum of European Clinical Chemistry Societies.

[37]  P. Broughton,et al.  Methods of Assigning Accurate Values to Reference Serum. Part 1. The Use of Reference Laboratories and Consensus Values, with an Evaluation of a Procedure for Transferring Values from One Reference Serum to Another , 1985, Annals of clinical biochemistry.

[38]  Sten Westgard,et al.  Sigma metrics used to assess analytical quality of clinical chemistry assays: importance of the allowable total error (TEa) target , 2014, Clinical chemistry and laboratory medicine.