Limits to the Evaluation of the Accuracy of Continuous Glucose Monitoring Systems by Clinical Trials

Systems for continuous glucose monitoring (CGM) are evolving quickly, and the data obtained are expected to become the basis for clinical decisions for many patients with diabetes in the near future. However, this requires that their analytical accuracy is sufficient. This accuracy is usually determined with clinical studies by comparing the data obtained by the given CGM system with blood glucose (BG) point measurements made with a so-called reference method. The latter is assumed to indicate the correct value of the target quantity. Unfortunately, due to the nature of the clinical trials and the approach used, such a comparison is subject to several effects which may lead to misleading results. While some reasons for the differences between the values obtained with CGM and BG point measurements are relatively well-known (e.g., measurement in different body compartments), others related to the clinical study protocols are less visible, but also quite important. In this review, we present a general picture of the topic as well as tools which allow to correct or at least to estimate the uncertainty of measures of CGM system performance.

[1]  J. Hans DeVries,et al.  Accuracy and reliability of continuous glucose monitoring systems: a head-to-head comparison. , 2013, Diabetes technology & therapeutics.

[2]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[3]  D. Cox,et al.  Evaluating Clinical Accuracy of Systems for Self-Monitoring of Blood Glucose , 1987, Diabetes Care.

[4]  Guido Freckmann,et al.  Performance Evaluation of Three Continuous Glucose Monitoring Systems: Comparison of Six Sensors Per Subject in Parallel , 2013, Journal of diabetes science and technology.

[5]  C. Toumazou,et al.  Glucose sensors: a review of current and emerging technology , 2009, Diabetic medicine : a journal of the British Diabetic Association.

[6]  B H Ginsberg,et al.  A new consensus error grid to evaluate the clinical significance of inaccuracies in the measurement of blood glucose. , 2000, Diabetes care.

[7]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[8]  Giuseppe De Nicolao,et al.  Enhancing the Accuracy of Subcutaneous Glucose Sensors: A Real-Time Deconvolution-Based Approach , 2012, IEEE Transactions on Biomedical Engineering.

[9]  Christina Schmid,et al.  Evaluation of the Performance of a Novel System for Continuous Glucose Monitoring , 2013, Journal of diabetes science and technology.

[10]  Lutz Heinemann,et al.  Continuous glucose monitoring with glucose sensors: calibration and assessment criteria. , 2003, Diabetes technology & therapeutics.

[11]  Giovanni Sparacino,et al.  A Model of Self-Monitoring Blood Glucose Measurement Error , 2017, Journal of diabetes science and technology.

[12]  A. Staib,et al.  Overview of a Novel Sensor for Continuous Glucose Monitoring , 2013, Journal of diabetes science and technology.

[13]  Eyal Dassau,et al.  A Run-to-Run Approach to Enhance Continuous Glucose Monitor Accuracy Based on Continuous Wear , 2015 .

[14]  D. Banauch,et al.  Eine Glucose-Dehydrogenase für die Glucose-Bestimmung in Körperflüssigkeiten , 1975 .

[15]  Eyal Dassau,et al.  The impact of glucose sensing dynamics on the closed-loop artificial pancreas , 2015, 2015 American Control Conference (ACC).

[16]  T. Bailey,et al.  The Performance and Usability of a Factory-Calibrated Flash Glucose Monitoring System , 2015, Diabetes technology & therapeutics.

[17]  E. Campos-Náñez,et al.  Effect of BGM Accuracy on the Clinical Performance of CGM: An In-Silico Study , 2017, Journal of diabetes science and technology.

[18]  W. Kenneth Ward,et al.  Modeling the Glucose Sensor Error , 2014, IEEE Transactions on Biomedical Engineering.

[19]  Luigi del Re,et al.  Performance Evaluations of Continuous Glucose Monitoring Systems: Precision Absolute Relative Deviation is Part of the Assessment , 2013, Journal of diabetes science and technology.

[20]  P. Twomey,et al.  Plasma glucose measurement with the Yellow Springs Glucose 2300 STAT and the Olympus AU640 , 2004, Journal of Clinical Pathology.

[21]  Ahmad Haidar,et al.  Evaluating the accuracy and large inaccuracy of two continuous glucose monitoring systems. , 2013, Diabetes technology & therapeutics.

[22]  G. Freckmann,et al.  Rate-of-Change Dependence of the Performance of Two CGM Systems During Induced Glucose Swings , 2015, Journal of diabetes science and technology.

[23]  C. Cobelli,et al.  Real-Time Improvement of Continuous Glucose Monitoring Accuracy , 2013, Diabetes Care.

[24]  Claudio Cobelli,et al.  Time Lag of Glucose From Intravascular to Interstitial Compartment in Type 1 Diabetes , 2014, Journal of diabetes science and technology.

[25]  L. Leelarathna,et al.  Accuracy of flash glucose monitoring and continuous glucose monitoring technologies: Implications for clinical practice , 2018, Diabetes & vascular disease research.

[26]  Steven J. Russell,et al.  A Comparative Effectiveness Analysis of Three Continuous Glucose Monitors , 2014, Journal of diabetes science and technology.

[27]  A. Maran,et al.  Head-to-head comparison between flash and continuous glucose monitoring systems in outpatients with type 1 diabetes , 2016, Journal of Endocrinological Investigation.

[28]  M. Nimchek Banach spaces of analytic functions , 1996 .

[29]  Luigi del Re,et al.  Identification of CGM Time Delays and Implications for BG Control in T1DM , 2016 .

[30]  J K Mader,et al.  Accuracy of two continuous glucose monitoring systems: a head-to-head comparison under clinical research centre and daily life conditions , 2014, Diabetes, obesity & metabolism.

[31]  Zeinab Mahmoudi,et al.  A multistep algorithm for processing and calibration of microdialysis continuous glucose monitoring data. , 2013, Diabetes technology & therapeutics.

[32]  Luca Zaccarian,et al.  LMI-Based Approaches for the Calibration of Continuous Glucose Measurement Sensors , 2015, IEEE Journal of Biomedical and Health Informatics.

[33]  Claudio Cobelli,et al.  Continuous Glucose Monitoring Accuracy Results Vary between Assessment at Home and Assessment at the Clinical Research Center , 2012, Journal of diabetes science and technology.

[34]  J. Hans DeVries,et al.  Accuracy and Longevity of an Implantable Continuous Glucose Sensor in the PRECISE Study: A 180-Day, Prospective, Multicenter, Pivotal Trial , 2016, Diabetes Care.

[35]  Giovanni Sparacino,et al.  Online Calibration of Glucose Sensors From the Measured Current by a Time-Varying Calibration Function and Bayesian Priors , 2016, IEEE Transactions on Biomedical Engineering.

[36]  Lutz Heinemann,et al.  Comparison of the Numerical and Clinical Accuracy of Four Continuous Glucose Monitors , 2008, Diabetes Care.

[37]  Ronald Brazg,et al.  Accuracy and acceptability of the 6-day Enlite continuous subcutaneous glucose sensor. , 2014, Diabetes technology & therapeutics.

[38]  Giovanni Sparacino,et al.  Improving Accuracy and Precision of Glucose Sensor Profiles: Retrospective Fitting by Constrained Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[39]  Christina Schmid,et al.  Performance Evaluation of a Continuous Glucose Monitoring System under Conditions Similar to Daily Life , 2013, Journal of diabetes science and technology.

[40]  S. Garg,et al.  Comparison of accuracy and safety of the SEVEN and the Navigator continuous glucose monitoring systems. , 2009, Diabetes technology & therapeutics.

[41]  Christina Schmid,et al.  System Accuracy Evaluation of 43 Blood Glucose Monitoring Systems for Self-Monitoring of Blood Glucose according to DIN EN ISO 15197 , 2012, Journal of diabetes science and technology.

[42]  R. Brazg,et al.  Accuracy of the 5-Day FreeStyle Navigator Continuous Glucose Monitoring System , 2007, Diabetes Care.

[43]  D. Klonoff,et al.  Assessing the Accuracy of Continuous Glucose Monitoring (CGM) Calibrated With Capillary Values Using Capillary or Venous Glucose Levels as a Reference , 2016, Journal of diabetes science and technology.

[44]  Giovanni Sparacino,et al.  Reduction of Blood Glucose Measurements to Calibrate Subcutaneous Glucose Sensors: A Bayesian Multiday Framework , 2018, IEEE Transactions on Biomedical Engineering.

[45]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[46]  Konstantina S. Nikita,et al.  A Review of Emerging Technologies for the Management of Diabetes Mellitus , 2015, IEEE Transactions on Biomedical Engineering.

[47]  Santhisagar Vaddiraju,et al.  Technologies for Continuous Glucose Monitoring: Current Problems and Future Promises , 2010, Journal of diabetes science and technology.

[48]  Steven J. Russell,et al.  A Comparative Effectiveness Analysis of Three Continuous Glucose Monitors , 2013, Diabetes Care.

[49]  B Wayne Bequette,et al.  Continuous Glucose Monitoring: Real-Time Algorithms for Calibration, Filtering, and Alarms , 2010, Journal of diabetes science and technology.

[50]  Harald Sourij,et al.  Evaluation of subcutaneous glucose monitoring systems under routine environmental conditions in patients with type 1 diabetes , 2017, Diabetes, obesity & metabolism.

[51]  Claudio Cobelli,et al.  Modeling Plasma-to-Interstitium Glucose Kinetics from Multitracer Plasma and Microdialysis Data. , 2015, Diabetes technology & therapeutics.

[52]  D. Cox,et al.  Evaluating the accuracy of continuous glucose-monitoring sensors: continuous glucose-error grid analysis illustrated by TheraSense Freestyle Navigator data. , 2004, Diabetes care.

[53]  Ronald Brazg,et al.  A continuous glucose sensor based on wired enzyme technology -- results from a 3-day trial in patients with type 1 diabetes. , 2003, Diabetes technology & therapeutics.

[54]  John J Mastrototaro,et al.  Subcutaneous glucose predicts plasma glucose independent of insulin: implications for continuous monitoring. , 1999, American journal of physiology. Endocrinology and metabolism.

[55]  Guido Freckmann,et al.  Significance and Reliability of MARD for the Accuracy of CGM Systems , 2017, Journal of diabetes science and technology.

[56]  David Rodbard,et al.  Characterizing Accuracy and Precision of Glucose Sensors and Meters , 2014, Journal of diabetes science and technology.

[57]  L. Laffel Improved Accuracy of Continuous Glucose Monitoring Systems in Pediatric Patients with Diabetes Mellitus: Results from Two Studies. , 2016, Diabetes technology & therapeutics.

[58]  Josep Vehí,et al.  Adaptive Calibration Algorithm for Plasma Glucose Estimation in Continuous Glucose Monitoring , 2013, IEEE Journal of Biomedical and Health Informatics.

[59]  Giovanni Sparacino,et al.  Model of glucose sensor error components: identification and assessment for new Dexcom G4 generation devices , 2014, Medical & Biological Engineering & Computing.

[60]  William Q. Meeker,et al.  Statistical Intervals: A Guide for Practitioners and Researchers , 2017 .

[61]  Luigi del Re,et al.  Prediction Methods for Blood Glucose Concentration: Design, Use and Evaluation , 2016 .