Comparing Machine Learning Techniques for Blood Glucose Forecasting Using Free-living and Patient Generated Data

Managing a chronic disease like Type 1 diabetes (T1D) is both challenging and time consuming, but new technologies that allow continuous measurement of glucose and delivery of insulin have led to significant improvements. The development of an artificial pancreas (AP), which algorithmically determines insulin dosing and delivers insulin in a fully automated way, may transform T1D care but it is not yet widely available. Patient-led alternatives, like the Open Artificial Pancreas (OpenAPS), are being used by hundreds of individuals and have also led to a dramatic increase in the availability of patient generated health data (PGHD). All APs require an accurate forecast of blood glucose (BG). While there have been efforts to develop better forecasts and apply new ML techniques like deep learning to this problem, methods are often tested on small controlled datasets that do not indicate how they may perform in reality – and the most advanced methods have not always outperformed the simplest. We introduce a rigorous comparison of BG forecasting using both a small controlled research dataset and large heterogeneous PGHD. Our comparison advances the state of the art in BG forecasting by providing insight into how methods may fare when moving beyond small controlled studies to real-world use.

[1]  Dana Lewis,et al.  History and Perspective on DIY Closed Looping , 2018, Journal of diabetes science and technology.

[2]  Youqing Wang,et al.  A novel adaptive-weighted-average framework for blood glucose prediction. , 2013, Diabetes technology & therapeutics.

[3]  G. Eknoyan,et al.  National Kidney Foundation Practice Guidelines for Chronic Kidney Disease: Evaluation, Classification, and Stratification , 2003, Annals of Internal Medicine.

[4]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[5]  Jianwei Chen,et al.  A Deep Learning Algorithm for Personalized Blood Glucose Prediction , 2018, KHD@IJCAI.

[6]  Rob J Hyndman,et al.  Automatic Time Series Forecasting: The forecast Package for R , 2008 .

[7]  Stavroula G. Mougiakakou,et al.  Multi-model data fusion to improve an early warning system for hypo-/hyperglycemic events , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  François Clemens,et al.  Interpolation in Time Series : An Introductive Overview of Existing Methods, Their Performance Criteria and Uncertainty Assessment , 2017 .

[9]  Cynthia R. Marling,et al.  The OhioT1DM Dataset for Blood Glucose Level Prediction: Update 2020 , 2020, KDH@ECAI.

[10]  Qian Wang,et al.  Benchmarking Machine Learning Algorithms on Blood Glucose Prediction for Type I Diabetes in Comparison With Classical Time-Series Models , 2020, IEEE Transactions on Biomedical Engineering.

[11]  Qian Wang,et al.  Benchmark Machine Learning Approaches with Classical Time Series Approaches on the Blood Glucose Level Prediction Challenge , 2018, KHD@IJCAI.

[12]  Rolf Johansson,et al.  Glycemic trend prediction using empirical model identification , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[13]  George Athanasopoulos,et al.  Forecasting: principles and practice , 2013 .

[14]  Jenna Wiens,et al.  Deep Multi-Output Forecasting: Learning to Accurately Predict Blood Glucose Trajectories , 2018, KDD.

[15]  C. Stettler,et al.  Glycaemic control in individuals with type 1 diabetes using an open source artificial pancreas system (OpenAPS) , 2019, Diabetes, obesity & metabolism.

[16]  Dimitrios I. Fotiadis,et al.  Multivariate Prediction of Subcutaneous Glucose Concentration in Type 1 Diabetes Patients Based on Support Vector Regression , 2013, IEEE Journal of Biomedical and Health Informatics.

[17]  Ali Mohebbi,et al.  Short Term Blood Glucose Prediction based on Continuous Glucose Monitoring Data , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[18]  Srinivasan Rajaraman,et al.  Predicting Subcutaneous Glucose Concentration in Humans: Data-Driven Glucose Modeling , 2009, IEEE Transactions on Biomedical Engineering.

[19]  Robert G. Sutherlin,et al.  A Bihormonal Closed-Loop Artificial Pancreas for Type 1 Diabetes , 2010, Science Translational Medicine.

[20]  Cynthia R. Marling,et al.  A Machine Learning Approach to Predicting Blood Glucose Levels for Diabetes Management , 2014, AAAI Workshop: Modern Artificial Intelligence for Health Analytics.

[21]  W. Clarke The original Clarke Error Grid Analysis (EGA). , 2005, Diabetes technology & therapeutics.

[22]  Gaurav Baruah,et al.  Predicting Glycemia in Type 1 Diabetes Patients: Experiments with XG-Boost , 2018, KHD@IJCAI.

[23]  Dimitrios I Fotiadis,et al.  A glucose model based on support vector regression for the prediction of hypoglycemic events under free-living conditions. , 2013, Diabetes technology & therapeutics.

[24]  Konstantina S. Nikita,et al.  Personalized glucose-insulin metabolism model based on self-organizing maps for patients with Type 1 Diabetes Mellitus , 2013, 13th IEEE International Conference on BioInformatics and BioEngineering.

[25]  Alberto Maran,et al.  Continuous subcutaneous glucose monitoring in diabetic patients: a multicenter analysis. , 2002, Diabetes care.

[26]  G. Kitagawa,et al.  Information Criteria and Statistical Modeling , 2007 .

[27]  Mehdi Ammi,et al.  Study of Short-Term Personalized Glucose Predictive Models on Type-1 Diabetic Children , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[28]  Ali Cinar,et al.  Adaptive system identification for estimating future glucose concentrations and hypoglycemia alarms , 2012, Autom..

[29]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[30]  Mark D. Huffman,et al.  Heart Disease and Stroke Statistics—2016 Update: A Report From the American Heart Association , 2016, Circulation.

[31]  Lei Yu,et al.  Effect of meal intake on the quality of empirical dynamic models for Type 1 Diabetes , 2014, 2014 IEEE International Symposium on Bioelectronics and Bioinformatics (IEEE ISBB 2014).

[32]  Carlo Novara,et al.  A Nonlinear Blind Identification Approach to Modeling of Diabetic Patients , 2016, IEEE Transactions on Control Systems Technology.

[33]  Chengyuan Liu,et al.  Enhancing Blood Glucose Prediction with Meal Absorption and Physical Exercise Information , 2019, ArXiv.

[34]  Rolf Johansson,et al.  Diabetes mellitus modeling and short-term prediction based on blood glucose measurements. , 2009, Mathematical biosciences.

[35]  Ali Cinar,et al.  Meal Detection and Carbohydrate Estimation Using Continuous Glucose Sensor Data , 2017, IEEE Journal of Biomedical and Health Informatics.

[36]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[37]  Bruce Buckingham,et al.  Effect of Acetaminophen on CGM Glucose in an Outpatient Setting , 2015, Diabetes Care.

[38]  Razvan C. Bunescu,et al.  LSTMs and Neural Attention Models for Blood Glucose Prediction: Comparative Experiments on Real and Synthetic Data , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Chengyuan Liu,et al.  Convolutional Recurrent Neural Networks for Glucose Prediction , 2018, IEEE Journal of Biomedical and Health Informatics.

[40]  David C. Kale,et al.  Phenotyping of Clinical Time Series with LSTM Recurrent Neural Networks , 2015, ArXiv.