Stacked LSTM based deep recurrent neural network with kalman smoothing for blood glucose prediction

Blood glucose (BG) management is crucial for type-1 diabetes patients resulting in the necessity of reliable artificial pancreas or insulin infusion systems. In recent years, deep learning techniques have been utilized for a more accurate BG level prediction system. However, continuous glucose monitoring (CGM) readings are susceptible to sensor errors. As a result, inaccurate CGM readings would affect BG prediction and make it unreliable, even if the most optimal machine learning model is used. In this work, we propose a novel approach to predicting blood glucose level with a stacked Long short-term memory (LSTM) based deep recurrent neural network (RNN) model considering sensor fault. We use the Kalman smoothing technique for the correction of the inaccurate CGM readings due to sensor error. For theOhioT1DMdataset, containing eight weeks’ data from six different patients, we achieve an average RMSE of 6.45 and 17.24mg/dl for 30minutes and 60minutes of prediction horizon (PH), respectively. To the best of our knowledge, this is the leading average prediction accuracy for the ohioT1DM dataset. Different physiological information, e.g., Kalman smoothed CGM data, carbohydrates from the meal, bolus insulin, and cumulative step counts in a fixed time interval, are crafted to represent meaningful features used as input to the model. The goal of our approach is to lower the difference between the predicted CGM values and the fingerstick blood glucose readings the ground truth. Our results indicate that the proposed approach is feasible for more reliable BG forecasting that might improve the performance of the artificial pancreas and insulin infusion system for T1D diabetes management.

[1]  Cynthia R. Marling,et al.  The OhioT1DM Dataset for Blood Glucose Level Prediction: Update 2020 , 2020, KDH@ECAI.

[2]  Qian Wang,et al.  Benchmark Machine Learning Approaches with Classical Time Series Approaches on the Blood Glucose Level Prediction Challenge , 2018, KHD@IJCAI.

[3]  J. Hans DeVries,et al.  Accuracy and reliability of continuous glucose monitoring systems: a head-to-head comparison. , 2013, Diabetes technology & therapeutics.

[4]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[5]  2. Classification and Diagnosis of Diabetes , 2014, Diabetes Care.

[6]  Cynthia R. Marling,et al.  Blood Glucose Level Prediction Using Physiological Models and Support Vector Regression , 2013, 2013 12th International Conference on Machine Learning and Applications.

[7]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[8]  Xiaojiang Du,et al.  Patient Infusion Pattern based Access Control Schemes for Wireless Insulin Pump System , 2015, IEEE Transactions on Parallel and Distributed Systems.

[9]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[10]  Classification and Diagnosis of Diabetes Mellitus and Other Categories of Glucose Intolerance , 1979, Diabetes.

[11]  Benjamin Schrauwen,et al.  Training and Analysing Deep Recurrent Neural Networks , 2013, NIPS.

[12]  2. Classification and Diagnosis of Diabetes , 2015, Diabetes Care.

[13]  Günter Niemeyer,et al.  Statistical Hypoglycemia Prediction , 2008, Journal of diabetes science and technology.

[14]  Volker Tresp,et al.  Neural-network models for the blood glucose metabolism of a diabetic , 1999, IEEE Trans. Neural Networks.

[15]  Xiaojiang Du,et al.  Voiceprint-Based Access Control for Wireless Insulin Pump Systems , 2018, 2018 IEEE 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS).

[16]  Razvan C. Bunescu,et al.  LSTMs and Neural Attention Models for Blood Glucose Prediction: Comparative Experiments on Real and Synthetic Data , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Øyvind Stavdahl,et al.  Kalman Smoothing for Objective and Automatic Preprocessing of Glucose Data , 2019, IEEE Journal of Biomedical and Health Informatics.

[18]  Efstratios N. Pistikopoulos,et al.  In Silico Closed-Loop Control Validation Studies for Optimal Insulin Delivery in Type 1 Diabetes , 2015, IEEE Transactions on Biomedical Engineering.

[19]  Giovanni Sparacino,et al.  Modeling Transient Disconnections and Compression Artifacts of Continuous Glucose Sensors. , 2016, Diabetes technology & therapeutics.

[20]  Giuseppe De Nicolao,et al.  Neural Network Incorporating Meal Information Improves Accuracy of Short-Time Prediction of Glucose Concentration , 2012, IEEE Transactions on Biomedical Engineering.

[21]  Malgorzata E. Wilinska,et al.  Insulin kinetics in type-1 diabetes: continuous and bolus delivery of rapid acting insulin , 2005, IEEE Transactions on Biomedical Engineering.

[22]  Giovanni Sparacino,et al.  An Online Failure Detection Method of the Glucose Sensor-Insulin Pump System: Improved Overnight Safety of Type-1 Diabetic Subjects , 2013, IEEE Transactions on Biomedical Engineering.

[23]  Michel Pasquier,et al.  Predicting Hypoglycemia in Diabetic Patients Using Time-Sensitive Artificial Neural Networks , 2016, Int. J. Heal. Inf. Syst. Informatics.

[24]  Marko V. Jankovic,et al.  Predicting Blood Glucose with an LSTM and Bi-LSTM Based Deep Neural Network , 2018, 2018 14th Symposium on Neural Networks and Applications (NEUREL).

[25]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[26]  Xiaojiang Du,et al.  A Visible Light Channel Based Access Control Scheme for Wireless Insulin Pump Systems , 2018, 2018 IEEE International Conference on Communications (ICC).

[27]  Ali Cinar,et al.  Hypoglycemia Early Alarm Systems Based On Multivariable Models. , 2013, Industrial & engineering chemistry research.

[28]  Jenna Wiens,et al.  Deep Multi-Output Forecasting: Learning to Accurately Predict Blood Glucose Trajectories , 2018, KDD.

[29]  Hung T. Nguyen,et al.  Neural network approach for non-invasive detection of hyperglycemia using electrocardiographic signals , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  R. Potts,et al.  Physiological differences between interstitial glucose and blood glucose measured in human subjects. , 2003, Diabetes care.

[31]  David R Flum,et al.  Perioperative hyperglycemia and risk of adverse events among patients with and without diabetes. , 2015, Annals of surgery.

[32]  Jianwei Chen,et al.  A Deep Learning Algorithm for Personalized Blood Glucose Prediction , 2018, KHD@IJCAI.

[33]  E. Kraegen,et al.  Timing of Insulin Delivery with Meals , 1981, Hormone and metabolic research = Hormon- und Stoffwechselforschung = Hormones et metabolisme.

[34]  Md Enamul Haque,et al.  SensPick: Sense Picking for Word Sense Disambiguation , 2021, 2021 IEEE 15th International Conference on Semantic Computing (ICSC).

[35]  FacchinettiAndrea,et al.  Modeling Transient Disconnections and Compression Artifacts of Continuous Glucose Sensors. , 2016 .

[36]  Dimitrios I. Fotiadis,et al.  Glucose Prediction in Type 1 and Type 2 Diabetic Patients Using Data Driven Techniques , 2011 .

[37]  Ali Cinar,et al.  Hypoglycemia Early Alarm Systems Based on Recursive Autoregressive Partial Least Squares Models , 2013, Journal of diabetes science and technology.

[38]  George Dailey,et al.  Effectiveness of sensor-augmented insulin-pump therapy in type 1 diabetes. , 2010, The New England journal of medicine.

[39]  Asha Gowda Karegowda,et al.  Cascading K-means Clustering and K-Nearest Neighbor Classifier for Categorization of Diabetic Patients , 2012 .

[40]  Zaki Nossair,et al.  A Recurrent Neural Network Approach for Predicting Glucose Concentration in Type-1 Diabetic Patients , 2011, EANN/AIAI.

[41]  Chengyuan Liu,et al.  Convolutional Recurrent Neural Networks for Glucose Prediction , 2018, IEEE Journal of Biomedical and Health Informatics.

[42]  C. Cobelli,et al.  Artificial neural network algorithm for online glucose prediction from continuous glucose monitoring. , 2010, Diabetes technology & therapeutics.

[43]  O FOKKENS,et al.  [Classification and diagnosis]. , 1962, Tijdschrift voor sociale geneeskunde.

[44]  Alexander Schliep,et al.  Automatic Blood Glucose Prediction with Confidence Using Recurrent Neural Networks , 2018, KDH@IJCAI.

[45]  Xiaojiang Du,et al.  PIPAC: Patient infusion pattern based access control scheme for wireless insulin pump system , 2013, 2013 Proceedings IEEE INFOCOM.

[46]  Niels Kjølstad Poulsen,et al.  Application of the continuous-discrete extended Kalman filter for fault detection in continuous glucose monitors for type 1 diabetes , 2016, 2016 European Control Conference (ECC).

[47]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[48]  C. Cobelli,et al.  Artificial Pancreas: Past, Present, Future , 2011, Diabetes.

[49]  P. O S I T I O N S T A T E M E N T,et al.  Diagnosis and Classification of Diabetes Mellitus , 2011, Diabetes Care.

[50]  Office Guide to Diagnosis and Classification of Diabetes Mellitus and Other Categories of Glucose Intolerance , 1995, Diabetes Care.

[51]  P. Cryer,et al.  Hypoglycemia in diabetes. , 2003, Diabetes care.

[52]  Lyvia Biagi,et al.  Prediction of Blood Glucose Levels And Nocturnal Hypoglycemia Using Physiological Models and Artificial Neural Networks , 2018, KHD@IJCAI.

[53]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[54]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[55]  K. Nørgaard,et al.  An Early Warning System for Hypoglycemic/Hyperglycemic Events Based on Fusion of Adaptive Prediction Models , 2013, Journal of diabetes science and technology.

[56]  Dimitrios I. Fotiadis,et al.  Multivariate Prediction of Subcutaneous Glucose Concentration in Type 1 Diabetes Patients Based on Support Vector Regression , 2013, IEEE Journal of Biomedical and Health Informatics.

[57]  Xiaolei Xie,et al.  An ARIMA Model With Adaptive Orders for Predicting Blood Glucose Concentrations and Hypoglycemia , 2019, IEEE Journal of Biomedical and Health Informatics.

[58]  Jianwei Chen,et al.  Dilated Recurrent Neural Network for Short-time Prediction of Glucose Concentration , 2018, KHD@IJCAI.

[59]  Scott M. Pappada,et al.  Neural network-based real-time prediction of glucose in patients with insulin-dependent diabetes. , 2011, Diabetes technology & therapeutics.

[60]  Giovanni Sparacino,et al.  Type-1 Diabetes Patient Decision Simulator for In Silico Testing Safety and Effectiveness of Insulin Treatments , 2018, IEEE Transactions on Biomedical Engineering.

[61]  BOULIN,et al.  [Classification and diagnosis of diabetes]. , 1953, Concours medical.

[62]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[63]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[64]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..