A Dual Mode Adaptive Basal-Bolus Advisor Based on Reinforcement Learning

Self-monitoring of blood glucose (SMBG) and continuous glucose monitoring (CGM) are commonly used by type 1 diabetes (T1D) patients to measure glucose concentrations. The proposed adaptive basal-bolus algorithm (ABBA) supports inputs from either SMBG or CGM devices to provide personalised suggestions for the daily basal rate and prandial insulin doses on the basis of the patients’ glucose level on the previous day. The ABBA is based on reinforcement learning, a type of artificial intelligence, and was validated in silico with an FDA-accepted population of 100 adults under different realistic scenarios lasting three simulated months. The scenarios involve three main meals and one bedtime snack per day, along with different variabilities and uncertainties for insulin sensitivity, mealtime, carbohydrate amount, and glucose measurement time. The results indicate that the proposed approach achieves comparable performance with CGM or SMBG as input signals, without influencing the total daily insulin dose. The results are a promising indication that AI algorithmic approaches can provide personalised adaptive insulin optimization and achieve glucose control—independent of the type of glucose monitoring technology.

[1]  Claudio Cobelli,et al.  In Silico Optimization of Basal Insulin Infusion Rate during Exercise: Implication for Artificial Pancreas , 2013, Journal of diabetes science and technology.

[2]  Stavroula G. Mougiakakou,et al.  Personalized tuning of a reinforcement learning control algorithm for glucose regulation , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Stavroula G. Mougiakakou,et al.  Model-Free Machine Learning in Biomedicine: Feasibility Study in Type 1 Diabetes , 2016, PloS one.

[4]  John N. Tsitsiklis,et al.  Actor-Critic Algorithms , 1999, NIPS.

[5]  C. Cobelli,et al.  The UVA/PADOVA Type 1 Diabetes Simulator , 2014, Journal of diabetes science and technology.

[6]  Stavroula G. Mougiakakou,et al.  An Actor-Critic based controller for glucose regulation in type 1 diabetes , 2013, Comput. Methods Programs Biomed..

[7]  C. Toumazou,et al.  Clinical Safety and Feasibility of the Advanced Bolus Calculator for Type 1 Diabetes Based on Case-Based Reasoning: A 6-Week Nonrandomized Single-Arm Pilot Study. , 2016, Diabetes technology & therapeutics.

[8]  Howard C. Zisser,et al.  Prandial Insulin Dosing Using Run-to-Run Control , 2007, Diabetes Care.

[9]  Claudio Cobelli,et al.  Individually Adaptive Artificial Pancreas in Subjects with Type 1 Diabetes: A One-Month Proof-of-Concept Trial in Free-Living Conditions , 2017 .

[10]  Ahmad Haidar,et al.  The Artificial Pancreas: How Closed-Loop Control Is Revolutionizing Diabetes , 2016, IEEE Control Systems.

[11]  Christofer Toumazou,et al.  Method for automatic adjustment of an insulin bolus calculator: In silico robustness evaluation under intra-day variability , 2015, Comput. Methods Programs Biomed..

[12]  Peter A Baghurst,et al.  Calculating the mean amplitude of glycemic excursion from continuous glucose monitoring data: an automated algorithm. , 2011, Diabetes technology & therapeutics.

[13]  C. Stettler,et al.  Variability of Basal Rate Profiles in Insulin Pump Therapy and Association with Complications in Type 1 Diabetes Mellitus , 2016, PloS one.

[14]  Larry D. Pyeatt,et al.  Reinforcement learning for closed-loop propofol anesthesia: a study in human volunteers , 2014, J. Mach. Learn. Res..

[15]  Martin Straume,et al.  Risk Analysis of Blood Glucose Data: A Quantitative Approach to Optimizing the Control of Insulin Dependent Diabetes , 2000 .

[16]  Christofer Toumazou,et al.  Advanced Insulin Bolus Advisor Based on Run-To-Run Control and Case-Based Reasoning , 2015, IEEE Journal of Biomedical and Health Informatics.

[17]  John Walsh,et al.  Bolus Advisors: Sources of Error, Targets for Improvement , 2018, Journal of diabetes science and technology.

[18]  Francis J. Doyle,et al.  Run-to-run control of blood glucose concentrations for people with type 1 diabetes mellitus , 2006, IEEE Transactions on Biomedical Engineering.

[19]  Claudio Cobelli,et al.  Toward a Run-to-Run Adaptive Artificial Pancreas: In Silico Results , 2018, IEEE Transactions on Biomedical Engineering.

[20]  Pantelis Georgiou,et al.  Automatic Adaptation of Basal Insulin Using Sensor-Augmented Pump Therapy , 2018, Journal of diabetes science and technology.

[21]  The Effectiveness and Risks of Programming an Insulin Pump to Counteract the Dawn Phenomenon in Type 1 Diabetes. , 2014, Endocrine practice : official journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists.

[22]  M. Rendell,et al.  The Dawn Phenomenon, an Early Morning Glucose Rise: Implications for Diabetic Intraday Blood Glucose Variation , 1981, Diabetes Care.

[23]  Larry D. Pyeatt,et al.  Reinforcement Learning: A Novel Method for Optimal Control of Propofol-Induced Hypnosis , 2011, Anesthesia and analgesia.

[24]  Larry D. Pyeatt,et al.  Reinforcement Learning for Closed-Loop Propofol Anesthesia: A Human Volunteer Study , 2010, IAAI.

[25]  Christofer Toumazou,et al.  Enhancing automatic closed-loop glucose control in type 1 diabetes with an adaptive meal bolus calculator - in silico evaluation under intra-day variability , 2017, Comput. Methods Programs Biomed..