Robust Nonlinear Model Predictive Control based on Constrained Saddle Point Optimization : Stability Analysis and Application to Type 1 Diabetes

This thesis deals with the design of a robust and safe control algorithm to aim at an artificial pancreas. More precisely we will be interested in controlling the stabilizing part of a classical cure. To meet this objective, the design of a robust nonlinear model predictive controller based on the solution of a saddle point optimization problem is considered. Also, to test the controller performances in a realistic case, numerical simulations on a FDA validated testing platform are envisaged.In a first part, we present an extension of the usual nonlinear model predictive controller designed to robustly control, in a sampled-data framework, systems described by nonlinear ordinary differential equations. This controller, which computes the best control input by considering the solution of a constrained saddle point optimization problem, is called saddle point model predictive controller (SPMPC). Using this controller, it is proved that the closed-loop is Ultimately Bounded and, with some assumptions on the problem structure, Input-to State practically Stable. Then, we are interested in numerically solving the corresponding control problem. To do so, we propose an algorithm inspired from the augmented Lagrangian technique and which makes use of adjoint model.In a second part, we consider the application of this controller to the problem of artificial blood glucose control. After a modeling phase, two models are retained. A simple one will be used to design the controller and a complex one will be used to simulate realistic virtual patients. This latter is needed to validate our control approach. In order to compute a good control input, the SPMPC controller needs the full state value. However, the sensors can only provide the value of blood glucose. That is why the design of an adequate observer is envisaged. Then, numerical simulations are performed. The results show the interest of the approach. For all virtual patients, no hypoglycemia event occurs and the time spent in hyperglycemia is too short to induce damageable consequences. Finally, the interest of extending the SPMPC approach to consider the control of time delay systems in a sampled-data framework is numerically explored.

[1]  Mingyu Gao,et al.  Improved unscented kalman filter for bounded state estimation , 2011, 2011 International Conference on Electronics, Communications and Control (ICECC).

[2]  John R. Hauser,et al.  A Barrier Function Method for the Optimization of Trajectory Functionals with Constraints , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[3]  Ondrej Straka,et al.  Unscented Kalman Filter: Aspects and Adaptive Setting of Scaling Parameter , 2012, IEEE Transactions on Automatic Control.

[4]  L. Shampine.  Solving Delay Differential Equations with dde 23 , 2000 .

[5]  M. S. Bichegkuev.  On a weakened Cauchy problem for a linear differential inclusion , 2006 .

[6]  F. Allgöwer,et al.  Inherent Robustness Properties of Quasi-infinite Horizon MPC , 2011 .

[7]  E. Fridman,et al.  Input / output delay approach to robust sampled-data H ∞ control , 2005 .

[8]  R. Unbehauen,et al.  Stochastic stability of the continuous-time extended Kalman filter , 2000 .

[9]  Nonlinear unknown input observer design by LMI for lipschitz nonlinear systems , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[10]  Xiaoteng Gao,et al.  Closed-loop blood glucose control using dual subcutaneous infusion of insulin and glucagon based on switching PID controller , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[11]  Tarunraj Singh,et al.  Blood glucose control algorithms for type 1 diabetic patients: A methodological review , 2013, Biomed. Signal Process. Control..

[12]  R. Rajamani.  Observers for Lipschitz nonlinear systems , 1998, IEEE Trans. Autom. Control..

[13]  Darine Zambrano,et al.  Internal model sliding mode control approach for glucose regulation in type 1 diabetes , 2010, Biomed. Signal Process. Control..

[14]  Qing Hua Qin,et al.  Recent Advances in Computer Science and Information Engineering , 2012, CSIE 2012.

[15]  Luigi del Re,et al.  Reduced hypoglycemia risk in insulin bolus therapy using asymmetric cost functions , 2009, 2009 7th Asian Control Conference.

[16]  Riccardo Scattolini,et al.  Regional Input-to-State Stability for Nonlinear Model Predictive Control , 2006, IEEE Transactions on Automatic Control.

[17]  W. Kenneth Ward,et al.  A Review of Closed-Loop Algorithms for Glycemic Control in the Treatment of Type 1 Diabetes , 2009, Algorithms.

[18]  W. P. M. H. Heemels,et al.  On input-to-state stability of min-max nonlinear model predictive control , 2008, Syst. Control. Lett..

[19]  Eduardo F. Camacho,et al.  Min-Max MPC using a tractable QP Problem , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[20]  Eduardo F. Camacho,et al.  Min-Max MPC based on a computationally efficient upper bound of the worst case cost , 2006 .

[21]  E. Yaz.  Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[22]  Nahum Shimkin,et al.  Nonlinear Control Systems , 2008 .

[23]  D. Rogers,et al.  The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus , 1994 .

[24]  A. Schaft,et al.  A receding-horizon approach to the nonlinear H ∞ control problem , 2000 .

[25]  Dale E. Seborg,et al.  An Improved PID Switching Control Strategy for Type 1 Diabetes , 2008, IEEE Transactions on Biomedical Engineering.

[26]  Juan I. Yuz,et al.  On sampled-data models for model predictive control , 2010, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.

[27]  Daniel U. Campos-Delgado,et al.  Extension of the run-to-run control to multi-boluses schemes , 2008, 2008 IEEE International Conference on Control Applications.

[28]  Marcello Farina,et al.  Tube-based robust sampled-data MPC for linear continuous-time systems , 2012, Autom..

[29]  Ya-Xiang Yuan,et al.  Convergence properties of Beale-Powell restart algorithm , 1998 .

[30]  Bart De Moor,et al.  A structure exploiting interior-point method for moving horizon estimation , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[31]  Simo Särkkä,et al.  On Unscented Kalman Filtering for State Estimation of Continuous-Time Nonlinear Systems , 2007, IEEE Trans. Autom. Control..

[32]  Zehui Mao,et al.  Fault-tolerant control for a class of nonlinear sampled-data systems via a Euler approximate observer , 2010, Autom..

[33]  C. Reinsch.  Smoothing by spline functions , 1967 .

[34]  Yuanwei Jing,et al.  Minimax robust control of structured uncertain time-delay systems , 2008, 2008 American Control Conference.

[35]  Rodrigo A. Ramos,et al.  A new procedure for modeling nonlinear systems via norm-bounded linear differential inclusions , 2011, 2011 Australian Control Conference.

[36]  A. Belmiloudi.  Thermal Therapy: Stabilization and Identification , 2011 .

[37]  Claudio Cobelli,et al.  Meal Simulation Model of the Glucose-Insulin System , 2007, IEEE Transactions on Biomedical Engineering.

[38]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[39]  Frank Allgöwer,et al.  Design of Terminal Cost Functionals and Terminal Regions for Model Predictive Control of Nonlinear Time-Delay Systems , 2012 .

[40]  Miss A.O. Penney.  (b) , 1974, The New Yale Book of Quotations.

[41]  G. Nicolao,et al.  Model Predictive Control of glucose concentration in subjects with type 1 diabetes: an in silico trial , 2008 .

[42]  R. Hovorka,et al.  Simulation models for in silico testing of closed-loop glucose controllers in type 1 diabetes , 2008 .

[43]  Tingshu Hu,et al.  Composite quadratic Lyapunov functions for constrained control systems , 2003, IEEE Trans. Autom. Control..

[44]  Jeffrey K. Uhlmann,et al.  Reduced sigma point filters for the propagation of means and covariances through nonlinear transformations , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[45]  Magdi S. Mahmoud,et al.  Switched Time-Delay Systems , 2010 .

[46]  Leipo Liu,et al.  Stability analysis of linear time-delay differential inclusion systems subject to input saturation , 2010 .

[47]  Frank Allgöwer,et al.  Tube MPC scheme based on robust control invariant set with application to Lipschitz nonlinear systems , 2011, CDC/ECC.

[48]  Alma Y. Alanis,et al.  Subcutaneous blood glucose neural inverse optimal control for type 1 diabetes mellitus patients , 2012, World Automation Congress 2012.

[49]  M. Alamir,et al.  From Open-Loop Trajectories to Stabilizing State Feedback -Application to a CSTR- , 1998 .

[50]  Dragan Nesic,et al.  A receding horizon control approach to sampled-data implementation of continuous-time controllers , 2006, Syst. Control. Lett..

[51]  C. Scherer,et al.  A game theoretic approach to nonlinear robust receding horizon control of constrained systems , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[52]  B. Wayne Bequette,et al.  Challenges and progress in the development of a closed-loop artificial pancreas , 2012, 2012 American Control Conference (ACC).

[53]  Amjad Abu-Rmileh,et al.  Wiener sliding-mode control for artificial pancreas: A new nonlinear approach to glucose regulation , 2012, Comput. Methods Programs Biomed..

[54]  E Dassau,et al.  Adaptive control algorithm for a rapid and slow acting insulin therapy following run-to-run methodology , 2010, Proceedings of the 2010 American Control Conference.

[56]  F. Fontes.  A General Framework to Design Stabilizing Nonlinear Model Predictive Controllers , 2001 .

[57]  W. Marsden.  I and J , 2012 .

[58]  Winston Garcia-Gabin,et al.  Smith Predictor Sliding Mode Closed-loop Glucose Controller in Type 1 Diabetes , 2011 .

[59]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[60]  A H Clemens,et al.  The artificial beta cell--a continuous control of blood sugar by external regulation of insulin infusion (glucose controlled insulin infusion system). , 1974, Hormone and metabolic research = Hormon- und Stoffwechselforschung = Hormones et metabolisme.

[61]  P. Niamsup,et al.  Robust H∞ control of linear systems with interval non-differentiable time-varying delays , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[62]  Bart De Moor,et al.  Unbiased minimum-variance input and state estimation for linear discrete-time systems , 2007, Autom..

[63]  Frank Allgöwer,et al.  A quasi-infinite horizon nonlinear model predictive control scheme with guaranteed stability , 1997, 1997 European Control Conference (ECC).

[64]  L C Gatewood,et al.  Simulation studies of blood-glucose regulation: effect of intestinal glucose absorption. , 1968, Computers and biomedical research, an international journal.

[65]  Vladimir Havlena,et al.  Unscented Kalman filter revisited — Hermite-Gauss Quadrature approach , 2012, 2012 15th International Conference on Information Fusion.

[66]  Konrad Reif,et al.  Stochastic stability of the discrete-time extended Kalman filter , 1999, IEEE Trans. Autom. Control..

[67]  Marc D. Breton,et al.  Modular Closed-Loop Control of Diabetes , 2012, IEEE Transactions on Biomedical Engineering.

[68]  Riccardo Scattolini,et al.  Model predictive control of continuous-time nonlinear systems with piecewise constant control , 2004, IEEE Transactions on Automatic Control.

[69]  Eduardo F. Camacho,et al.  Robust stability of min-max MPC controllers for nonlinear systems with bounded uncertainties , 2004 .

[70]  Chunyan Han,et al.  Robust model predictive control for continuous uncertain systems with state delay , 2008 .

[71]  P. S. Teh,et al.  Observer-based residual design for nonlinear systems with unknown inputs , 2011, 2011 Australian Control Conference.

[72]  Yang Kuang,et al.  Mathematical models and software tools for the glucose-insulin regulatory system and diabetes: an overview , 2006 .

[73]  A. Vande Wouwer,et al.  Application of a Continuous-discrete Unknown Input Observer to Estimation in Phytoplanktonic Cultures ? , 2012 .

[74]  L. Biegler,et al.  A fast moving horizon estimation algorithm based on nonlinear programming sensitivity , 2008 .

[75]  Riccardo Scattolini,et al.  Robust Stability Analysis of Nonlinear Discrete-Time Systems With Application to MPC , 2012, IEEE Transactions on Automatic Control.

[76]  Vladimir L. Kharitonov,et al.  Stability of Time-Delay Systems , 2003, Control Engineering.

[77]  F. Allgower,et al.  An EKF-based observer for nonlinear time-delay systems , 2006, 2006 American Control Conference.

[78]  R. Hovorka,et al.  Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes. , 2004, Physiological measurement.

[79]  Yuri B. Shtessel,et al.  High-order sliding-mode control for blood glucose: Practical relative degree approach , 2013 .

[80]  Frank Allgöwer,et al.  General design parameters of model predictive control for nonlinear time-delay systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[81]  Eduardo F. Camacho,et al.  Min–Max MPC based on an upper bound of the worst case cost with guaranteed stability. Application to a pilot plant , 2011 .

[82]  Tongwen Chen,et al.  Offline robust model predictive control with rewinding prediction , 2006, 2006 American Control Conference.

[83]  R. Findeisen,et al.  On Disturbance Attenuation of Nonlinear Moving Horizon Control , 2007 .

[84]  Li Peng,et al.  Improved off-line formulation of robust model predictive control for a discrete time incertain system , 2009, 2009 International Conference on Mechatronics and Automation.

[85]  J. Shewchuk.  An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[86]  Darren M. Dawson,et al.  A new robust nonlinear control algorithm for the regulation of blood glucose in diabetic patients , 2012, 2012 IEEE International Conference on Control Applications.

[87]  Alberto Bemporad,et al.  Robust explicit MPC based on approximate multiparametric convex programming , 2004, IEEE Transactions on Automatic Control.

[88]  F. Allgower,et al.  Robustness Properties and Output Feedback of Optimization Based Sampled-data Open-loop Feedback , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[89]  Arkadi Nemirovski,et al.  Lmi Control Toolbox For Use With Matlab , 2014 .

[90]  Eric Renard,et al.  Insulin Delivery Route for the Artificial Pancreas: Subcutaneous, Intraperitoneal, or Intravenous? Pros and Cons , 2008, Journal of diabetes science and technology.

[91]  M. A. Jaradat,et al.  Optimal PID-Fuzzy Logic Controller for type 1 diabetic patients , 2012, 2012 8th International Symposium on Mechatronics and its Applications.

[92]  A. I. Cohen.  Rate of convergence of several conjugate gradient algorithms. , 1972 .

[93]  M. Mahmoud.  Robust Control and Filtering for Time-Delay Systems , 2000 .

[94]  Chunyan Qu,et al.  Nonlinear estimation for model based fault diagnosis of nonlinear chemical systems , 2009 .

[95]  Masaki Yamakita,et al.  Constrained state estimation for nonlinear systems with non-Gaussian noise , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[96]  H. ChenT,et al.  A Quasi-Infinite Horizon Nonlinear Model Predictive Control Scheme with Guaranteed Stability * , 1998 .

[97]  Franco Blanchini,et al.  Set invariance in control , 1999, Autom..

[98]  D. Nesic,et al.  Model predictive sampled-data redesign for nonlinear systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[99]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[100]  H. Katayama,et al.  Receding Horizon H∞ Control for Time-varying Sampled-data Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[101]  Lorenz T. Biegler,et al.  A tool to analyze robust stability for model predictive controllers , 1999 .

[102]  H. Katayama,et al.  Robust Model Predictive Control for Sampled-data Systems , 2006, 2006 SICE-ICASE International Joint Conference.

[103]  Minimax algorithm for constructing an optimal control strategy in differential games with a Lipschitz payoff , 2011 .

[104]  P. Bassanini,et al.  Elliptic Partial Differential Equations of Second Order , 1997 .

[105]  Zhifeng Dai,et al.  Global convergence of a modified Hestenes-Stiefel nonlinear conjugate gradient method with Armijo line search , 2011, Numerical Algorithms.

[106]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[107]  Dale E. Seborg,et al.  Control-Relevant Models for Glucose Control Using A Priori Patient Characteristics , 2012, IEEE Transactions on Biomedical Engineering.

[108]  Marion Kee,et al.  Analysis , 2004, Machine Translation.

[109]  D. Q. Mayne,et al.  Suboptimal model predictive control (feasibility implies stability) , 1999, IEEE Trans. Autom. Control..

[110]  R. Mahboobi Esfanjani,et al.  Stabilizing model predictive control for constrained nonlinear distributed delay systems. , 2011, ISA transactions.

[111]  Jun Huang,et al.  Robust Stabilization of Linear Differential Inclusions with Affine Uncertainty , 2011, Circuits Syst. Signal Process..

[112]  John O'Reilly,et al.  Optimisation of attraction domains of nonlinear MPC via LMI methods , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[113]  Xiaogang Wang,et al.  Comparison of Unscented Kalman Filters , 2007, 2007 International Conference on Mechatronics and Automation.

[114]  M W Percival,et al.  Development of a multi-parametric model predictive control algorithm for insulin delivery in type 1 diabetes mellitus using clinical parameters. , 2011, Journal of process control.

[115]  Jean-Pierre Richard,et al.  Time-delay systems: an overview of some recent advances and open problems , 2003, Autom..

[116]  Reza Mahboobi Esfanjani,et al.  Robust model predictive control for constrained distributed delay systems , 2009, 2009 XXII International Symposium on Information, Communication and Automation Technologies.

[117]  Antonella Ferrara,et al.  Robust Model Predictive Control With Integral Sliding Mode in Continuous-Time Sampled-Data Nonlinear Systems , 2011, IEEE Transactions on Automatic Control.

[118]  R. Hovorka.  Continuous glucose monitoring and closed‐loop systems , 2006, Diabetic medicine : a journal of the British Diabetic Association.

[119]  Giorgio Battistelli,et al.  Advances in moving horizon estimation for nonlinear systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[120]  D. Mayne,et al.  Robust receding horizon control of constrained nonlinear systems , 1993, IEEE Trans. Autom. Control..

[121]  C. Cobelli,et al.  In Silico Preclinical Trials: A Proof of Concept in Closed-Loop Control of Type 1 Diabetes , 2009, Journal of diabetes science and technology.

[122]  Peter Philipp.  Structure exploiting derivative computation for moving horizon estimation , 2011, Proceedings of the 2011 American Control Conference.

[123]  Radhakant Padhi,et al.  An adaptive insulin infusion approach for customized blood glucose regulation of TYPE I diabetic patients , 2011, 2011 IEEE International Conference on Control Applications (CCA).

[124]  R. Bergman,et al.  Physiologic evaluation of factors controlling glucose tolerance in man: measurement of insulin sensitivity and beta-cell glucose sensitivity from the response to intravenous glucose. , 1981, The Journal of clinical investigation.

[125]  G. Steil,et al.  nterstitial fluid glucose time-lag correction for real-time continuous glucose onitoring , 2012 .

[126]  Rolf Findeisen,et al.  Nonlinear model predictive control : a sampled data feedback perspective , 2005 .

[127]  Emilia Fridman,et al.  A refined input delay approach to sampled-data control , 2010, Autom..

[128]  B. Murty,et al.  Orthogonality correction in the conjugate-gradient method , 1983 .

[129]  Eduardo F. Camacho,et al.  Min-max Model Predictive Control of Nonlinear Systems: A Unifying Overview on Stability , 2009, Eur. J. Control.

[130]  Amjad Abu-Rmileh,et al.  A Gain-Scheduling Model Predictive Controller for Blood Glucose Control in Type 1 Diabetes , 2010, IEEE Transactions on Biomedical Engineering.

[131]  David Q. Mayne,et al.  Constrained state estimation for nonlinear discrete-time systems: stability and moving horizon approximations , 2003, IEEE Trans. Autom. Control..

[132]  Efstratios N. Pistikopoulos,et al.  Simultaneous constrained Moving Horizon state Estimation and Model Predictive Control by multi-parametric programming , 2010, 49th IEEE Conference on Decision and Control (CDC).

[133]  Francis J. Doyle,et al.  Run-to-run control of blood glucose concentrations for people with type 1 diabetes mellitus , 2006, IEEE Transactions on Biomedical Engineering.

[134]  Giuseppe De Nicolao,et al.  Modeling and Control of Diabetes: Towards the Artificial Pancreas , 2011 .

[135]  Konstantina S. Nikita,et al.  An Insulin Infusion Advisory System Based on Autotuning Nonlinear Model-Predictive Control , 2011, IEEE Transactions on Biomedical Engineering.

[136]  Boris Kovatchev,et al.  Analysis, Modeling, and Simulation of the Accuracy of Continuous Glucose Sensors , 2008, Journal of diabetes science and technology.

[137]  John Thomas Sorensen,et al.  A physiologic model of glucose metabolism in man and its use to design and assess improved insulin therapies for diabetes , 1985 .

[138]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[139]  D R Worthington,et al.  Minimal model of food absorption in the gut. , 1997, Medical informatics = Medecine et informatique.

[140]  Amjad Abu-Rmileh,et al.  Feedforward-feedback multiple predictive controllers for glucose regulation in type 1 diabetes , 2010, Comput. Methods Programs Biomed..

[141]  Francis J. Doyle,et al.  Robust H∞ glucose control in diabetes using a physiological model , 2000 .

[142]  Manfred Morari,et al.  Learning a feasible and stabilizing explicit model predictive control law by robust optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[143]  G. Steil,et al.  Closed-loop insulin delivery-the path to physiological glucose control. , 2004, Advanced drug delivery reviews.

[144]  F. J. Doyle.  Zone model predictive control of an artificial pancreas , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[145]  Soohee Han,et al.  Constrained receding horizon controls for nonlinear time-delay systems , 2012 .

[146]  Cheng Wang,et al.  Robust H∞ control for stochastic systems with nonlinearity, uncertainty and time-varying delay , 2012, Comput. Math. Appl..

[147]  Eduardo F. Camacho,et al.  Input to state stability of min-max MPC controllers for nonlinear systems with bounded uncertainties , 2006, Autom..