Simultaneous nonlinear model predictive control and state estimation

Author(s): Copp, David | Advisor(s): Hespanha, Joao | Abstract: As computational power increases, online optimization is becoming a ubiquitous approach for solving control and estimation problems in both academia and industry. This widespread popularity of online optimization techniques is largely due to their abilities to solve complex problems in real time and to explicitly accommodate hard constraints. In this dissertation, we discuss an especially popular online optimization control technique called model predictive control (MPC). Specifically, we present a novel output-feedback approach to nonlinear MPC, which combines the problems of state estimation and control into a single min-max optimization. In this way, the control and estimation problems are solved simultaneously providing an output-feedback controller that is robust to worst-case system disturbances and noise. This min-max optimization is subject to the nonlinear system dynamics as well as constraints that come from practical considerations such as actuator limits. Furthermore, we introduce a novel primal-dual interior-point method that can be used to efficiently solve the min-max optimization problem numerically and present several examples showing that the method succeeds even for severely nonlinear and non-convex problems. Unlike other output-feedback nonlinear optimal control approaches that solve the estimation and control problems separately, this combined estimation and control approach facilitates straightforward analysis of the resulting constrained, nonlinear, closed-loop system and yields improved performance over other standard approaches. Under appropriate assumptions that encode controllability and observability of the nonlinear process to be controlled, we show that this approach ensures that the state of the closed-loop system remains bounded. Finally, we investigate the use of this approach in several applications including the coordination of multiple unmanned aerial vehicles for vision-based target tracking of a moving ground vehicle and feedback control of an artificial pancreas system for the treatment of Type 1 Diabetes. We discuss why this novel combined control and estimation approach is especially beneficial for these applications and show promising simulation results for the eventual implementation of this approach in real-life scenarios.

[1]  David Yang Gao,et al.  Canonical Dual Transformation Method and Generalized Triality Theory in Nonsmooth Global Optimization , 2000, J. Glob. Optim..

[2]  James B. Rawlings,et al.  Critical Evaluation of Extended Kalman Filtering and Moving-Horizon Estimation , 2005 .

[3]  Eyal Dassau,et al.  Adjustment of Open-Loop Settings to Improve Closed-Loop Results in Type 1 Diabetes: A Multicenter Randomized Trial. , 2015, The Journal of clinical endocrinology and metabolism.

[4]  F. Allgöwer,et al.  A note on stability, robustness and performance of output feedback nonlinear model predictive control , 2003 .

[5]  B. Bequette A critical assessment of algorithms and challenges in the development of a closed-loop artificial pancreas. , 2005, Diabetes technology & therapeutics.

[6]  Luigi Chisci,et al.  Optimal UAV coordination for target tracking using dynamic programming , 2010, 49th IEEE Conference on Decision and Control (CDC).

[7]  Alberto Bemporad,et al.  Robust model predictive control: A survey , 1998, Robustness in Identification and Control.

[8]  João Pedro Hespanha,et al.  Robust UAV coordination for target tracking using output-feedback model predictive control with moving horizon estimation , 2015, 2015 American Control Conference (ACC).

[9]  Derek A. Paley,et al.  Multivehicle Coordination in an Estimated Time-Varying Flowfield , 2011 .

[10]  M. Guay,et al.  Adaptive Robust MPC: A minimally-conservative approach , 2007, 2007 American Control Conference.

[11]  William S. Levine,et al.  The Control Handbook , 2005 .

[12]  R.S. Parker,et al.  A model-based algorithm for blood glucose control in Type I diabetic patients , 1999, IEEE Transactions on Biomedical Engineering.

[13]  Eyal Dassau,et al.  MPC design for rapid pump-attenuation and expedited hyperglycemia response to treat T1DM with an Artificial Pancreas , 2014, 2014 American Control Conference.

[14]  Moritz Diehl,et al.  Robust dynamic programming for min-max model predictive control of constrained uncertain systems , 2004, IEEE Transactions on Automatic Control.

[15]  Frank Allgöwer,et al.  State and Output Feedback Nonlinear Model Predictive Control: An Overview , 2003, Eur. J. Control.

[16]  Francesco Bullo,et al.  Distributed Control of Robotic Networks , 2009 .

[17]  Jay H. Lee,et al.  A moving horizon‐based approach for least‐squares estimation , 1996 .

[18]  Joao P. Hespanha,et al.  Robust Coordination of Small UAVs for Vision‐Based Target Tracking Using Output‐Feedback MPC with MHE , 2017 .

[19]  Naira Hovakimyan,et al.  Cooperative target tracking in balanced circular formation: Multiple UAVs tracking a ground vehicle , 2013, 2013 American Control Conference.

[20]  Jay H. Lee,et al.  Constrained linear state estimation - a moving horizon approach , 2001, Autom..

[21]  Eyal Dassau,et al.  Zone Model Predictive Control: A Strategy to Minimize Hyper- and Hypoglycemic Events , 2010, Journal of diabetes science and technology.

[22]  David Angeli,et al.  Fundamentals of economic model predictive control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[23]  James B. Rawlings,et al.  Tutorial overview of model predictive control , 2000 .

[24]  R. Hovorka Continuous glucose monitoring and closed‐loop systems , 2006, Diabetic medicine : a journal of the British Diabetic Association.

[25]  Hans Joachim Ferreau,et al.  Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation , 2009 .

[26]  Eduardo D. Sontag,et al.  Control-Lyapunov functions , 1999 .

[27]  Francisco Facchinei,et al.  A smoothing method for mathematical programs with equilibrium constraints , 1999, Math. Program..

[28]  Ahmad Haidar,et al.  The Artificial Pancreas: How Closed-Loop Control Is Revolutionizing Diabetes , 2016, IEEE Control Systems.

[29]  S. Griffis EDITOR , 1997, Journal of Navigation.

[30]  Amit K. Roy-Chowdhury,et al.  Coordinated sensing and tracking for mobile camera platforms , 2012, 2012 American Control Conference (ACC).

[31]  Stephen J. Wright,et al.  Application of Interior-Point Methods to Model Predictive Control , 1998 .

[32]  W. P. M. H. Heemels,et al.  On input-to-state stability of min-max nonlinear model predictive control , 2008, Syst. Control. Lett..

[33]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[34]  Mahendra Mallick,et al.  Geolocation using video sensor measurements , 2007, 2007 10th International Conference on Information Fusion.

[35]  Stephen P. Boyd,et al.  Fast Model Predictive Control Using Online Optimization , 2010, IEEE Transactions on Control Systems Technology.

[36]  James B. Rawlings,et al.  Particle filtering and moving horizon estimation , 2006, Comput. Chem. Eng..

[37]  Lorenz T. Biegler,et al.  Optimization approaches to nonlinear model predictive control , 1991 .

[38]  David Q. Mayne,et al.  Constrained state estimation for nonlinear discrete-time systems: stability and moving horizon approximations , 2003, IEEE Trans. Autom. Control..

[39]  Derek Kingston,et al.  Decentralized Control of Multiple UAVs for Perimeter and Target Surveillance , 2007 .

[40]  Joao P. Hespanha,et al.  Simultaneous model predictive control and moving horizon estimation for blood glucose regulation in Type 1 diabetes , 2018 .

[41]  Martin Guay,et al.  Adaptive Model Predictive Control for Constrained Nonlinear Systems , 2008 .

[42]  Hyondong Oh,et al.  Nonlinear Model Predictive Coordinated Standoff Tracking of a Moving Ground Vehicle , 2011 .

[43]  Eduardo F. Camacho,et al.  Min-max Model Predictive Control of Nonlinear Systems: A Unifying Overview on Stability , 2009, Eur. J. Control.

[44]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[45]  Daniel Liberzon,et al.  Universal construction of feedback laws achieving ISS and integral-ISS disturbance attenuation , 2002, Syst. Control. Lett..

[46]  Stephen J. Wright,et al.  Nonlinear Predictive Control and Moving Horizon Estimation — An Introductory Overview , 1999 .

[47]  Lorenz T. Biegler,et al.  Efficient Solution of Dynamic Optimization and NMPC Problems , 2000 .

[48]  S. R. Searle,et al.  Matrix Algebra Useful for Statistics , 1982 .

[49]  João Pedro Hespanha,et al.  Nonlinear output-feedback model predictive control with moving horizon estimation , 2014, 53rd IEEE Conference on Decision and Control.

[50]  Eyal Dassau,et al.  Velocity-weighting to prevent controller-induced hypoglycemia in MPC of an artificial pancreas to treat T1DM , 2015, 2015 American Control Conference (ACC).

[51]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[52]  Johan Löfberg,et al.  TOWARDS JOINT STATE ESTIMATION AND CONTROL IN MINIMAX MPC , 2002 .

[53]  David Q. Mayne,et al.  Robust output feedback model predictive control of constrained linear systems , 2006, Autom..

[54]  D. Mayne,et al.  Min-max feedback model predictive control for constrained linear systems , 1998, IEEE Trans. Autom. Control..

[55]  Dimitri Boiroux Model Predictive Control Algorithms for Pen and Pump Insulin Administration , 2012 .

[56]  Jinfeng Liu,et al.  Lyapunov-based MPC with robust moving horizon estimation and its triggered implementation , 2013 .

[57]  Eduardo F. Camacho,et al.  MIN-MAX MODEL PREDICTIVE CONTROL AS A QUADRATIC PROGRAM , 2005 .

[58]  Frank Allgöwer,et al.  Robust model predictive control for nonlinear discrete‐time systems , 2003 .

[59]  Riccardo Scattolini,et al.  Robustness and robust design of MPC for nonlinear discrete-time systems , 2007 .

[60]  Lorenz T. Biegler,et al.  A Survey on Sensitivity-based Nonlinear Model Predictive Control , 2013 .

[61]  Wpmh Maurice Heemels,et al.  Stabilizing output feedback nonlinear model predictive control : an extended observer approach , 2006 .

[62]  Giuseppe De Nicolao,et al.  Model predictive control of glucose concentration in type I diabetic patients: An in silico trial , 2009, Biomed. Signal Process. Control..

[63]  L. Magni,et al.  Evaluating the Efficacy of Closed-Loop Glucose Regulation via Control-Variability Grid Analysis , 2008, Journal of diabetes science and technology.

[64]  Giorgio Battistelli,et al.  Moving-horizon state estimation for nonlinear discrete-time systems: New stability results and approximation schemes , 2008, Autom..

[65]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[66]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .

[67]  Lars Grne,et al.  Nonlinear Model Predictive Control: Theory and Algorithms , 2011 .

[68]  David Q. Mayne,et al.  Adaptive receding horizon control for constrained nonlinear systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[69]  Frank L. Lewis,et al.  Multi-agent discrete-time graphical games and reinforcement learning solutions , 2014, Autom..

[70]  Reuven Y. Rubinstein,et al.  Nondifferentiable optimization via smooth approximation: General analytical approach , 1992, Ann. Oper. Res..

[71]  John T. Betts,et al.  Practical Methods for Optimal Control and Estimation Using Nonlinear Programming , 2009 .

[72]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[73]  C. Cobelli,et al.  In Silico Preclinical Trials: A Proof of Concept in Closed-Loop Control of Type 1 Diabetes , 2009, Journal of diabetes science and technology.

[74]  Francis J. Doyle,et al.  Design of an artificial pancreas using zone model predictive control with a Moving Horizon State Estimator , 2014, 53rd IEEE Conference on Decision and Control.

[75]  Anil V. Rao,et al.  Practical Methods for Optimal Control Using Nonlinear Programming , 1987 .

[76]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[77]  L. Grüne,et al.  Nonlinear Model Predictive Control : Theory and Algorithms. 2nd Edition , 2011 .

[78]  Dale E. Seborg,et al.  Control-Relevant Models for Glucose Control Using A Priori Patient Characteristics , 2012, IEEE Transactions on Biomedical Engineering.

[79]  M. Hovd,et al.  Robust output feedback model predictive control for linear systems via moving horizon estimation , 2008, 2008 American Control Conference.

[80]  A CoppDavid,et al.  Simultaneous nonlinear model predictive control and state estimation , 2017 .

[81]  R. Hovorka,et al.  Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes. , 2004, Physiological measurement.

[82]  João Pedro Hespanha,et al.  Conditions for saddle-point equilibria in output-feedback MPC with MHE , 2016, 2016 American Control Conference (ACC).

[83]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[84]  Eyal Dassau,et al.  Periodic-Zone Model Predictive Control for Diurnal Closed-Loop Operation of an Artificial Pancreas , 2013, Journal of diabetes science and technology.

[85]  Roy E. Marsten,et al.  On Implementing Mehrotra's Predictor-Corrector Interior-Point Method for Linear Programming , 1992, SIAM J. Optim..

[86]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[87]  Rainer Manuel Schaich,et al.  Robust model predictive control , 2017 .

[88]  João P. Hespanha,et al.  Addressing Adaptation and Learning in the Context of MPC with MHE , 2015 .

[89]  K. Glover,et al.  A game theoretic approach to moving horizon control , 1993 .

[90]  C. Scherer,et al.  A game theoretic approach to nonlinear robust receding horizon control of constrained systems , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[91]  Jinfeng Liu Moving horizon state estimation for nonlinear systems with bounded uncertainties , 2013 .

[92]  T. Basar,et al.  H∞-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach , 1996, IEEE Trans. Autom. Control..

[93]  Eyal Dassau,et al.  Periodic zone-MPC with asymmetric costs for outpatient-ready safety of an artificial pancreas to treat type 1 diabetes , 2016, Autom..

[94]  Tyler H. Summers,et al.  Coordinated Standoff Tracking of Moving Targets: Control Laws and Information Architectures , 2008 .

[95]  D. Limón,et al.  Input-to-State Stability: A Unifying Framework for Robust Model Predictive Control , 2009 .

[96]  Stephen J. Wright,et al.  Applying new optimization algorithms to more predictive control , 1996 .

[97]  D. Mayne,et al.  Moving horizon observers and observer-based control , 1995, IEEE Trans. Autom. Control..

[98]  Edwin K. P. Chong,et al.  A POMDP Framework for Coordinated Guidance of Autonomous UAVs for Multitarget Tracking , 2009, EURASIP J. Adv. Signal Process..

[99]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[100]  Lorenz T. Biegler,et al.  Robust extended Kalman filter based nonlinear model predictive control formulation , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[101]  David A. Copp,et al.  Addressing Adaptation and Learning in the Context of Model Predictive Control With Moving-Horizon Estimation , 2016 .

[102]  Eyal Dassau,et al.  Safety Constraints in an Artificial Pancreatic β Cell: An Implementation of Model Predictive Control with Insulin on Board , 2009, Journal of diabetes science and technology.

[103]  F. Doyle,et al.  Design of the Health Monitoring System for the Artificial Pancreas: Low Glucose Prediction Module , 2012, Journal of diabetes science and technology.

[104]  Mats Larsson,et al.  Stabilization of a Riderless Bicycle [Applications of Control] , 2010, IEEE Control Systems.

[105]  Marko Bacic,et al.  Model predictive control , 2003 .

[106]  David Q. Mayne,et al.  Robust output feedback model predictive control of constrained linear systems: Time varying case , 2009, Autom..

[107]  Lauren M. Huyett,et al.  Closed-Loop Artificial Pancreas Systems: Engineering the Algorithms , 2014, Diabetes Care.

[108]  Alberto Bemporad,et al.  Min-max control of constrained uncertain discrete-time linear systems , 2003, IEEE Trans. Autom. Control..

[109]  J. H. Leet,et al.  Worst-case formulations of model predictive control for systems with bounded parameters , 1997, Autom..

[110]  C. Cobelli,et al.  Artificial Pancreas: Past, Present, Future , 2011, Diabetes.