Scalable techniques for the computation of viable and reachable sets : safety guarantees for high-dimensional linear time-invariant systems

Reachability analysis and viability theory are key in providing guarantees of safety and proving the existence of safety-preserving controllers for constrained dynamical systems. The minimal reachable tube and (by duality) the viability kernel are the only constructs that can be used for this purpose. Unfortunately, current numerical schemes that compute these constructs suffer from a complexity that is exponential in the dimension of the state, rendering them impractical for systems of dimension greater than three or four. In this thesis we propose two separate approaches that improve the scalability of the computation of the minimal reachable tube and the viability kernel for high-dimensional systems. The first approach is based on structure decomposition and aims to facilitate the use of computationally intensive yet versatile and powerful tools for higher-dimensional linear time-invariant (LTI) systems. Within the structure decomposition framework we present two techniques—Schur-based and Riccati-based decompositions—that impose an appropriate structure on the system which is then exploited for the computation of our desired constructs in lower-dimensional subspaces. The second approach is based on set-theoretic methods and draws a new connection between the viability kernel and maximal reachable sets. Existing tools that compute the maximal reachable sets are efficient and scalable with polynomial complexity in time and space. As such, these scalable techniques can now be used to compute our desired constructs and therefore provide guarantees of safety for high-dimensional systems. Based on this new connection between the viability kernel and maximal reachable sets we propose a scalable algorithm using ellipsoidal techniques for reachability. We show that this algorithm can efficiently compute a conservative under-

[1]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[2]  Yan Gao,et al.  The Reachability Problem for Uncertain Hybrid Systems Revisited: A Viability Theory Perspective , 2006, HSCC.

[3]  Ian M. Mitchell Scalable calculation of reach sets and tubes for nonlinear systems with terminal integrators: a mixed implicit explicit formulation , 2011, HSCC '11.

[4]  Hassan K. Khalil,et al.  Singular perturbation methods in control : analysis and design , 1986 .

[5]  Oded Maler,et al.  Recent progress in continuous and hybrid reachability analysis , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[6]  Antoine Girard,et al.  Efficient Computation of Reachable Sets of Linear Time-Invariant Systems with Inputs , 2006, HSCC.

[7]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[8]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[9]  Bruce H. Krogh,et al.  Reachability Analysis of Large-Scale Affine Systems Using Low-Dimensional Polytopes , 2006, HSCC.

[10]  A. Rantzer,et al.  On Analysis and Synthesis of Safe Control Laws , 2004 .

[11]  Ian M. Mitchell,et al.  A Toolbox of Level Set Methods , 2005 .

[12]  Antoine Girard,et al.  Approximate bisimulation relations for constrained linear systems , 2007, Autom..

[13]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[14]  Ian M. Mitchell,et al.  Computing the viability kernel using maximal reachable sets , 2012, HSCC '12.

[15]  S. Raković Set Theoretic Methods in Model Predictive Control , 2009 .

[16]  S. Syafiie,et al.  NMPC for Propofol Drug Dosing during Anesthesia Induction , 2009 .

[17]  John Lygeros,et al.  Controllers for reachability specifications for hybrid systems , 1999, Autom..

[18]  Volker Krebs,et al.  Reachability Analysis and Control of a Special Class of Hybrid Systems , 2002 .

[19]  Pravin Varaiya,et al.  Computation of Reach Sets for Dynamical Systems , 2010 .

[20]  Oded Maler,et al.  Reachability Analysis via Face Lifting , 1998, HSCC.

[21]  John Lygeros,et al.  Verified hybrid controllers for automated vehicles , 1998, IEEE Trans. Autom. Control..

[22]  Ian M. Mitchell Comparing Forward and Backward Reachability as Tools for Safety Analysis , 2007, HSCC.

[23]  Antoine Girard,et al.  Reachability of Uncertain Linear Systems Using Zonotopes , 2005, HSCC.

[24]  John Lygeros,et al.  Controlled Invariance of Discrete Time Systems , 2000, HSCC.

[25]  Magdi S. Mahmoud,et al.  Large scale systems modelling , 1981 .

[26]  Mato Baotic,et al.  Multi-Parametric Toolbox (MPT) , 2004, HSCC.

[27]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .

[28]  Domitilla Del Vecchio,et al.  Automated Vehicle-to-Vehicle Collision Avoidance at Intersections , 2011 .

[29]  Julio E. Normey-Rico,et al.  Robust Predictive Control Strategy Applied for Propofol Dosing Using BIS as a Controlled Variable During Anesthesia , 2008, IEEE Transactions on Biomedical Engineering.

[30]  A.N. Daryin,et al.  Reachability Approaches and Ellipsoidal Techniques for Closed-Loop Control of Oscillating Systems under Uncertainty , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[31]  Alexandre M. Bayen,et al.  Aircraft Autolander Safety Analysis Through Optimal Control-Based Reach Set Computation , 2007 .

[32]  Inseok Hwang,et al.  Computation of an over-approximation of the backward reachable set using subsystem level set functions , 2003, 2003 European Control Conference (ECC).

[33]  Wolfgang Kuehn,et al.  Rigorously computed orbits of dynamical systems without the wrapping effect , 1998, Computing.

[34]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[35]  A. Pnueli,et al.  Effective synthesis of switching controllers for linear systems , 2000, Proceedings of the IEEE.

[36]  A. Girard,et al.  Efficient reachability analysis for linear systems using support functions , 2008 .

[37]  P. Saint-Pierre,et al.  Set-Valued Numerical Analysis for Optimal Control and Differential Games , 1999 .

[38]  M. Safonov,et al.  A Schur method for balanced-truncation model reduction , 1989 .

[39]  C. Tomlin,et al.  Ellipsoidal approximations of reachable sets for linear games , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[40]  João Miranda Lemos,et al.  Drug Delivery for Neuromuscular Blockade With Supervised Multimodel Adaptive Control , 2009, IEEE Transactions on Control Systems Technology.

[41]  Kyu-Hong Shim,et al.  Singularly perturbed unified time systems with low sensitivity to model reduction using delta operators , 2006, Int. J. Syst. Sci..

[42]  Ian M. Mitchell,et al.  A Toolbox of Hamilton-Jacobi Solvers for Analysis of Nondeterministic Continuous and Hybrid Systems , 2005, HSCC.

[43]  Antoine Girard,et al.  SpaceEx: Scalable Verification of Hybrid Systems , 2011, CAV.

[44]  E. K. Kostousovat Control synthesis via parallelotopes: optimzation and parallel compuations * , 2001 .

[45]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[46]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[47]  A. Kurzhanski,et al.  Ellipsoidal Calculus for Estimation and Control , 1996 .

[48]  D. Mayne,et al.  Set Robust Control Invariance for Linear Discrete Time Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[49]  Z. Gajic,et al.  General transformation for block diagonalization of weakly coupled linear systems composed of N-subsystems , 2000 .

[50]  Meeko M. K. Oishi,et al.  Complexity reduction through a Schur-based decomposition for reachability analysis of linear time-invariant systems , 2011, Int. J. Control.

[51]  Domitilla Del Vecchio,et al.  A separation principle for a class of hybrid automata on a partial order , 2009, 2009 American Control Conference.

[52]  Ian M. Mitchell,et al.  Overapproximating Reachable Sets by Hamilton-Jacobi Projections , 2003, J. Sci. Comput..

[53]  George J. Pappas,et al.  Geometric programming relaxations for linear system reachability , 2004, Proceedings of the 2004 American Control Conference.

[54]  Ian M. Mitchell,et al.  The continual reachability set and its computation using maximal reachability techniques , 2011, IEEE Conference on Decision and Control and European Control Conference.

[55]  B. Krogh,et al.  Reachability analysis of nonlinear systems using trajectory piecewise linearized models , 2006, 2006 American Control Conference.

[56]  Franco Blanchini,et al.  Set-theoretic methods in control , 2007 .

[57]  P. Saint-Pierre Approximation of the viability kernel , 1994 .

[58]  P. Kokotovic A Riccati equation for block-diagonalization of ill-conditioned systems , 1975 .

[59]  B. Krogh,et al.  Reachability analysis of hybrid control systems using reduced-order models , 2004, Proceedings of the 2004 American Control Conference.

[60]  Mark R. Greenstreet Verifying Safety Properties of Differential Equations , 1996, CAV.

[61]  G.A. Dumont,et al.  Modelling for Computer Controlled Neuromuscular Blockade , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[62]  Ian M. Mitchell,et al.  Fixed-complexity piecewise ellipsoidal representation of the continual reachability set based on ellipsoidal techniques , 2012, 2012 American Control Conference (ACC).

[63]  Pravin Varaiya,et al.  Reach Set Computation Using Optimal Control , 2000 .

[64]  Jean-Pierre Aubin,et al.  Viability Theory: New Directions , 2011 .

[65]  Pravin Varaiya,et al.  Ellipsoidal Techniques for Reachability Analysis of Discrete-Time Linear Systems , 2007, IEEE Transactions on Automatic Control.

[66]  Guy Albert Dumont,et al.  Introduction to Automated Drug Delivery in Clinical Anesthesia , 2005, Eur. J. Control.

[67]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[68]  Eugene Asarin,et al.  Abstraction by Projection and Application to Multi-affine Systems , 2004, HSCC.

[69]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[70]  K. W. Chang Singular Perturbations of a General Boundary Value Problem , 1972 .

[71]  Colas Le Guernic Reachability Analysis of Hybrid Systems with Linear Continuous Dynamics. (Calcul d'Atteignabilité des Systèmes Hybrides à Partie Continue Linéaire) , 2009 .

[72]  John Lygeros,et al.  Air traffic management with target windows: An approach using reachability , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[73]  John Lygeros,et al.  On reachability and minimum cost optimal control , 2004, Autom..

[74]  Gene H. Golub,et al.  Matrix computations , 1983 .

[75]  M. Egerstedt,et al.  On the regularization of Zeno hybrid automata , 1999 .

[76]  Pravin Varaiya,et al.  On Reachability Under Uncertainty , 2002, SIAM J. Control. Optim..

[77]  E. Kerrigan Robust Constraint Satisfaction: Invariant Sets and Predictive Control , 2000 .

[78]  Jürgen Groβ,et al.  Explicit solutions to the matrix inverse problem AX = B , 1999 .

[79]  Jean-Pierre Aubin Viability Kernels and Capture Basins of Sets Under Differential Inclusions , 2001, SIAM J. Control. Optim..

[80]  Olaf Stursberg,et al.  Efficient Representation and Computation of Reachable Sets for Hybrid Systems , 2003, HSCC.

[81]  A. Laub,et al.  Feedback properties of multivariable systems: The role and use of the return difference matrix , 1981 .

[82]  Antoine Girard,et al.  Controller synthesis for safety and reachability via approximate bisimulation , 2010, Autom..

[83]  Datta N. Godbole,et al.  Addressing Multiobjective Control: Safety and Performance through Constrained Optimization , 2001, HSCC.

[84]  Sophie Martin,et al.  Approximating Viability Kernels With Support Vector Machines , 2007, IEEE Transactions on Automatic Control.

[85]  Meeko M. K. Oishi,et al.  Schur-based decomposition for reachability analysis of linear time-invariant systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[86]  Alexandre M. Bayen,et al.  Computational Techniques for the Verification and Control of Hybrid Systems , 2005 .

[87]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[88]  G. Kenny,et al.  'Paedfusor' pharmacokinetic data set. , 2005, British journal of anaesthesia.

[89]  Pravin Varaiya,et al.  Ellipsoidal Techniques for Reachability Analysis , 2000, HSCC.

[90]  P. Bertrand,et al.  Optimal approximation of high-order systems subject to polynomial inputs , 1977 .

[91]  Manjunatha K Prasad,et al.  Generalized Inverse of a Matrix and its Applications , 2011 .

[92]  Arthur E. Bryson,et al.  Control of spacecraft and aircraft , 1994 .

[93]  H. Raiffa,et al.  3. The Double Description Method , 1953 .

[94]  Guy A. Dumont,et al.  Robust control of depth of anesthesia , 2008 .

[95]  Guy A. Dumont,et al.  Multivariable self-tuning control based on laguerre series representation , 1989 .

[96]  Donald R. Smith Decoupling and order reduction via the Riccati transformation , 1987 .

[97]  R. Munos,et al.  A Dynamic Programming Approach to Viability Problems , 2007, 2007 IEEE International Symposium on Approximate Dynamic Programming and Reinforcement Learning.

[98]  Franco Blanchini,et al.  Set invariance in control , 1999, Autom..

[99]  B. Krogh,et al.  Computing polyhedral approximations to flow pipes for dynamic systems , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[100]  Ruzena Bajcsy,et al.  Safe semi-autonomous control with enhanced driver modeling , 2012, 2012 American Control Conference (ACC).

[101]  Ian M. Mitchell,et al.  Optimization Techniques for State-Constrained Control and Obstacle Problems , 2006 .

[102]  Ali Jadbabaie,et al.  Safety Verification of Hybrid Systems Using Barrier Certificates , 2004, HSCC.

[103]  Sriram Sankaranarayanan,et al.  Generating and Analyzing Symbolic Traces of Simulink/Stateflow Models , 2009, CAV.

[104]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[105]  Antoine Girard,et al.  Synthesis using approximately bisimilar abstractions: state-feedback controllers for safety specifications , 2010, HSCC '10.

[106]  Antoine Girard,et al.  Approximation Metrics for Discrete and Continuous Systems , 2006, IEEE Transactions on Automatic Control.

[107]  R. Hofmockel,et al.  Automatic drug delivery in anesthesia: From the beginning until now , 2007, 2007 Mediterranean Conference on Control & Automation.

[108]  B. Krogh,et al.  Reachability Analysis for Affine Systems Using ε-Decomposition , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[109]  A. Girard,et al.  Reachability analysis of linear systems using support functions , 2010 .

[110]  Gerhard Freiling,et al.  A survey of nonsymmetric Riccati equations , 2002 .

[111]  Terence J. Gilhuly,et al.  Modelling and control of neuromuscular blockade , 2007 .

[112]  P. Varaiya,et al.  Ellipsoidal techniques for reachability analysis: internal approximation , 2000 .

[113]  P. Varaiya,et al.  Ellipsoidal Toolbox (ET) , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[114]  Christophe Béné,et al.  A viability analysis for a bio-economic model , 2001 .

[115]  A. Morse Supervisory control of families of linear set-point controllers , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[116]  Mireille E. Broucke,et al.  On the least restrictive control for collision avoidance of two unicycles , 2006 .

[117]  John Lygeros,et al.  A viability approach for the stabilization of an underactuated underwater vehicle in the presence of current disturbances , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[118]  Francesco Borrelli,et al.  Robust invariant sets for constrained storage systems , 2009, Autom..

[119]  João Pedro Hespanha,et al.  Supervised multi-model adaptive control of neuromuscular blockade with off-set compensation , 2009, 2009 European Control Conference (ECC).

[120]  Antoine Girard,et al.  Safety controller synthesis for switched systems using multi-scale symbolic models , 2011, IEEE Conference on Decision and Control and European Control Conference.