Hybrid Dynamical Systems: An Introduction to Control and Verification

Hybrid dynamical systems are a class of complex systems that involve interacting discrete-eventand continuous-variable dynamics. They are important in applications in embedded systems,cyber-physical systems, robotics, manufacturing systems, traffic management, bio-molecular networks,and have recently been at the center of intense research activity in the control theory,computer-aided verification, and artificial intelligence communities. This paper provides a tutorialintroduction to this multidisciplinary research area. A number of fundamental topics, such asmodeling, abstraction, verification, supervisory control, stability analysis, stabilization, andoptimal control of hybrid systems are introduced and discussed. Additionally, more advanced topicsare briefly discussed at the end of each chapter with references given for further reading.

[1]  A. Juloski,et al.  A Bayesian approach to identification of hybrid systems , 2004, CDC.

[2]  Michael Margaliot,et al.  Lie-algebraic stability conditions for nonlinear switched systems and differential inclusions , 2006, Syst. Control. Lett..

[3]  George J. Pappas,et al.  Hierarchical control system design using approximate simulation , 2001 .

[4]  R. Decarlo,et al.  Solution of coupled Lyapunov equations for the stabilization of multimodal linear systems , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[5]  Wolfgang Thomas,et al.  On the Synthesis of Strategies in Infinite Games , 1995, STACS.

[6]  Ali Jadbabaie,et al.  Safety Verification of Hybrid Systems Using Barrier Certificates , 2004, HSCC.

[7]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[8]  B. Krogh,et al.  Synthesis of supervisory controllers for hybrid systems based on approximating automata , 1998, IEEE Trans. Autom. Control..

[9]  Thomas A. Henzinger,et al.  The Algorithmic Analysis of Hybrid Systems , 1995, Theor. Comput. Sci..

[10]  Amir Pnueli,et al.  On the synthesis of a reactive module , 1989, POPL '89.

[11]  Thomas A. Henzinger,et al.  HYTECH: a model checker for hybrid systems , 1997, International Journal on Software Tools for Technology Transfer.

[12]  Feng Zhu,et al.  Optimal control of hybrid switched systems: A brief survey , 2015, Discret. Event Dyn. Syst..

[13]  John Lygeros,et al.  Stochastic Hybrid Models: An Overview , 2003, ADHS.

[14]  Edmund M. Clarke,et al.  Model Checking , 1999, Handbook of Automated Reasoning.

[15]  Mark Reynolds,et al.  Continuous Temporal Models , 2001, Australian Joint Conference on Artificial Intelligence.

[16]  Karl Henrik Johansson,et al.  Dynamical properties of hybrid automata , 2003, IEEE Trans. Autom. Control..

[17]  Jan H. van Schuppen,et al.  Reachability and control synthesis for piecewise-affine hybrid systems on simplices , 2006, IEEE Transactions on Automatic Control.

[18]  Jean-Pierre Aubin,et al.  Impulse differential inclusions: a viability approach to hybrid systems , 2002, IEEE Trans. Autom. Control..

[19]  C.G. Cassandras,et al.  Optimal control of hybrid systems in manufacturing , 2000, Proceedings of the IEEE.

[20]  S. Shankar Sastry,et al.  A numerical method for the optimal control of switched systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[21]  A. Papachristodoulou,et al.  A tutorial on sum of squares techniques for systems analysis , 2005, Proceedings of the 2005, American Control Conference, 2005..

[22]  Stephen A. Edwards,et al.  Design of embedded systems: formal models, validation, and synthesis , 1997, Proc. IEEE.

[23]  A. Rantzer,et al.  Piecewise linear quadratic optimal control , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[24]  Helen Gill,et al.  Cyber-Physical Systems , 2019, 2019 IEEE International Conference on Mechatronics (ICM).

[25]  Antonio Bicchi,et al.  Symbolic planning and control of robot motion [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[26]  Rajeev Alur,et al.  The Theory of Timed Automata , 1991, REX Workshop.

[27]  Pravin Varaiya,et al.  SHIFT: A Formalism and a Programming Language for Dynamic Networks of Hybrid Automata , 1996, Hybrid Systems.

[28]  G. Zhai,et al.  Quadratic stabilizability of switched linear systems with polytopic uncertainties , 2003 .

[29]  S. Pettersson,et al.  Stabilization of hybrid systems using a min-projection strategy , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[30]  David Angeli,et al.  Nonlinear norm-observability notions and stability of switched systems , 2005, IEEE Transactions on Automatic Control.

[31]  W. M. Wonham,et al.  The control of discrete event systems , 1989 .

[32]  S. Sastry,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[33]  Sergio Yovine,et al.  KRONOS: a verification tool for real-time systems , 1997, International Journal on Software Tools for Technology Transfer.

[34]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems, Second Edition , 2008 .

[35]  Raymond A. DeCarlo,et al.  Switched Controller Synthesis for the Quadratic Stabilisation of a Pair of Unstable Linear Systems , 1998, Eur. J. Control.

[36]  K. Narendra,et al.  A common Lyapunov function for stable LTI systems with commuting A-matrices , 1994, IEEE Trans. Autom. Control..

[37]  Joao P. Hespanha,et al.  Stabilization Through Hybrid Control , 2011 .

[38]  Paulo Tabuada An Approximate Simulation Approach to Symbolic Control , 2008, IEEE Transactions on Automatic Control.

[39]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[40]  Domine M. W. Leenaerts,et al.  Piecewise Linear Modeling and Analysis , 1998 .

[41]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[42]  Panos J. Antsaklis,et al.  Optimal control of switched systems based on parameterization of the switching instants , 2004, IEEE Transactions on Automatic Control.

[43]  Christos G. Cassandras,et al.  Introduction to Discrete Event Systems , 1999, The Kluwer International Series on Discrete Event Dynamic Systems.

[44]  A. Michel Recent trends in the stability analysis of hybrid dynamical systems , 1999 .

[45]  Peter E. Caines,et al.  On the Hybrid Optimal Control Problem: Theory and Algorithms , 2007, IEEE Transactions on Automatic Control.

[46]  George J. Pappas,et al.  Discrete abstractions of hybrid systems , 2000, Proceedings of the IEEE.

[47]  Alberto Bemporad,et al.  HYSDEL-a tool for generating computational hybrid models for analysis and synthesis problems , 2004, IEEE Transactions on Control Systems Technology.

[48]  O. Stursberg,et al.  Continuous-discrete interactions in chemical processing plants , 2000, Proceedings of the IEEE.

[49]  B. I. Silva,et al.  Modeling and Verifying Hybrid Dynamic Systems Using CheckMate , 2001 .

[50]  Pravin Varaiya,et al.  What's decidable about hybrid automata? , 1995, STOC '95.

[51]  A. Morse,et al.  Stability of switched systems with average dwell-time , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[52]  Mikael Johansson,et al.  Piecewise linear control systems - a computational approach , 2002, Lecture notes in control and information sciences.

[53]  Anders Rantzer,et al.  CDP Tool, a Matlab Tool for Optimal Control of Hybrid Systems , 1999 .

[54]  M. Johansson,et al.  Piecewise Linear Control Systems , 2003 .

[55]  Joshua A. Levine,et al.  Sampling-based planning, control and verification of hybrid systems , 2000 .

[56]  A. Morse Supervisory control of families of linear set-point controllers , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[57]  Thomas A. Henzinger,et al.  Hybrid Automata: An Algorithmic Approach to the Specification and Verification of Hybrid Systems , 1992, Hybrid Systems.

[58]  R. W. Brockett,et al.  Asymptotic stability and feedback stabilization , 1982 .

[59]  P.J. Antsaklis,et al.  Supervisory control of hybrid systems , 2000, Proceedings of the IEEE.

[60]  S. Shankar Sastry,et al.  O-Minimal Hybrid Systems , 2000, Math. Control. Signals Syst..

[61]  H. Witsenhausen A class of hybrid-state continuous-time dynamic systems , 1966 .

[62]  Alexandre M. Bayen,et al.  Computational techniques for the verification of hybrid systems , 2003, Proc. IEEE.

[63]  Y. Pyatnitskiy,et al.  Criteria of asymptotic stability of differential and difference inclusions encountered in control theory , 1989 .

[64]  W. P. M. H. Heemels,et al.  A Bayesian approach to identification of hybrid systems , 2004, IEEE Transactions on Automatic Control.

[65]  M. Branicky Multiple Lyapunov functions and other analysis tools for switched and hybrid systems , 1998, IEEE Trans. Autom. Control..

[66]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[67]  Robert Shorten,et al.  Stability Criteria for Switched and Hybrid Systems , 2007, SIAM Rev..

[68]  Magnus Egerstedt,et al.  Transition-time optimization for switched-mode dynamical systems , 2006, IEEE Transactions on Automatic Control.

[69]  Marco Pistore,et al.  NuSMV 2: An OpenSource Tool for Symbolic Model Checking , 2002, CAV.

[70]  W. Wonham,et al.  Supervisory control of timed discrete-event systems , 1994, IEEE Trans. Autom. Control..

[71]  R. Sanfelice,et al.  Hybrid dynamical systems , 2009, IEEE Control Systems.

[72]  Robin J. Evans,et al.  Stability results for switched controller systems , 1999, Autom..

[73]  Ricardo G. Sanfelice,et al.  Hybrid Dynamical Systems: Modeling, Stability, and Robustness , 2012 .

[74]  Michael D. Lemmon,et al.  Supervisory hybrid systems , 1999 .

[75]  Ranjan Mukherjee,et al.  Optimally switched linear systems , 2008, Autom..

[76]  Jamal Daafouz,et al.  Stability analysis and control synthesis for switched systems: a switched Lyapunov function approach , 2002, IEEE Trans. Autom. Control..

[77]  G. Ziegler Lectures on Polytopes , 1994 .

[78]  Eduardo Sontag Nonlinear regulation: The piecewise linear approach , 1981 .

[79]  Sriram Sankaranarayanan,et al.  Monte-carlo techniques for falsification of temporal properties of non-linear hybrid systems , 2010, HSCC '10.

[80]  A. Papachristodoulou,et al.  Analysis of switched and hybrid systems - beyond piecewise quadratic methods , 2003, Proceedings of the 2003 American Control Conference, 2003..

[81]  Jianghai Hu,et al.  Stochastic Hybrid Systems , 2013 .

[82]  Bart De Schutter,et al.  Equivalence of hybrid dynamical models , 2001, Autom..

[83]  Eduardo D. Sontag,et al.  Mathematical control theory: deterministic finite dimensional systems (2nd ed.) , 1998 .

[84]  Christel Baier,et al.  Principles of model checking , 2008 .

[85]  Thomas A. Henzinger,et al.  Modularity for Timed and Hybrid Systems , 1997, CONCUR.

[86]  Hai Lin,et al.  Switching Stabilizability for Continuous-Time Uncertain Switched Linear Systems , 2007, IEEE Transactions on Automatic Control.

[87]  Marta Z. Kwiatkowska,et al.  PRISM: Probabilistic Symbolic Model Checker , 2002, Computer Performance Evaluation / TOOLS.

[88]  E. Yaz Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[89]  Panos J. Antsaklis,et al.  Results and Perspectives on Computational Methods for Optimal Control of Switched Systems , 2003, HSCC.

[90]  Philippe Schnoebelen,et al.  Systems and Software Verification, Model-Checking Techniques and Tools , 2001 .

[91]  A. Michel,et al.  Stability theory for hybrid dynamical systems , 1998, IEEE Trans. Autom. Control..

[92]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[93]  M. Egerstedt,et al.  On the regularization of Zeno hybrid automata , 1999 .

[94]  S. Shankar Sastry,et al.  Conflict resolution for air traffic management: a study in multiagent hybrid systems , 1998, IEEE Trans. Autom. Control..

[95]  Nancy A. Lynch,et al.  Hybrid I/O automata , 1995, Inf. Comput..

[96]  Alberto Bemporad,et al.  Dynamic programming for constrained optimal control of discrete-time linear hybrid systems , 2005, Autom..

[97]  Jan H. van Schuppen,et al.  A control problem for affine dynamical systems on a full-dimensional polytope , 2004, Autom..

[98]  Antonis Papachristodoulou,et al.  Robust Stability Analysis of Nonlinear Hybrid Systems , 2009, IEEE Transactions on Automatic Control.

[99]  Jörg Raisch,et al.  Discrete approximation and supervisory control of continuous systems , 1998, IEEE Trans. Autom. Control..

[100]  Guangming Xie,et al.  Controllability and stabilizability of switched linear-systems , 2003, Syst. Control. Lett..

[101]  A. Morse,et al.  Stability of switched systems: a Lie-algebraic condition ( , 1999 .

[102]  Calin Belta,et al.  Controlling a Class of Nonlinear Systems on Rectangles , 2006, IEEE Transactions on Automatic Control.

[103]  A. Bhaya,et al.  Equivalence of stability concepts for discrete time‐varying systems , 1994 .

[104]  Gerard J. Holzmann,et al.  The Model Checker SPIN , 1997, IEEE Trans. Software Eng..

[105]  Hidde de Jong,et al.  Modeling and Simulation of Genetic Regulatory Systems: A Literature Review , 2002, J. Comput. Biol..

[106]  Christos G. Cassandras,et al.  Optimal control of a class of hybrid systems , 2001, IEEE Trans. Autom. Control..

[107]  Thomas Bak,et al.  Planning : A Timed Automata Approach , 2004 .

[108]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[109]  R. Decarlo,et al.  Perspectives and results on the stability and stabilizability of hybrid systems , 2000, Proceedings of the IEEE.

[110]  Vijay Kumar,et al.  Modular Specification of Hybrid Systems in CHARON , 2000, HSCC.

[111]  João Pedro Hespanha,et al.  Stochastic Hybrid Systems: Application to Communication Networks , 2004, HSCC.

[112]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[113]  Kim G. Larsen,et al.  A Tutorial on Uppaal , 2004, SFM.

[114]  Hai Lin,et al.  Stability and Stabilizability of Switched Linear Systems: A Survey of Recent Results , 2009, IEEE Transactions on Automatic Control.

[115]  C. Pinello,et al.  Automotive engine control and hybrid systems: challenges and opportunities , 2000, Proceedings of the IEEE.

[116]  J.-N. Lin,et al.  Canonical piecewise-linear approximations , 1992 .

[117]  A. Nerode,et al.  Hybrid Control Systems: An Introductory Discussion to the Special Issue , 1998, IEEE Trans. Autom. Control..

[118]  Moshe Y. Vardi An Automata-Theoretic Approach to Linear Temporal Logic , 1996, Banff Higher Order Workshop.

[119]  S. Pettersson Synthesis of switched linear systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[120]  Eugene Asarin,et al.  As Soon as Possible: Time Optimal Control for Timed Automata , 1999, HSCC.

[121]  Y. Wardi,et al.  Algorithm for optimal mode scheduling in switched systems , 2012, 2012 American Control Conference (ACC).

[122]  Joao P. Hespanha,et al.  Logic-based switching control of a nonholonomic system with parametric modeling uncertainty , 1999 .

[123]  Antoine Girard,et al.  Approximation Metrics for Discrete and Continuous Systems , 2006, IEEE Transactions on Automatic Control.

[124]  Oded Maler,et al.  Sensitive state-space exploration , 2008, 2008 47th IEEE Conference on Decision and Control.

[125]  Panagiotis Manolios,et al.  Computer-Aided Reasoning: An Approach , 2011 .

[126]  Johannes Schumacher,et al.  An Introduction to Hybrid Dynamical Systems, Springer Lecture Notes in Control and Information Sciences 251 , 1999 .

[127]  Alberto Bemporad,et al.  Identification of piecewise affine systems via mixed-integer programming , 2004, Autom..

[128]  L.C.G.J.M. Habets,et al.  Control of Rectangular Multi-Affine Hybrid Systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[129]  Edward A. Lee,et al.  A hierarchical hybrid system model and its simulation , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[130]  Paulo Tabuada,et al.  Verification and Control of Hybrid Systems - A Symbolic Approach , 2009 .

[131]  Raymond A. DeCarlo,et al.  Optimal control of switching systems , 2005, Autom..

[132]  Anders Rantzer,et al.  Convex dynamic programming for hybrid systems , 2002, IEEE Trans. Autom. Control..

[133]  Thomas A. Henzinger,et al.  The theory of hybrid automata , 1996, Proceedings 11th Annual IEEE Symposium on Logic in Computer Science.

[134]  Derong Liu,et al.  Robust absolute stability of time-varying nonlinear discrete-time systems , 2002 .

[135]  Bruce H. Krogh,et al.  Computational techniques for hybrid system verification , 2003, IEEE Trans. Autom. Control..

[136]  Paul Gastin,et al.  Fast LTL to Büchi Automata Translation , 2001, CAV.

[137]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[138]  A. Morse,et al.  Basic problems in stability and design of switched systems , 1999 .

[139]  Magnus Egerstedt,et al.  Behavior Based Robotics Using Hybrid Automata , 2000, HSCC.

[140]  Lydia E. Kavraki,et al.  Falsification of LTL Safety Properties in Hybrid Systems , 2009, TACAS.

[141]  Edward A. Lee Cyber Physical Systems: Design Challenges , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[142]  Thomas A. Henzinger,et al.  Hybrid Automata with Finite Bisimulatioins , 1995, ICALP.

[143]  Amir Pnueli,et al.  The temporal logic of programs , 1977, 18th Annual Symposium on Foundations of Computer Science (sfcs 1977).

[144]  Calin Belta,et al.  A Fully Automated Framework for Control of Linear Systems from Temporal Logic Specifications , 2008, IEEE Transactions on Automatic Control.

[145]  Antoine Girard,et al.  SpaceEx: Scalable Verification of Hybrid Systems , 2011, CAV.

[146]  Carl W. Lee,et al.  Subdivisions and Triangulationsof Polytopes , 2004, Handbook of Discrete and Computational Geometry, 2nd Ed..

[147]  Jun-ichi Imura,et al.  Characterization of well-posedness of piecewise-linear systems , 2000, IEEE Trans. Autom. Control..

[148]  Francesco Borrelli,et al.  Constrained Optimal Control of Linear and Hybrid Systems , 2003, IEEE Transactions on Automatic Control.

[149]  Alberto Bemporad,et al.  On the Optimal Control Law for Linear Discrete Time Hybrid Systems , 2002, HSCC.

[150]  Christopher K. King,et al.  A singularity test for the existence of common quadratic Lyapunov functions for pairs of stable LTI systems , 2004, Proceedings of the 2004 American Control Conference.

[151]  A. Michel,et al.  Qualitative analysis of discrete-time switched systems , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[152]  E. Mojica-Nava,et al.  A polynomial approach for optimal control of switched nonlinear systems , 2014 .

[153]  Panos J. Antsaklis,et al.  Special issue on hybrid systems: theory and applications a brief introduction to the theory and applications of hybrid systems , 2000, Proc. IEEE.

[154]  S. Sastry,et al.  The Art of Hybrid Systems , 2005 .

[155]  Alberto Bemporad,et al.  Observability and controllability of piecewise affine and hybrid systems , 2000, IEEE Trans. Autom. Control..

[156]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[157]  Rajeev Alur,et al.  Model-checking for real-time systems , 1990, [1990] Proceedings. Fifth Annual IEEE Symposium on Logic in Computer Science.

[158]  E. Allen Emerson,et al.  Temporal and Modal Logic , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[159]  S. Pettersson,et al.  Hybrid system stability and robustness verification using linear matrix inequalities , 2002 .

[160]  John Lygeros,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[161]  H. Sussmann,et al.  A maximum principle for hybrid optimal control problems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[162]  Joseph Sifakis,et al.  On the Synthesis of Discrete Controllers for Timed Systems (An Extended Abstract) , 1995, STACS.

[163]  H. Wong-Toi,et al.  The control of dense real-time discrete event systems , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[164]  Eugene Asarin,et al.  The d/dt Tool for Verification of Hybrid Systems , 2002, CAV.

[165]  Shuzhi Sam Ge,et al.  Controllability and reachability criteria for switched linear systems , 2002, Autom..

[166]  Manfred Morari,et al.  A clustering technique for the identification of piecewise affine systems , 2001, Autom..

[167]  Hai Lin,et al.  Hybrid state feedback stabilization with l 2 performance for discrete-time switched linear systems , 2008, Int. J. Control.

[168]  P. Ramadge,et al.  Supervisory control of a class of discrete event processes , 1987 .

[169]  Panos J. Antsaklis,et al.  Optimal Control of Switched Hybrid Systems: A Brief Survey , 2013 .