A unified framework for hybrid control: model and optimal control theory

We propose a very general framework that systematizes the notion of a hybrid system, combining differential equations and automata, governed by a hybrid controller that issues continuous-variable commands and makes logical decisions. We first identify the phenomena that arise in real-world hybrid systems. Then, we introduce a mathematical model of hybrid systems as interacting collections of dynamical systems, evolving on continuous-variable state spaces and subject to continuous controls and discrete transitions. The model captures the identified phenomena, subsumes previous models, yet retains enough structure to pose and solve meaningful control problems. We develop a theory for synthesizing hybrid controllers for hybrid plants in all optimal control framework. In particular, we demonstrate the existence of optimal (relaxed) and near-optimal (precise) controls and derive "generalized quasi-variational inequalities" that the associated value function satisfies. We summarize algorithms for solving these inequalities based on a generalized Bellman equation, impulse control, and linear programming.

[1]  José Carlos Goulart de Siqueira,et al.  Differential Equations , 1919, Nature.

[2]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[3]  L. Shaw,et al.  System Theory. , 1965, Science.

[4]  H. Witsenhausen.  A class of hybrid-state continuous-time dynamic systems , 1966 .

[5]  and Charles K. Taft Reswick,et al.  Introduction to Dynamic Systems , 1967 .

[6]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[7]  V. Arnold,et al.  Ordinary Differential Equations , 1973 .

[8]  J. Zabczyk.  Optimal control by means switchings , 1973 .

[9]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and Linear Algebra , 1974 .

[10]  L. Young.  Lectures on the Calculus of Variations and Optimal Control Theory , 1980 .

[11]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[12]  Alain Bensoussan,et al.  Impulse Control and Quasi-Variational Inequalities , 1984 .

[13]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[14]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[15]  C. S. Hsu,et al.  Cell-to-Cell Mapping , 1987 .

[16]  L. Tavernini.  Differential automata and their discrete simulators , 1987 .

[17]  J. Yong.  Systems governed by ordinary differential equations with continuous, switching and impulse controls , 1989 .

[18]  P. Varaiya,et al.  Hybrid dynamical systems , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[19]  S. Smale,et al.  On a theory of computation and complexity over the real numbers; np-completeness , 1989 .

[20]  M. H. A. Davis,et al.  Impulse control of piecewise-deterministic processes , 1989, Math. Control. Signals Syst..

[21]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[22]  L. Blum.  A Theory of Computation and Complexity over the real numbers , 1991 .

[23]  O. Costa.  Impulse control of piecewise-deterministic processes via linear programming , 1991 .

[24]  John Guckenheimer,et al.  A Dynamical Simulation Facility for Hybrid Systems , 1993, Hybrid Systems.

[25]  Anil Nerode,et al.  Models for Hybrid Systems: Automata, Topologies, Controllability, Observability , 1992, Hybrid Systems.

[26]  Jozef Hooman,et al.  A Compositional Approach to the Design of Hybrid Systems , 1992, Hybrid Systems.

[27]  Panos J. Antsaklis,et al.  Hybrid System Modeling and Autonomous Control Systems , 1992, Hybrid Systems.

[28]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[29]  Roger W. Brockett,et al.  Hybrid Models for Motion Control Systems , 1993 .

[30]  L. Liao,et al.  Optimal control of systems with continuous and discrete states , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[31]  Robert L. Grossman,et al.  Timed Automata , 1999, CAV.

[32]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[33]  Akash Deshpande,et al.  Control of hybrid systems , 1994 .

[34]  V. Borkar,et al.  A unified framework for hybrid control , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[35]  George Meyer,et al.  Design of Flight Vehicle Management Systems , 1994 .

[36]  Pravin Varaiya,et al.  Viable Control of Hybrid Systems , 1994, Hybrid Systems.

[37]  P. Caines,et al.  The hierarchical lattices of a finite machine , 1995 .

[38]  Michael S. Branicky,et al.  Universal Computation and Other Capabilities of Hybrid and Continuous Dynamical Systems , 1995, Theor. Comput. Sci..

[39]  Anil Nerode,et al.  Viability in Hybrid Systems , 1995, Theor. Comput. Sci..

[40]  M. Branicky,et al.  Algorithms for optimal hybrid control , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[41]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[42]  Michael S. Branicky,et al.  Studies in hybrid systems: modeling, analysis, and control , 1996 .

[43]  Sanjeev R. Kulkarni,et al.  Reduction of Timed Hybrid Systems , 1998, Discret. Event Dyn. Syst..