Computational Methods for Optimal Control of Hybrid Systems

This thesis aims to find algorithms for optimal control of hybrid systems and explore them in sufficient detail to be able to implement the ideas in computational tools. By hybrid systems is meant systems with interacting continuous and discrete dynamics. Code for computations has been developed in parallel to the theory. The optimal control methods studied in this thesis are global, i.e. the entire state space is considered simultaneously rather than searching for locally optimal trajectories. The optimal value function that maps each state of the state space onto the minimal cost for trajectories starting in that state is central for global methods. It is often difficult to compute the value function of an optimal control problem, even for a purely continuous system. This thesis shows that a lower bound of the value function of a hybrid optimal control problem can be found via convex optimization in a linear program. Moreover, a dual of this optimization problem, parameterized in the control law, has been formulated via general ideas from duality in transportation problems. It is shown that the lower bound of the value function is tight for continuous systems and that there is no gap between the dual optimization problems. Two computational tools are presented. One is built on theory for piecewise affine systems. Various analysis and synthesis problems for this kind of systems are via piecewise quadratic Lyapunov-like functions cast into linear matrix inequalities. The second tool can be used for value function computation, control law extraction, and simulation of hybrid systems. This tool parameterizes the value function in its values in a uniform grid of points in the state space, and the optimization problem is formulated as a linear program. The usage of this tool is illustrated in a case study. (Less)

[1]  T. Koopmans.  Optimum Utilization of the Transportation System , 1949 .

[2]  Shouchuan Hu.  Differential equations with discontinuous right-hand sides☆ , 1991 .

[3]  P. Parrilo,et al.  On convexity in stabilization of nonlinear systems , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[4]  A. Rantzer,et al.  Smooth blending of nonlinear controllers using density functions , 2001, 2001 European Control Conference (ECC).

[5]  Thomas A. Henzinger,et al.  A User Guide to HyTech , 1995, TACAS.

[6]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[7]  J. Hespanha,et al.  Nonlinear observability and an invariance principle for switched systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[8]  B. Schutter,et al.  Model predictive control for max-min-plus-scaling systems , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[9]  D. R. Fulkerson,et al.  Flows in Networks. , 1964 .

[10]  Sven Hedlund.  Computational Methods for Hybrid Systems , 1999 .

[11]  H. Sussmann,et al.  A maximum principle for hybrid optimal control problems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[12]  M. Corless.  Robust stability analysis and controller design with quadratic Lyapunov functions , 1994 .

[13]  A. J. van der Schaft,et al.  Complementarity modeling of hybrid systems , 1998, IEEE Trans. Autom. Control..

[14]  Pierre Riedinger,et al.  Optimal control for hybrid systems: an hysteresis example , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[15]  A. Haddad,et al.  On the Controllability and Observability of Hybrid Systems , 1988, 1988 American Control Conference.

[16]  L. Young,et al.  Lectures on the Calculus of Variations and Optimal Control Theory. , 1971 .

[17]  R. Bellman.  Dynamic programming. , 1957, Science.

[18]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[19]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[20]  M. Johansson,et al.  Piecewise Linear Control Systems , 2003 .

[21]  P. Varaiya,et al.  Hybrid dynamical systems , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[22]  V. Borkar,et al.  A unified framework for hybrid control , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[23]  S. Sastry,et al.  On the existence of executions of hybrid automata , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[24]  Xuping Xu,et al.  Optimal control of switched systems: new results and open problems , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[25]  Anders Rantzer,et al.  Convex dynamic programming for hybrid systems , 2002, IEEE Trans. Autom. Control..

[26]  C. Iung,et al.  Linear quadratic optimization for hybrid systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[27]  A. Rantzer.  A dual to Lyapunov's stability theorem , 2001 .

[28]  Alberto Bemporad,et al.  Verification of Hybrid Systems via Mathematical Programming , 1999, HSCC.

[29]  B. Piccoli.  Necessary conditions for hybrid optimization , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[30]  V. Utkin.  Variable structure systems with sliding modes , 1977 .

[31]  S. Hedlund,et al.  Hybrid control laws from convex dynamic programming , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[32]  C.G. Cassandras,et al.  Optimal control of hybrid systems in manufacturing , 2000, Proceedings of the IEEE.

[33]  R. Vinter.  Convex duality and nonlinear optimal control , 1993 .

[34]  S. Rachev,et al.  Mass transportation problems , 1998 .

[35]  Johannes Schumacher,et al.  An Introduction to Hybrid Dynamical Systems, Springer Lecture Notes in Control and Information Sciences 251 , 1999 .

[36]  A. Bensoussan,et al.  Hybrid control and dynamic programming , 1997 .

[37]  M. Branicky,et al.  Algorithms for optimal hybrid control , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[38]  M. Eisen,et al.  Probability and its applications , 1975 .

[39]  Pravin Varaiya,et al.  What's decidable about hybrid automata? , 1995, STOC '95.

[40]  A. Michel,et al.  Stability analysis of switched systems , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[41]  Computation of piecewise quadratic Lyapunov functions for hybrid systems , 1998, IEEE Trans. Autom. Control..

[42]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[43]  M. Branicky.  Multiple Lyapunov functions and other analysis tools for switched and hybrid systems , 1998, IEEE Trans. Autom. Control..

[44]  L. Young.  Lectures on the Calculus of Variations and Optimal Control Theory , 1980 .

[45]  Bruce H. Krogh,et al.  Formal verification of hybrid systems using CheckMate: a case study , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[46]  F. L. Hitchcock.  The Distribution of a Product from Several Sources to Numerous Localities , 1941 .

[47]  A. Rantzer,et al.  Piecewise linear quadratic optimal control , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[48]  Eduardo D. Sontag,et al.  Interconnected Automata and Linear Systems: A Theoretical Framework in Discrete-Time , 1996, Hybrid Systems.

[49]  A. Nerode,et al.  Hybrid Control Systems: An Introductory Discussion to the Special Issue , 1998, IEEE Trans. Autom. Control..

[50]  Karl Henrik Johansson,et al.  Relay Feedback and Multivariable Control , 1997 .

[51]  Max Donath,et al.  American Control Conference , 1993 .

[52]  H. Wong-Toi,et al.  Symbolic analysis of hybrid systems , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[53]  A. Rantzer,et al.  Optimal control of hybrid systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[54]  Olivier Bournez,et al.  Approximate Reachability Analysis of Piecewise-Linear Dynamical Systems , 2000, HSCC.

[55]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[56]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[57]  Wang Yi,et al.  Compositional and symbolic model-checking of real-time systems , 1995, Proceedings 16th IEEE Real-Time Systems Symposium.

[58]  A. Rantzer.  Dynamic Programming via Convex Optimization , 1999 .

[59]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[60]  D. Luenberger.  Optimization by Vector Space Methods , 1968 .

[61]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[62]  Eduardo Sontag.  Nonlinear regulation: The piecewise linear approach , 1981 .

[63]  L. Evans.  Partial Differential Equations and Monge-Kantorovich Mass Transfer , 1997 .

[64]  G. Grammel,et al.  Maximum Principle for a Hybrid System Via Singular Perturbations , 1999 .

[65]  W. P. M. H. Heemels,et al.  Linear Complementarity Systems , 2000, SIAM J. Appl. Math..

[66]  Panos J. Antsaklis,et al.  Modeling and analysis of hybrid control systems , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.