Synthesis of optimal switching logic for hybrid systems

Given a multi-modal dynamical system, optimal switching logic synthesis involves generating conditions for switching between the system modes such that the resulting hybrid system satisfies a quantitative specification. We formalize and solve the problem of optimal switching logic synthesis for quantitative specifications over long run behavior. Our paper generalizes earlier work on synthesis for safety. We present an approach for specifying quantitative measures using reward and penalty functions, and illustrate its effectiveness using several examples. Each trajectory of the system, and each state of the system, is associated with a cost. Our goal is to synthesize a system that minimizes this cost from each initial state. Our algorithm works in two steps. For a single initial state, we reduce the synthesis problem to an unconstrained numerical optimization problem which can be solved by any off-the-shelf numerical optimization engines. In the next step, optimal switching condition is learnt as a generalization of the optimal switching states discovered for each initial state. We prove the correctness of our technique and demonstrate the effectiveness of this approach with experimental results.

[1]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[2]  Richard M. Karp,et al.  A characterization of the minimum cycle mean in a digraph , 1978, Discret. Math..

[3]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[4]  Editors , 1986, Brain Research Bulletin.

[5]  David Haussler,et al.  Learnability and the Vapnik-Chervonenkis dimension , 1989, JACM.

[6]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT' 98.

[7]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[8]  B. Krogh,et al.  Synthesis of supervisory controllers for hybrid systems based on approximating automata , 1998, IEEE Trans. Autom. Control..

[9]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[10]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT.

[11]  J. Raisch,et al.  Discrete control of switched linear systems , 1999, 1999 European Control Conference (ECC).

[12]  P. Manon,et al.  Controller synthesis for hybrid systems with linear vector fields , 1999, Proceedings of the 1999 IEEE International Symposium on Intelligent Control Intelligent Systems and Semiotics (Cat. No.99CH37014).

[13]  A. Pnueli,et al.  Effective synthesis of switching controllers for linear systems , 2000, Proceedings of the IEEE.

[14]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[15]  S. Shankar Sastry,et al.  Mode Switching Synthesis for Reachability Specifications , 2001, HSCC.

[16]  Xuping Xu,et al.  Optimal control of switched systems via non-linear optimization based on direct differentiations of value functions , 2002 .

[17]  Jean Charles Gilbert,et al.  Numerical Optimization: Theoretical and Practical Aspects , 2003 .

[18]  Peter E. Caines,et al.  On the Optimal Control of Hybrid Systems: Optimization of Trajectories, Switching Times, Location Schedules , 2003, HSCC.

[19]  Antonín Kucera,et al.  On the Controller Synthesis for Finite-State Markov Decision Processes , 2005, Fundam. Informaticae.

[20]  Amit Patra,et al.  Super-stable energy based switching control scheme for DC-DC buck converter circuits , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[21]  Kim G. Larsen,et al.  On using priced timed automata to achieve optimal scheduling , 2006, Formal Methods Syst. Des..

[22]  J. Frédéric Bonnans,et al.  Numerical Optimization: Theoretical and Practical Aspects (Universitext) , 2006 .

[23]  Krishnendu Chatterjee,et al.  Markov Decision Processes with Multiple Long-Run Average Objectives , 2007, FSTTCS.

[24]  Erik I. Verriest,et al.  Gradient Descent Approach to Optimal Mode Scheduling in Hybrid Dynamical Systems , 2008 .

[25]  Krishnendu Chatterjee,et al.  Controller Synthesis with Budget Constraints , 2008, HSCC.

[26]  Paulo Tabuada,et al.  Controller synthesis for bisimulation equivalence , 2007, Syst. Control. Lett..

[27]  Kim G. Larsen,et al.  Automatic Synthesis of Robust and Optimal Controllers - An Industrial Case Study , 2009, HSCC.

[28]  Ashish Tiwari,et al.  Switching logic synthesis for reachability , 2010, EMSOFT '10.

[29]  S. Shankar Sastry,et al.  A numerical method for the optimal control of switched systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[30]  S. Shankar Sastry,et al.  A descent algorithm for the optimal control of constrained nonlinear switched dynamical systems , 2010, HSCC '10.

[31]  Sumit Gulwani,et al.  Synthesizing switching logic for safety and dwell-time requirements , 2010, ICCPS '10.

[32]  Ashish Tiwari,et al.  Synthesizing Switching Logic to Minimize Long-Run Cost , 2011, ArXiv.