Consistent Approximations for the Optimal Control of Constrained Switched Systems - Part 1: A Conceptual Algorithm

Switched systems, or systems whose control parameters include a continuous-valued input and a discrete-valued input which corresponds to the mode of the system that is active at a particular instance in time, have shown to be highly effective in modeling a variety of physical phenomena. Unfortunately, the construction of an optimal control algorithm for such systems has proved difficult since it demands some form of optimal mode scheduling. In a pair of papers, we construct a first order optimization algorithm to address this problem. Our approach, which we prove in this paper converges to local minimizers of the constrained optimal control problem, first relaxes the discrete-valued input, performs traditional optimal control, and then projects the constructed relaxed discrete-valued input back to a pure discrete-valued input by employing an extension to the classical chattering lemma that we formalize. In the second part of this pair of papers, we describe how this conceptual algorithm can be recast in o...

[1]  Frédéric Kratz,et al.  An Optimal Control Approach for Hybrid Systems , 2003, Eur. J. Control.

[2]  Munther A. Dahleh,et al.  Suboptimal Control of Switched Systems With an Application to the DISC Engine , 2008, IEEE Transactions on Control Systems Technology.

[3]  Vinutha Kallem,et al.  Image-guided Control of Flexible Bevel-Tip Needles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Panos J. Antsaklis,et al.  Optimal control of hybrid autonomous systems with state jumps , 2003, Proceedings of the 2003 American Control Conference, 2003..

[5]  Todd D. Murphey,et al.  Second-Order Switching Time Optimization for Nonlinear Time-Varying Dynamic Systems , 2011, IEEE Transactions on Automatic Control.

[6]  Y. Wardi,et al.  Multi-process control using queuing theory , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[7]  Claire J. Tomlin,et al.  Applications of hybrid reachability analysis to robotic aerial vehicles , 2011, Int. J. Robotics Res..

[8]  Peter E. Caines,et al.  On the Hybrid Optimal Control Problem: Theory and Algorithms , 2007, IEEE Transactions on Automatic Control.

[9]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[10]  Roger W. Brockett,et al.  Stabilization of motor networks , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[11]  Christos G. Cassandras,et al.  Optimal control of a class of hybrid systems , 2001, IEEE Trans. Autom. Control..

[12]  Kenneth Holmstrom,et al.  The TOMLAB Optimization Environment in Matlab , 1999 .

[13]  Rolf Dach,et al.  Technical Report 2012 , 2013 .

[14]  Peter F. Al-Hokayem.  Stability Analysis of Networked Control Systems , 2003 .

[15]  Raymond A. DeCarlo,et al.  Optimal control of switching systems , 2005, Autom..

[16]  Magnus Egerstedt,et al.  A controlled-precision algorithm for mode-switching optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[17]  H. Sussmann.  The “Bang-Bang” Problem for Certain Control Systems in $GL(n,R)$ , 1972 .

[18]  A. Mukherjea,et al.  Real and Functional Analysis , 1978 .

[19]  Peter E. Caines,et al.  On the Optimal Control of Hybrid Systems: Optimization of Trajectories, Switching Times, Location Schedules , 2003, HSCC.

[20]  S. Shankar Sastry,et al.  Screw-based motion planning for bevel-tip flexible needles in 3D environments with obstacles , 2008, 2008 IEEE International Conference on Robotics and Automation.

[21]  A. Rantzer,et al.  Optimal control of hybrid systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[22]  Emanuel Todorov,et al.  Optimal Control Theory , 2006 .

[23]  C. A. Desoer,et al.  Nonlinear Systems Analysis , 1978 .

[24]  Anil V. Rao,et al.  Algorithm 902: GPOPS, A MATLAB software for solving multiple-phase optimal control problems using the gauss pseudospectral method , 2010, TOMS.

[25]  S. Shankar Sastry,et al.  A numerical method for the optimal control of switched systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[26]  M. Alamir,et al.  On solving optimal control problems for switched hybrid nonlinear systems by strong variations algorithms , 2003 .

[27]  Xuping Xu,et al.  Optimal control of switched autonomous systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[28]  M. Zabarankin,et al.  Convex functional analysis , 2005 .

[29]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[30]  H. Sussmann,et al.  A maximum principle for hybrid optimal control problems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[31]  S. Shankar Sastry,et al.  A descent algorithm for the optimal control of constrained nonlinear switched dynamical systems , 2010, HSCC '10.

[32]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[33]  A. Haar.  Zur Theorie der orthogonalen Funktionensysteme , 1910 .

[34]  E. Polak,et al.  A study of minimizing sequences , 1983, The 22nd IEEE Conference on Decision and Control.

[35]  Erik I. Verriest,et al.  Gradient Descent Approach to Optimal Mode Scheduling in Hybrid Dynamical Systems , 2008 .

[36]  D. Mayne,et al.  First-order strong variation algorithms for optimal control , 1975 .

[37]  Magnus Egerstedt,et al.  Transition-time optimization for switched-mode dynamical systems , 2006, IEEE Transactions on Automatic Control.

[38]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[39]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[40]  S. Shankar Sastry,et al.  Consistent Approximations for the Optimal Control of Constrained Switched Systems - Part 2: An Implementable Algorithm , 2013, SIAM J. Control. Optim..

[41]  Benedetto Piccoli,et al.  Hybrid systems and optimal control , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[42]  Y. Wardi,et al.  Algorithm for optimal mode scheduling in switched systems , 2012, 2012 American Control Conference (ACC).

[43]  Kenneth Holmström,et al.  The TOMLAB Optimization Environment , 2004 .

[44]  E. Feron,et al.  Robust hybrid control for autonomous vehicle motion planning , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[45]  A. Rantzer,et al.  Optimizing linear system switching , 2001 .

[46]  Sven Leyffer,et al.  Solving mixed integer nonlinear programs by outer approximation , 1994, Math. Program..

[47]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[48]  R. M. Bianchini,et al.  First-order differentiability of the flow of a system withLp controls , 1996 .

[49]  Gerald B. Folland,et al.  Real Analysis: Modern Techniques and Their Applications , 1984 .

[50]  Claire J. Tomlin,et al.  Hybrid System Models of Biological Cell Network Signaling and Di erentiation , 2001 .

[51]  L. Armijo.  Minimization of functions having Lipschitz continuous first partial derivatives. , 1966 .