A descent algorithm for the optimal control of constrained nonlinear switched dynamical systems

One of the oldest problems in the study of dynamical systems is the calculation of an optimal control. Though the determination of a numerical solution for the general non-convex optimal control problem for hybrid systems has been pursued relentlessly to date, it has proven difficult, since it demands nominal mode scheduling. In this paper, we calculate a numerical solution to the optimal control problem for a constrained switched nonlinear dynamical system with a running and final cost. The control parameter has a discrete component, the sequence of modes, and two continuous components, the duration of each mode and the continuous input while in each mode. To overcome the complexity posed by the discrete optimization problem, we propose a bi-level hierarchical optimization algorithm: at the higher level, the algorithm updates the mode sequence by using a single-mode variation technique, and at the lower level, the algorithm considers a fixed mode sequence and minimizes the cost functional over the continuous components. Numerical examples detail the potential of our proposed methodology.

[1]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[2]  W. Rudin Principles of mathematical analysis , 1964 .

[3]  M. L. Chambers The Mathematical Theory of Optimal Processes , 1965 .

[4]  D. Naidu,et al.  Optimal Control Systems , 2018 .

[5]  D. Mayne,et al.  First-order strong variation algorithms for optimal control , 1975 .

[6]  Gerald B. Folland,et al.  Real Analysis: Modern Techniques and Their Applications , 1984 .

[7]  Roger W. Brockett,et al.  Stabilization of motor networks , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[8]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[9]  Elijah Polak,et al.  Optimization: Algorithms and Consistent Approximations , 1997 .

[10]  A. Rantzer,et al.  Piecewise linear quadratic optimal control , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[11]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[12]  A. Rantzer,et al.  Optimal control of hybrid systems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[13]  Linda Bushnell,et al.  Stability analysis of networked control systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[14]  Alberto Bemporad,et al.  Piecewise linear optimal controllers for hybrid systems , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[15]  Richard B. Vinter,et al.  Optimal Control , 2000 .

[16]  Claire J. Tomlin,et al.  Hybrid System Models of Biological Cell Network Signaling and Di erentiation , 2001 .

[17]  A. Giua,et al.  Optimal control of switched autonomous linear systems , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[18]  A. Rantzer,et al.  Optimizing linear system switching , 2001 .

[19]  Y. Wardi,et al.  Multi-process control using queuing theory , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[20]  Xuping Xu,et al.  Optimal control of switched systems via non-linear optimization based on direct differentiations of value functions , 2002 .

[21]  Y. Wardi,et al.  Optimal control of switching times in switched dynamical systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[22]  Peter E. Caines,et al.  On the Optimal Control of Hybrid Systems: Optimization of Trajectories, Switching Times, Location Schedules , 2003, HSCC.

[23]  Panos J. Antsaklis,et al.  Results and Perspectives on Computational Methods for Optimal Control of Switched Systems , 2003, HSCC.

[24]  Scheduling of a limited communication channel for optimal control , 2004, Autom..

[25]  Alberto Bemporad,et al.  Dynamic programming for constrained optimal control of discrete-time linear hybrid systems , 2005, Autom..

[26]  Magnus Egerstedt,et al.  Transition-time optimization for switched-mode dynamical systems , 2006, IEEE Transactions on Automatic Control.

[27]  Claire J. Tomlin,et al.  Quadrotor Helicopter Flight Dynamics and Control: Theory and Experiment , 2007 .

[28]  Erik I. Verriest,et al.  Gradient Descent Approach to Optimal Mode Scheduling in Hybrid Dynamical Systems , 2008 .

[29]  Munther A. Dahleh,et al.  Suboptimal Control of Switched Systems With an Application to the DISC Engine , 2008, IEEE Transactions on Control Systems Technology.

[30]  Jianghai Hu,et al.  Stabilization of Discrete-Time Switched Linear Systems: A Control-Lyapunov Function Approach , 2009, HSCC.