Optimal control of discrete-time switched linear systems

Abstract This paper considers the optimal control problems of switched autonomous linear systems and switched non-autonomous linear systems in discrete-time, where the objective is that of minimizing a linear quadratic performance index function or multiple linear quadratic performance index function. The subsystems switching sequence and the number of switchings are free in this paper. By employing an embedding technique, we embed the origin switched autonomous or non-autonomous linear systems into a larger family of systems. Owing to the embedding technique, the optimal control problem of the origin switched linear systems can be relaxed into a traditional optimal control problem for the larger family systems. We thus derive the optimal switching control law and the optimal control input for the bang-bang type optimal solution of the relaxed optimal control problem simultaneously. The optimal solution of the origin switched optimal control problem can be obtained by the bang-bang type optimal solution of the relaxed optimal control problem. Finally, results of numerical simulation examples are given to demonstrate the remarkable effectiveness and superiority of the developed method.

[1]  H. Robbins A generalized legendre-clebsch condition for the singular cases of optimal control , 1967 .

[2]  Raymond A. DeCarlo,et al.  Optimal control of switching systems , 2005, Autom..

[3]  Chi Zhang,et al.  Extended adaptive optimal control of linear systems with unknown dynamics using adaptive dynamic programming , 2019, Asian Journal of Control.

[4]  Li Ma,et al.  Observer-based adaptive fuzzy tracking control of MIMO switched nonlinear systems preceded by unknown backlash-like hysteresis , 2019, Inf. Sci..

[5]  Michael Margaliot,et al.  Stability analysis of switched systems using variational principles: An introduction , 2006, Autom..

[6]  S. Ge,et al.  Switched Linear Systems: Control and Design , 2005 .

[7]  Yuanguo Zhu,et al.  A linear-quadratic control problem of uncertain discrete-time switched systems , 2016 .

[8]  Anders Rantzer,et al.  Piecewise linear quadratic optimal control , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[9]  Magnus Egerstedt,et al.  Transition-time optimization for switched-mode dynamical systems , 2006, IEEE Transactions on Automatic Control.

[10]  Jianghai Hu,et al.  Exponential stabilization of discrete-time switched linear systems , 2009, Autom..

[11]  Duan Li,et al.  Successive method for general multiple linear-quadratic control problem in discrete time , 2000, IEEE Trans. Autom. Control..

[12]  M. Chyba,et al.  Singular Trajectories and Their Role in Control Theory , 2003, IEEE Transactions on Automatic Control.

[13]  A. Krener The High Order Maximal Principle and Its Application to Singular Extremals , 1977 .

[14]  Dan Zhang,et al.  Dissipative Filtering for Switched Fuzzy Systems With Missing Measurements , 2020, IEEE Transactions on Cybernetics.

[15]  Ali Heydari,et al.  Optimal switching with minimum dwell time constraint , 2017, J. Frankl. Inst..

[16]  Ali Heydari,et al.  Optimal switching between autonomous subsystems , 2014, J. Frankl. Inst..

[17]  Shuzhi Sam Ge,et al.  Analysis and synthesis of switched linear control systems , 2005, Autom..

[18]  Alberto Bemporad,et al.  Optimal control of continuous-time switched affine systems , 2006, IEEE Transactions on Automatic Control.

[19]  Feng Zhu,et al.  Optimal control of hybrid switched systems: A brief survey , 2015, Discret. Event Dyn. Syst..

[20]  S. Ge,et al.  Stability Theory of Switched Dynamical Systems , 2011 .

[21]  Alessandro Abate,et al.  On infinite horizon switched LQR problems with state and control constraints , 2012, Syst. Control. Lett..

[22]  Sina Ober-Blöbaum,et al.  Second-Order Switching Time Optimization for Switched Dynamical Systems , 2016, IEEE Transactions on Automatic Control.

[23]  Hai Lin,et al.  Stability and Stabilizability of Switched Linear Systems: A Survey of Recent Results , 2009, IEEE Transactions on Automatic Control.

[24]  Pierre Riedinger,et al.  A Switched LQ Regulator Design in Continuous Time , 2014, IEEE Transactions on Automatic Control.

[25]  Alberto Bemporad,et al.  Synthesis of state-feedback optimal controllers for continuous-time switched linear systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[26]  A. Giua,et al.  Stabilization of switched systems via optimal control , 2014 .

[27]  Li Ma,et al.  Observer-based fuzzy adaptive stabilization of uncertain switched stochastic nonlinear systems with input quantization , 2019, J. Frankl. Inst..

[28]  Zheng-Guang Wu,et al.  How often should one update control and estimation: review of networked triggering techniques , 2020, Science China Information Sciences.

[29]  Jie Chen,et al.  Optimal Linear Quadratic Regulator of Switched Systems , 2019, IEEE Transactions on Automatic Control.

[30]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[31]  Wei Xu,et al.  Optimal switching for linear quadratic problem of switched systems in discrete time , 2017, Autom..

[32]  Huaguang Zhang,et al.  Neural-Network-Based Constrained Optimal Control Scheme for Discrete-Time Switched Nonlinear System Using Dual Heuristic Programming , 2014, IEEE Transactions on Automation Science and Engineering.

[33]  Xin Huo,et al.  Event-triggered adaptive fuzzy output feedback control of MIMO switched nonlinear systems with average dwell time , 2020, Appl. Math. Comput..

[34]  Xiao-Heng Chang,et al.  Robust Guaranteed Cost Control Under Digital Communication Channels , 2020, IEEE Transactions on Industrial Informatics.

[35]  Jingang Zhao,et al.  Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning , 2021, Journal of Industrial & Management Optimization.

[36]  Ying Shen,et al.  Dissipativity-Based Asynchronous Control for 2-D Markov Jump Systems in Continuous-Time Domain , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[37]  Chi Zhang,et al.  Data-driven optimal control of switched linear autonomous systems , 2019, Int. J. Syst. Sci..

[38]  Pierre Riedinger,et al.  An LQ sub-optimal stabilizing feedback law for switched linear systems , 2014, HSCC.

[39]  Huaguang Zhang,et al.  Infinite horizon optimal control of affine nonlinear discrete switched systems using two-stage approximate dynamic programming , 2012, Int. J. Syst. Sci..

[40]  Ranjan Mukherjee,et al.  Optimally switched linear systems , 2008, Autom..

[41]  Ali Heydari,et al.  Optimal scheduling for reference tracking or state regulation using reinforcement learning , 2015, J. Frankl. Inst..

[42]  Pierre Riedinger,et al.  Dynamic output feedback for switched linear systems based on a LQG design , 2015, Autom..

[43]  Mato Baotic,et al.  An efficient algorithm for optimal control of PWA systems with polyhedral performance indices , 2008, Autom..

[44]  Chi Zhang,et al.  Event-triggered H∞ optimal control for continuous-time nonlinear systems using neurodynamic programming , 2019, Neurocomputing.

[45]  Peng Shi,et al.  Static Output Feedback Control of Switched Nonlinear Systems With Actuator Faults , 2020, IEEE Transactions on Fuzzy Systems.

[46]  Steven Liu,et al.  Optimal Control and Scheduling of Switched Systems , 2011, IEEE Transactions on Automatic Control.

[47]  Wei Zhang,et al.  On Switching Stabilizability for Continuous-Time Switched Linear Systems , 2016, IEEE Transactions on Automatic Control.

[48]  Wei Zhang,et al.  On weak topology for optimal control of switched nonlinear systems , 2017, Autom..

[49]  Jianghai Hu,et al.  Infinite-Horizon Switched LQR Problems in Discrete Time: A Suboptimal Algorithm With Performance Analysis , 2012, IEEE Transactions on Automatic Control.

[50]  Panos J. Antsaklis,et al.  Optimal control of switched systems based on parameterization of the switching instants , 2004, IEEE Transactions on Automatic Control.

[51]  Zheng-Guang Wu,et al.  Asynchronous Stabilization of Boolean Control Networks With Stochastic Switched Signals , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[52]  Guangdeng Zong,et al.  Adaptive neural control for switched nonlinear systems with unknown backlash-like hysteresis and output dead-zone , 2019, Neurocomputing.

[53]  Jianghai Hu,et al.  On the Value Functions of the Discrete-Time Switched LQR Problem , 2009, IEEE Transactions on Automatic Control.

[54]  Wenjie Lu,et al.  A Hybrid-Adaptive Dynamic Programming Approach for the Model-Free Control of Nonlinear Switched Systems , 2016, IEEE Transactions on Automatic Control.

[55]  Duarte Antunes,et al.  Linear Quadratic Regulation of Switched Systems Using Informed Policies , 2017, IEEE Transactions on Automatic Control.

[56]  Li Ma,et al.  Fuzzy Approximation Based Asymptotic Tracking Control for a Class of Uncertain Switched Nonlinear Systems , 2020, IEEE Transactions on Fuzzy Systems.

[57]  A. Morse,et al.  Stability of switched systems: a Lie-algebraic condition ( , 1999 .