The linear quadratic regulator for periodic hybrid systems

The main objective of this paper is to characterize feedback control laws that are optimal with respect to a quadratic cost functional in the framework of linear hybrid systems undergoing time-driven periodic jumps, namely the so-called hybrid Linear–Quadratic Regulator (LQR) problem. The optimal solution to the hybrid LQR problem is determined both in the case of finite-horizon and infinite-horizon optimal control problems by introducing a hybrid (periodic) extension of the classic Differential and Difference Riccati Equations, thus leading to the notion of Monodromy Riccati Equation. Interestingly, due to the periodic nature of the discrete-time events, the computation of the optimal feedback hinges upon the solution of a differential, rather than algebraic, Riccati equation also in the infinite-horizon case, hence yielding a time-varying, periodic control law. Necessary and sufficient conditions that ensure asymptotic stability of the closed-loop system are provided and discussed in detail in the case of infinite-horizon optimal control problems.

[1]  Hai Lin,et al.  Switched Linear Systems: Control and Design , 2006, IEEE Transactions on Automatic Control.

[2]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[3]  Martin Bohner.  CALCULUS OF VARIATIONS ON TIME SCALES , 2004 .

[4]  Laura Menini,et al.  Robust Trajectory Tracking for a Class of Hybrid Systems: An Internal Model Principle Approach , 2012, IEEE Transactions on Automatic Control.

[5]  Ruth F. Curtain,et al.  Linear-quadratic control: An introduction , 1997, Autom..

[6]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[7]  Douglas A. Lawrence.  On output feedback stabilization for linear impulsive systems , 2012, 2012 American Control Conference (ACC).

[8]  D. Cobb,et al.  Descriptor variable systems and optimal state regulation , 1983 .

[9]  Enrique A. Medina,et al.  State feedback stabilization of linear impulsive systems , 2009, Autom..

[10]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[11]  Laura Menini,et al.  Hybrid Output Regulation for Linear Systems With Periodic Jumps: Solvability Conditions, Structural Implications and Semi-Classical Solutions , 2016, IEEE Transactions on Automatic Control.

[12]  Madhu N. Belur,et al.  Singular LQ Control, Optimal PD Controller and Inadmissible Initial Conditions , 2013, IEEE Transactions on Automatic Control.

[13]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[14]  W. P. M. H. Heemels,et al.  $\mathcal{L}_{2}$-Gain Analysis for a Class of Hybrid Systems With Applications to Reset and Event-Triggered Control: A Lifting Approach , 2016, IEEE Transactions on Automatic Control.

[15]  Bruce A. Francis,et al.  Optimal Sampled-Data Control Systems , 1996, Communications and Control Engineering Series.

[16]  Lorenzo Marconi,et al.  Hybrid output regulation for minimum phase linear systems , 2011, Proceedings of the 2011 American Control Conference.

[17]  Laura Menini,et al.  Velocity observers for non-linear mechanical systems subject to non-smooth impacts , 2002, Autom..

[18]  L. Menini,et al.  Asymptotic tracking of periodic trajectories for a simple mechanical system subject to non-smooth impacts , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[19]  R. Sanfelice,et al.  Hybrid dynamical systems , 2009, IEEE Control Systems.

[20]  S. Kahne,et al.  Optimal control: An introduction to the theory and ITs applications , 1967, IEEE Transactions on Automatic Control.

[21]  T. K. Nguyen.  Numerical solution of discrete-time algebraic Riccati equation , 1999 .

[22]  Laura Menini,et al.  Output regulation for a class of linear hybrid systems. Part 2: stabilization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[23]  Laura Menini,et al.  Output regulation for a class of linear hybrid systems. Part 1: trajectory generation , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[24]  Mario Sassano,et al.  Necessary and sufficient conditions for output regulation in a class of hybrid linear systems , 2013, 52nd IEEE Conference on Decision and Control.

[25]  B. Francis,et al.  A lifting technique for linear periodic systems with applications to sampled-data control , 1991 .

[26]  Vera Zeidan,et al.  Calculus of variations on time scales: weak local piecewise Crd1 solutions with variable endpoints , 2004 .

[27]  C. Turcu,et al.  Hybrid Systems by Methods of Time Scales Analysis , 2013 .

[28]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[29]  Daniel Liberzon,et al.  Calculus of Variations and Optimal Control Theory: A Concise Introduction , 2012 .

[30]  Lorenzo Ntogramatzidis,et al.  The generalized continuous algebraic Riccati equation and impulse-free continuous-time LQ optimal control , 2014, Autom..

[31]  Lorenzo Ntogramatzidis,et al.  A parametrization of the solutions of the finite-horizon LQ problem with general cost and boundary conditions , 2005, Autom..

[32]  Corrado Possieri,et al.  $\mathcal{L}_2$-Gain for Hybrid Linear Systems With Periodic Jumps: A Game Theoretic Approach for Analysis and Design , 2018, IEEE Transactions on Automatic Control.

[33]  Peter E. Caines,et al.  On the Hybrid Optimal Control Problem: Theory and Algorithms , 2007, IEEE Transactions on Automatic Control.

[34]  A. Saberi,et al.  Cheap and singular controls for linear quadratic regulators , 1985, 1985 24th IEEE Conference on Decision and Control.

[35]  Alan J. Laub,et al.  The linear-quadratic optimal regulator for descriptor systems , 1985, 1985 24th IEEE Conference on Decision and Control.

[36]  Vera Zeidan,et al.  Hamilton-Jacobi theory over time scales and applications to linear-quadratic problems , 2012 .

[37]  H. Sussmann,et al.  A maximum principle for hybrid optimal control problems , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[38]  Laura Menini,et al.  Robust semiclassical internal model based regulation for a class of hybrid linear systems , 2014 .

[39]  Christos G. Cassandras,et al.  Optimal control of a class of hybrid systems , 2001, IEEE Trans. Autom. Control..

[40]  Laura Menini,et al.  A case study for hybrid regulation: Output tracking for a spinning and bouncing disk , 2013, 21st Mediterranean Conference on Control and Automation.

[41]  Lorenzo Marconi,et al.  Hybrid output regulation with unmeasured clock , 2011, IEEE Conference on Decision and Control and European Control Conference.

[42]  Lorenzo Ntogramatzidis,et al.  Continuous-time singular linear-quadratic control: Necessary and sufficient conditions for the existence of regular solutions , 2016, Syst. Control. Lett..

[43]  L. Silverman,et al.  System structure and singular control , 1983 .

[44]  Mauro Garavello,et al.  Hybrid optimal control: Case study of a car with gears , 2003 .

[45]  Laura Menini,et al.  Robust Hybrid Output Regulation for Linear Systems With Periodic Jumps: Semiclassical Internal Model Design , 2017, IEEE Transactions on Automatic Control.

[46]  Corrado Possieri,et al.  LQ optimal control for a class of hybrid systems , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[47]  Corrado Possieri,et al.  Structural Properties of a Class of Linear Hybrid Systems and Output Feedback Stabilization , 2017, IEEE Transactions on Automatic Control.

[48]  J. Willems,et al.  Singular optimal control: A geometric approach , 1986 .

[49]  Laura Menini,et al.  Output Regulation of Hybrid Linear Systems with Unpredictable Jumps , 2014 .

[50]  Mario Sassano,et al.  A linear quadratic approach to linear time invariant stabilization for a class of hybrid systems , 2014, 22nd Mediterranean Conference on Control and Automation.

[51]  Lorenzo Ntogramatzidis,et al.  The Extended Symplectic Pencil and the Finite-Horizon LQ Problem With Two-Sided Boundary Conditions , 2012, IEEE Transactions on Automatic Control.

[52]  Chengzhi Yuan,et al.  Hybrid Control for Switched Linear Systems With Average Dwell Time , 2015, IEEE Transactions on Automatic Control.

[53]  Panos J. Antsaklis,et al.  Optimal control of switched systems based on parameterization of the switching instants , 2004, IEEE Transactions on Automatic Control.