$\mathscr{H}_{\infty}$ state-feedback gain-scheduled control for MJLS with non-homogeneous Markov chains*

This paper deals with discrete-time Markov jump linear systems (MJLS) whose stochastic process that rules the jumps between the operation modes is non-homogeneous (time-varying transition probabilities). This class of systems is specially useful in networked control system problems where the Markov chain can be associated with time-varying parameters that can be measured or estimated, for example, packet loss variant with distance, network congestion, protocol communication, among others. With this motivation, it is proposed a design procedure for $\mathscr{H}_{\infty}$ state-feedback controllers scheduled by the time-varying probabilities, potentially providing improved performance with respect to the standard robust controllers (in-dependent of the probabilities). Synthesis conditions are given in terms of parameter-dependent linear matrix inequalities (LMIs), that can be numerically solved in terms of polynomial approximations of fixed degrees for the decision variables. As a physically motivated example, it is investigated a problem of car pursuit, where the packet loss rate of control signal varies with time, depending on the distance of the vehicle to the control unit. Additionally, the accuracy of the proposed conditions is evaluated through numerical comparisons with techniques from the literature in the case of homogeneous MJLS (time-invariant probabilities).

[1]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[2]  Alim P. C. Gonçalves,et al.  Output Feedback Control applied to Car Pursuit problem with lossy network , 2016, 2016 IEEE Biennial Congress of Argentina (ARGENCON).

[3]  Ricardo C. L. F. Oliveira,et al.  H∞ state feedback control for MJLS with uncertain probabilities , 2015, Autom..

[4]  M. Fragoso,et al.  ℋ︁∞ filtering for discrete‐time linear systems with Markovian jumping parameters† , 2003 .

[5]  H. Zimmermann,et al.  OSI Reference Model - The ISO Model of Architecture for Open Systems Interconnection , 1980, IEEE Transactions on Communications.

[6]  K. Loparo,et al.  Stability and control of discrete-time jump linear systems , 1991 .

[7]  Daniel J. Stilwell,et al.  Stability and Disturbance Attenuation for Markov Jump Linear Systems with Time-Varying Transition Probabilities , 2016, IEEE Transactions on Automatic Control.

[8]  Alim P. C. Gonçalves,et al.  The H2-control for jump linear systems: cluster observations of the Markov state , 2002, Autom..

[9]  Lixian Zhang,et al.  Mode-dependent Hinfinity filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities , 2009, Autom..

[10]  Ricardo C. L. F. Oliveira,et al.  Discretisation and control of polytopic systems with uncertain sampling rates and network-induced delays , 2014, Int. J. Control.

[11]  D. Cooke,et al.  Finite Markov Processes and Their Applications , 1981 .

[12]  C.E. de Souza,et al.  Robust stability and stabilization of uncertain discrete-time Markovian jump linear systems , 2006, IEEE Transactions on Automatic Control.

[13]  Biswanath Mukherjee,et al.  Wireless sensor network survey , 2008, Comput. Networks.

[14]  Ricardo C. L. F. Oliveira,et al.  Reduced-order dynamic output feedback control of uncertain discrete-time Markov jump linear systems , 2017, Int. J. Control.

[15]  Marcelo D. Fragoso,et al.  A Detector-Based Approach for the $H_{2} $ Control of Markov Jump Linear Systems With Partial Information , 2015, IEEE Transactions on Automatic Control.

[16]  W. L. Koning,et al.  Discrete-time Markovian jump linear systems , 1993 .

[17]  Samir Aberkane,et al.  Stochastic stabilization of a class of nonhomogeneous Markovian jump linear systems , 2011, Syst. Control. Lett..

[18]  Ricardo C. L. F. Oliveira,et al.  Parameter-Dependent LMIs in Robust Analysis: Characterization of Homogeneous Polynomially Parameter-Dependent Solutions Via LMI Relaxations , 2007, IEEE Transactions on Automatic Control.

[19]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[20]  Matheus F. Amorim,et al.  Optimal H2 Output-Feedback Control of Sampled Systems , 2016 .

[21]  E. Boukas,et al.  H∞ control for discrete‐time Markovian jump linear systems with partly unknown transition probabilities , 2009 .

[22]  Raja Sengupta,et al.  An H/sub /spl infin// approach to networked control , 2005, IEEE Transactions on Automatic Control.

[23]  Ricardo C. L. F. Oliveira,et al.  Robust LMIs with parameters in multi-simplex: Existence of solutions and applications , 2008, 2008 47th IEEE Conference on Decision and Control.

[24]  Alim P. C. Gonçalves,et al.  H∞ robust and networked control of discrete-time MJLS through LMIs , 2012, J. Frankl. Inst..

[25]  V. Dragan,et al.  Mathematical Methods in Robust Control of Linear Stochastic Systems , 2006 .

[26]  M. Fragoso,et al.  Stability Results for Discrete-Time Linear Systems with Markovian Jumping Parameters , 1993 .

[27]  Márcio F. Braga,et al.  Brief Paper - H 2 control of discrete-time Markov jump linear systems with uncertain transition probability matrix: improved linear matrix inequality relaxations and multi-simplex modelling , 2013 .

[28]  Ricardo C. L. F. Oliveira,et al.  Robust stability, ℋ2 analysis and stabilisation of discrete-time Markov jump linear systems with uncertain probability matrix , 2009, Int. J. Control.

[29]  Alim P. C. Gonçalves,et al.  Dynamic Output Feedback Control of Discrete-Time Markov Jump Linear Systems through Linear Matrix Inequalities , 2009, SIAM J. Control. Optim..

[30]  E. Boukas,et al.  Mode-dependent Hºº filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities. , 2007 .

[31]  Ricardo C. L. F. Oliveira,et al.  ℋ∞ static output feedback control of discrete-time Markov jump linear systems with uncertain transition probability matrix , 2014, 2014 American Control Conference.

[32]  Alim P. C. Gonçalves,et al.  Optimal H2 and H∞ Mode-Independent Control for Generalized Bernoulli Jump Systems , 2014 .

[33]  João Pedro Hespanha,et al.  A Survey of Recent Results in Networked Control Systems , 2007, Proceedings of the IEEE.

[34]  E. Boukas,et al.  ℋ︁∞ control of discrete‐time Markov jump systems with bounded transition probabilities , 2009 .