Output Regulation of Linear Stochastic Systems

We address the output regulation problem for a general class of linear stochastic systems. Specifically, we formulate and solve the ideal full-information and output-feedback problems, obtaining perfect, but noncausal, asymptotic regulation. A characterisation of the problem solvability is deduced. We point out that the ideal problems cannot be solved in practice because they unrealistically require that the Brownian motion affecting the system is available for feedback. Drawing from the ideal solution, we formulate and solve approximate versions of the full-information and output-feedback problems, which do not yield perfect asymptotic tracking but can be solved in a realistic scenario. These solutions rely on two key ideas: first we introduce a discrete-time a-posteriori estimator of the variations of the Brownian motion obtained causally by sampling the system state or output; second we introduce a hybrid state observer and a hybrid regulator scheme which employ the estimated Brownian variations. The approximate solution tends to the ideal as the sampling period tends to zero. The proposed theory is validated by the regulation of a circuit subject to electromagnetic noise.

[1]  W. Wonham.  Linear Multivariable Control: A Geometric Approach , 1974 .

[2]  Frank Allgöwer,et al.  An internal model principle is necessary and sufficient for linear output synchronization , 2011, Autom..

[3]  Akira Ichikawa,et al.  Output regulation of time-varying systems , 2006, Syst. Control. Lett..

[4]  Christopher I. Byrnes,et al.  Limit sets, zero dynamics, and internal models in the problem of nonlinear output regulation , 2003, IEEE Trans. Autom. Control..

[5]  E. Davison,et al.  The robust decentralized control of a general servomechanism problem , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[6]  Giordano Scarciotti,et al.  Normal Form and Exact Feedback Linearisation of Nonlinear Stochastic Systems: the Ideal Case , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[7]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[8]  Jie Huang,et al.  Nonlinear Output Regulation: Theory and Applications , 2004 .

[9]  Frank Kozin,et al.  On Almost Sure Stability of Linear Systems with Random Coefficients , 1963 .

[10]  G. Scarciotti,et al.  Error-Feedback Output Regulation of Linear Stochastic Systems: a Hybrid Nonlinear Approach , 2019, IFAC-PapersOnLine.

[11]  Andrew R. Teel,et al.  On Moment Matching for Stochastic Systems , 2021, IEEE Transactions on Automatic Control.

[12]  Christopher I. Byrnes,et al.  Nonlinear internal models for output regulation , 2004, IEEE Transactions on Automatic Control.

[13]  Giordano Scarciotti,et al.  Output Regulation of Linear Stochastic Systems: the Full-Information Case , 2018, 2018 European Control Conference (ECC).

[14]  Fei Liu,et al.  Output regulation of a class of continuous-time Markovian jumping systems , 2013, Signal Process..

[15]  Eli Gershon,et al.  Robust Reduced-order H∞ Output-Feedback Control of Retarded Stochastic Linear Systems , 2013, IEEE Transactions on Automatic Control.

[16]  E. Davison.  The robust control of a servomechanism problem for linear time-invariant multivariable systems , 1976 .

[17]  Lorenzo Marconi,et al.  Uniform Practical Nonlinear Output Regulation , 2008, IEEE Transactions on Automatic Control.

[18]  Laura Menini,et al.  Hybrid Output Regulation for Linear Systems With Periodic Jumps: Solvability Conditions, Structural Implications and Semi-Classical Solutions , 2016, IEEE Transactions on Automatic Control.

[19]  B. Francis.  The linear multivariable regulator problem , 1976, 1976 IEEE Conference on Decision and Control including the 15th Symposium on Adaptive Processes.

[20]  A. Isidori,et al.  Output regulation of nonlinear systems , 1990 .

[21]  Giordano Scarciotti,et al.  ε-Approximate Output Regulation of Linear Stochastic Systems: a Hybrid Approach , 2019, 2019 18th European Control Conference (ECC).

[22]  H. Hua,et al.  Voltage control for uncertain stochastic nonlinear system with application to energy Internet: Non-fragile robust H ∞ approach , 2018, Journal of Mathematical Analysis and Applications.

[23]  Lorenzo Marconi,et al.  Internal Model Principle for Linear Systems With Periodic State Jumps , 2013, IEEE Transactions on Automatic Control.

[24]  Lorenzo Marconi,et al.  Semi-global nonlinear output regulation with adaptive internal model , 2001, IEEE Trans. Autom. Control..

[25]  L. Marconi,et al.  Output Stabilization via Nonlinear Luenberger Observers , 2006, SIAM J. Control. Optim..

[26]  Ian R. Petersen,et al.  Absolute Stabilization and Minimax Optimal Control of Uncertain Systems with Stochastic Uncertainty , 1997 .

[27]  D. Hinrichsen,et al.  Stochastic H∞ , 1998 .

[28]  David Engel,et al.  Output Regulation Of Uncertain Nonlinear Systems , 2016 .

[29]  N. Wouw,et al.  Uniform Output Regulation of Nonlinear Systems: A Convergent Dynamics Approach , 2005 .

[30]  A. Cemal Eringen,et al.  On Stochastic Linear Systems , 1959 .

[31]  Frank Kozin,et al.  A survey of stability of stochastic systems , 1969, Autom..

[32]  Jie Huang,et al.  On a nonlinear multivariable servomechanism problem , 1990, Autom..

[33]  Bruce A. Francis,et al.  The internal model principle of control theory , 1976, Autom..

[34]  T. Damm.  Rational Matrix Equations in Stochastic Control , 2004 .

[35]  Fei Liu,et al.  Almost Asymptotic Regulation of Markovian Jumping Linear Systems in Discrete Time , 2014 .