Robust identification of linear ARX models with recursive EM algorithm based on Student's t-distribution

Abstract This paper considers the robust identification issue of linear systems represented by autoregressive exogenous models using the recursive expectation-maximization (EM) algorithm. In this paper, a recursive Q-function is formulated based on the maximum likelihood principle. Meanwhile, the outliers that frequently appear in practical processes are accommodated with the Student’s t-distribution. The parameter vector, variance of noise, and the degree of freedom are recursively estimated. Finally, a numerical example, as well as a simulated continuous stirred tank reactor (CSTR) system, is performed to verify the effectiveness of the proposed recursive EM algorithm.

[1]  Yaojie Lu,et al.  Robust multiple-model LPV approach to nonlinear process identification using mixture t distributions , 2014 .

[2]  Fredrik Lindsten,et al.  Recursive Maximum Likelihood Identification of Jump Markov Nonlinear Systems , 2013, IEEE Transactions on Signal Processing.

[3]  Shen Yin,et al.  Robust Global Identification and Output Estimation for LPV Dual-Rate Systems Subjected to Random Output Time-Delays , 2017, IEEE Transactions on Industrial Informatics.

[4]  D. Rubin,et al.  ML ESTIMATION OF THE t DISTRIBUTION USING EM AND ITS EXTENSIONS, ECM AND ECME , 1999 .

[5]  O. Cappé,et al.  On‐line expectation–maximization algorithm for latent data models , 2009 .

[6]  Yaojie Lu,et al.  A Variational Bayesian Approach to Robust Identification of Switched ARX Models , 2016, IEEE Transactions on Cybernetics.

[7]  Keiichi Tokuda,et al.  Robust recursive time series modeling based on an AR model excited by a t-distribution process , 1998, IEEE Trans. Signal Process..

[8]  Sotirios Chatzis,et al.  A variational Bayesian methodology for hidden Markov models utilizing Student's-t mixtures , 2011, Pattern Recognit..

[9]  Thomas B. Schön,et al.  System identification of nonlinear state-space models , 2011, Autom..

[10]  Biao Huang,et al.  Multiple model LPV approach to nonlinear process identification with EM algorithm , 2011 .

[11]  Kiyotsugu Takaba,et al.  Identification of piecewise affine systems based on statistical clustering technique , 2004, Autom..

[12]  Yonggang Zhang,et al.  Robust student’s t based nonlinear filter and smoother , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Olivier Capp'e.  Online EM Algorithm for Hidden Markov Models , 2009, 0908.2359.

[14]  Christopher M. Bishop,et al.  Robust Bayesian Mixture Modelling , 2005, ESANN.

[15]  Christophe Andrieu,et al.  Online expectation-maximization type algorithms for parameter estimation in general state space models , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[16]  Alireza Fatehi,et al.  A Data-Driven Hybrid ARX and Markov Chain Modeling Approach to Process Identification With Time-Varying Time Delays , 2017, IEEE Transactions on Industrial Electronics.

[17]  Biao Huang,et al.  Robust identification of piecewise/switching autoregressive exogenous process , 2009 .

[18]  Biao Huang,et al.  Robust Identification of Switching Markov ARX Models Using EM Algorithm , 2017 .

[19]  D. Titterington.  Recursive Parameter Estimation Using Incomplete Data , 1984 .

[20]  Xianqiang Yang,et al.  Robust global identification of linear parameter varying systems with generalised expectation–maximisation algorithm , 2015 .

[21]  Zhiqiang Ge,et al.  Robust modeling of mixture probabilistic principal component analysis and process monitoring application , 2014 .

[22]  Yongsheng Ding,et al.  An Augmented Model Approach for Identification of Nonlinear Errors-in-Variables Systems Using the EM Algorithm , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Aristidis Likas,et al.  The mixtures of Student's t-distributions as a robust framework for rigid registration , 2009, Image Vis. Comput..

[24]  John B. Moore,et al.  On-line estimation of hidden Markov model parameters based on the Kullback-Leibler information measure , 1993, IEEE Trans. Signal Process..

[25]  Neil D. Lawrence,et al.  Variational inference for Student-t models: Robust Bayesian interpolation and generalised component analysis , 2005, Neurocomputing.

[26]  Xianqiang Yang,et al.  EM algorithm-based identification of a class of nonlinear Wiener systems with missing output data , 2015 .

[27]  Gang George Yin,et al.  Recursive algorithms for estimation of hidden Markov models and autoregressive models with Markov regime , 2002, IEEE Trans. Inf. Theory.

[28]  Biao Huang,et al.  A Bayesian approach to robust process identification with ARX models , 2013 .

[29]  Gianluigi Mongillo,et al.  Online Learning with Hidden Markov Models , 2008, Neural Computation.

[30]  Shaojun Wang,et al.  Almost sure convergence of Titterington's recursive estimator for mixture models , 2002, Proceedings IEEE International Symposium on Information Theory,.

[31]  Myong Kee Jeong,et al.  Robust Probabilistic Multivariate Calibration Model , 2008, Technometrics.