An Augmented Model Approach for Identification of Nonlinear Errors-in-Variables Systems Using the EM Algorithm

This paper proposes an augmented model approach for identification of nonlinear errors-in-variables (EIVs) systems. An EIV model accounts for uncertainties in the observations of both inputs and outputs. As the direct identification of nonlinear functions is difficult, we propose to approximate the nonlinear EIV model using multiple ARX models. To estimate the noise-free input signal, we use a collection of particle filters which run in parallel corresponding to each of the multiple ARX models. The parameters of local models are estimated by applying expectation maximization algorithm, under a maximum likelihood framework, using the input-output data of the nonlinear EIV system. Simulated numerical examples and an experiment study on a multitank system are used to illustrate the efficacy of the proposed approach.

[1]  Bassam Bamieh,et al.  Identification of linear parameter varying models , 2002 .

[2]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[3]  F. Ding,et al.  Performance analysis of the generalised projection identification for time-varying systems , 2016 .

[4]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[5]  F. Ding,et al.  Filtering-based iterative identification for multivariable systems , 2016 .

[6]  Yaojie Lu,et al.  Generalized expectation–maximization approach to LPV process identification with randomly missing output data , 2015 .

[7]  Feng Ding,et al.  Decomposition based least squares iterative identification algorithm for multivariate pseudo-linear ARMA systems using the data filtering , 2017, J. Frankl. Inst..

[8]  J. R. Carroll,et al.  Design elements of the modern spinning control system , 1994, Proceedings of 1994 IEEE/IAS Annual Textile, Fiber and Film Industry Technical Conference.

[9]  Yucai Zhu,et al.  Nonlinear MPC using an identified LPV model , 2009 .

[10]  Wei Xing Zheng,et al.  A bias correction method for identification of linear dynamic errors-in-variables models , 2002, IEEE Trans. Autom. Control..

[11]  Alireza Fatehi,et al.  A Data-Driven Hybrid ARX and Markov Chain Modeling Approach to Process Identification With Time-Varying Time Delays , 2017, IEEE Transactions on Industrial Electronics.

[12]  T. Söderström.  ERRORS-IN-VARIABLES METHODS IN SYSTEM IDENTIFICATION , 2006 .

[13]  Yongsheng Ding,et al.  Bidirectional Optimization of the Melting Spinning Process , 2014, IEEE Transactions on Cybernetics.

[14]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[15]  Chunling Du,et al.  Multirate Identification of Mechanical Resonances Beyond the Nyquist Frequency in High-Performance Mechatronic Systems , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Ahmad Fauzi Ismail,et al.  The effect of processing conditions on a polyacrylonitrile fiber produced using a solvent-free free coagulation process , 2008 .

[17]  Biao Huang,et al.  Multiple model approach to nonlinear system identification with an uncertain scheduling variable using EM algorithm , 2013 .

[18]  Feng Ding,et al.  Recursive Least Squares and Multi-innovation Stochastic Gradient Parameter Estimation Methods for Signal Modeling , 2017, Circuits Syst. Signal Process..

[19]  R. Bhushan Gopaluni,et al.  Nonlinear system identification under missing observations: The case of unknown model structure , 2010 .

[20]  Torsten Söderström.  System identification for the errors-in-variables problem , 2010 .

[21]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[22]  Biao Huang,et al.  Multiple model LPV approach to nonlinear process identification with EM algorithm , 2011 .

[23]  Yongsheng Ding,et al.  A Bioinspired Multilayered Intelligent Cooperative Controller for Stretching Process of Fiber Production , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Shen Yin,et al.  Variational Bayesian Inference for FIR Models With Randomly Missing Measurements , 2017, IEEE Transactions on Industrial Electronics.

[25]  Y. Arkun,et al.  Estimation of nonlinear systems using linear multiple models , 1997 .

[26]  Na Liu,et al.  Fashion Sales Forecasting With a Panel Data-Based Particle-Filter Model , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  Feng Ding,et al.  Novel data filtering based parameter identification for multiple-input multiple-output systems using the auxiliary model , 2016, Autom..

[28]  Pushkin Kachroo,et al.  Modeling and Estimation of the Vehicle-Miles Traveled Tax Rate Using Stochastic Differential Equations , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[29]  C. L. Philip Chen,et al.  Adaptive Sensor Fault Detection and Identification Using Particle Filter Algorithms , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[30]  David S. Stoffer,et al.  Time series analysis and its applications , 2000 .

[31]  Alex Simpkins,et al.  System Identification: Theory for the User, 2nd Edition (Ljung, L.; 1999) [On the Shelf] , 2012, IEEE Robotics & Automation Magazine.

[32]  Arun K. Tangirala,et al.  Principles of System Identification , 2014 .

[33]  John Yen,et al.  Radial basis function networks, regression weights, and the expectation-maximization algorithm , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[34]  Derong Liu,et al.  Data-Based Adaptive Critic Designs for Nonlinear Robust Optimal Control With Uncertain Dynamics , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Isabelle Bloch,et al.  Integration of Fuzzy Spatial Information in Tracking Based on Particle Filtering , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  George K Stylios,et al.  Novel mechanism for spinning continuous twisted composite nanofiber yarns , 2008 .

[37]  Jonathan William Gillard.  An overview of linear structural models , 2010 .

[38]  T. Hayat,et al.  Parameter estimation for pseudo-linear systems using the auxiliary model and the decomposition technique , 2017 .

[39]  Biao Huang,et al.  Identification of nonlinear parameter varying systems with missing output data , 2012 .