ARX Model Identification using Generalized Spectral Decomposition

This article is concerned with the identification of autoregressive with exogenous inputs (ARX) models. Most of the existing approaches like prediction error minimization and state-space framework are widely accepted and utilized for the estimation of ARX models but are known to deliver unbiased and consistent parameter estimates for a correctly supplied guess of input-output orders and delay. In this paper, we propose a novel automated framework which recovers orders, delay, output noise distribution along with parameter estimates. The primary tool utilized in the proposed framework is generalized spectral decomposition. The proposed algorithm systematically estimates all the parameters in two steps. The first step utilizes estimates of the order by examining the generalized eigenvalues, and the second step estimates the parameter from the generalized eigenvectors. Simulation studies are presented to demonstrate the efficacy of the proposed method and are observed to deliver consistent estimates even at low signal to noise ratio (SNR).

[1]  Arun K. Tangirala,et al.  Principles of System Identification , 2014 .

[2]  P. Rapisarda On the Identification of Self-Adjoint Linear Time-Varying State Models , 2018 .

[3]  I. Jolliffe Principal Component Analysis , 2005 .

[4]  Mike Brookes,et al.  Frequency-domain under-modelled blind system identification based on cross power spectrum and sparsity regularization , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  S. Beheshti,et al.  A new information-theoretic approach to signal denoising and best basis selection , 2005, IEEE Transactions on Signal Processing.

[6]  G. Stewart,et al.  An Algorithm for Generalized Matrix Eigenvalue Problems. , 1973 .

[7]  S.J. Elliott,et al.  Active noise control , 1993, IEEE Signal Processing Magazine.

[8]  Identification of Errors-in-Variables Models Using Dynamic Iterative Principal Component Analysis , 2018, Industrial & Engineering Chemistry Research.

[9]  Bart De Moor,et al.  Globally Optimal Least-Squares ARMA Model Identification is an Eigenvalue Problem , 2019, IEEE Control Systems Letters.

[10]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[11]  Mike Brookes,et al.  Room geometry estimation from a single channel acoustic impulse response , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[12]  S. Narasimhan,et al.  Identification of Linear Dynamic Systems using Dynamic Iterative Principal Component Analysis , 2016 .

[13]  Calyampudi R. Rao The use and interpretation of principal component analysis in applied research , 1964 .

[14]  Mati Wax Order selection for AR models by predictive least-squares , 1986, 1986 25th IEEE Conference on Decision and Control.

[15]  H. Fujisaki,et al.  System identification of the speech production process based on a state-space representation , 1984 .

[16]  Bart De Moor,et al.  Least squares realization of LTI models is an eigenvalue problem , 2019, ECC.

[18]  Satheesh K. Perepu,et al.  Identification of Equation Error Models from Small Samples using Compressed Sensing Techniques , 2015 .

[19]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[20]  Ahmed A. Alani Principal component analysis in statistics , 2014 .

[21]  Sirish L. Shah,et al.  Model Identification and Error Covariance Matrix Estimation from Noisy Data Using PCA , 2004 .

[22]  H. Markov,et al.  An algorithm to , 1997 .

[23]  Marc Moonen,et al.  Robust Adaptive Time Delay Estimation for Speaker Localization in Noisy and Reverberant Acoustic Environments , 2003, EURASIP J. Adv. Signal Process..

[24]  Mrdjan J. Jankovic,et al.  Constructive Nonlinear Control , 2011 .

[25]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[26]  Tryphon T. Georgiou,et al.  Identification of linear systems: A graph point of view , 1992, 1992 American Control Conference.

[27]  Paolo Rapisarda,et al.  A geometric approach to fault identification in linear repetitive processes , 2014 .

[28]  Chenyi Zhang,et al.  An Algorithm for , 2011 .

[29]  竹安 数博,et al.  Time series analysis and its applications , 2007 .

[30]  Yoshito Ohta,et al.  Positive FIR System Identification using Maximum Entropy Prior , 2018 .

[31]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[32]  T. Kailath,et al.  A least-squares approach to blind channel identification , 1995, IEEE Trans. Signal Process..