Application of fast orthogonal search to linear and nonlinear stochastic systems

Standard deterministic autoregressive moving average (ARMA) models consider prediction errors to be unexplain able noise sources. The accuracy of the estimated ARMA model parameters depends on producing minimum prediction errors. In this study, an accurate algorithm is developed for estimating linear and nonlinear stochastic ARMA model parameters by using a method known as fast orthogonal search, with an extended model containing prediction errors as part of the model estimation process. The extended algorithm uses fast orthogonal search in a two-step procedure in which deterministic terms in the non-linear difference equation model are first identified and then reestimated, this time in a model containing the prediction errors. Since the extended algorithm uses an orthogonal procedure, together with automatic model order selection criteria, the significant model terms are estimated efficiently and accurately. The model order selection criteria developed for the extended algorithm are also crucial in obtaining accurate parameter estimates. Several simulated examples are presented to demonstrate the efficacy of the algorithm.

[1]  I. J. Leontaritis,et al.  Parameter Estimation Techniques for Nonlinear Systems , 1982 .

[2]  S. Billings,et al.  Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks , 1996 .

[3]  M. Korenberg.  Identifying nonlinear difference equation and functional expansion representations: The fast orthogonal algorithm , 2006, Annals of Biomedical Engineering.

[4]  D.G. Dudley,et al.  Dynamic system identification experiment design and data analysis , 1979, Proceedings of the IEEE.

[5]  V. Marmarelis,et al.  On the efficacy of linear system analysis of renal autoregulation in rats , 1993, IEEE Transactions on Biomedical Engineering.

[6]  V.Z. Marmarelis,et al.  Modeling of neural systems by use of neuronal modes , 1993, IEEE Transactions on Biomedical Engineering.

[7]  Vasilis Z. Marmarelis,et al.  Detection of interactions between myogenic and TGF mechanisms using nonlinear analysis , 1994 .

[8]  K. Yana,et al.  A time domain approach for the fluctuation analysis of heart rate related to instantaneous lung volume , 1993, IEEE Transactions on Biomedical Engineering.

[9]  S. Billings,et al.  Orthogonal parameter estimation algorithm for non-linear stochastic systems , 1988 .

[10]  M. Korenberg.  Fast Orthogonal Algorithms for Nonlinear System Identification and Time-Series Analysis , 1989 .

[11]  S. Billings,et al.  A prediction-error and stepwise-regression estimation algorithm for non-linear systems , 1986 .

[12]  Alan A. Desrochers.  On an improved model reduction technique for nonlinear systems , 1981, Autom..

[13]  Y. W. Lee,et al.  Measurement of the Wiener Kernels of a Non-linear System by Cross-correlation† , 1965 .

[14]  M. H. Perrott,et al.  An efficient approach to ARMA modeling of biological systems with multiple inputs and delays , 1996, IEEE Transactions on Biomedical Engineering.

[15]  D J Marsh,et al.  Detection of interactions between myogenic and TGF mechanisms using nonlinear analysis. , 1994, The American journal of physiology.

[16]  H. Akaike.  Power spectrum estimation through autoregressive model fitting , 1969 .

[17]  Ki H. Chon,et al.  Parametric and Nonparametric Nonlinear Modeling of Renal Autoregulation Dynamics , 1994 .