Stability analysis of RBF network-based state-dependent autoregressive model for nonlinear time series

Varying-coefficient models have attracted great attention in nonlinear time series analysis recently. In this paper, we consider a semi-parametric functional-coefficient autoregressive model, called the radial basis function network-based state-dependent autoregressive (RBF-AR) model. The stability conditions and existing conditions of limit cycle of the RBF-AR model are discussed. An efficient structured parameter estimation method and the modified multi-fold cross-validation criterion are applied to identify the RBF-AR model. Application of the RBF-AR model to the famous Canadian lynx data is presented. The forecasting capability of the RBF-AR model is compared to those of other competing time series models, which shows that the RBF-AR model is as good as or better than other models for the postsample forecasts.

[1]  Nathan Mendes,et al.  Identification of temperature and moisture content fields using a combined neural network and clustering method approach , 2009 .

[2]  T. Ozaki,et al.  Non-linear time series models for non-linear random vibrations , 1980, Journal of Applied Probability.

[3]  P. McNelis.  Neural networks in finance : gaining predictive edge in the market , 2005 .

[4]  Kazushi Nakano,et al.  RBF-ARX model based nonlinear system modeling and predictive control with application to a NOx decomposition process , 2004 .

[5]  G. Kitagawa,et al.  Information Criteria and Statistical Modeling , 2007 .

[6]  D. Tjøstheim.  Non-linear time series and Markov chains , 1990, Advances in Applied Probability.

[7]  Min Gan,et al.  A hybrid approach for parameter optimization of RBF-AR model , 2010, 49th IEEE Conference on Decision and Control (CDC).

[8]  Leandro dos Santos Coelho,et al.  Multi-step ahead nonlinear identification of Lorenz’s chaotic system using radial basis neural network with learning by clustering and particle swarm optimization , 2008 .

[9]  Chia-Nan Ko,et al.  Time series prediction using RBF neural networks with a nonlinear time-varying evolution PSO algorithm , 2009, Neurocomputing.

[10]  David R. Brillinger,et al.  Time series analysis and applications to geophysical systems , 1992 .

[11]  Yan Yu,et al.  Penalized spline estimation for functional coefficient regression models , 2010, Comput. Stat. Data Anal..

[12]  Çagdas Hakan Aladag,et al.  Forecasting nonlinear time series with a hybrid methodology , 2009, Appl. Math. Lett..

[13]  Hui Peng,et al.  The Innovation Approach to the Identification of Nonlinear Causal Models in Time Series Analysis , 2004 .

[14]  R. Tweedie.  Criteria for classifying general Markov chains , 1976, Advances in Applied Probability.

[15]  Riquan Zhang.  Proportional functional coefficient time series models , 2009 .

[16]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[17]  C. Granger,et al.  An introduction to bilinear time series models , 1979 .

[18]  Hannu T. Toivonen,et al.  State-dependent parameter modelling and identification of stochastic non-linear sampled-data systems , 2006 .

[19]  Haipeng Shen,et al.  Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach , 2004 .

[20]  Jean-Marc Vesin,et al.  An amplitude-dependent autoregressive model based on a radial basis functions expansion , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[21]  Zhaoyun Shi,et al.  Nonlinear time series modelling with the radial basis function-based state-dependent autoregressive model , 1999, Int. J. Syst. Sci..

[22]  Jane L. Harvill,et al.  Functional coefficient autoregressive models for vector time series , 2006, Comput. Stat. Data Anal..

[23]  Ashu Jain,et al.  Hybrid neural network models for hydrologic time series forecasting , 2007, Appl. Soft Comput..

[24]  Pedro Paulo Balestrassi,et al.  Design of experiments on neural network's training for nonlinear time series forecasting , 2009, Neurocomputing.

[25]  T. Ozaki,et al.  Modelling nonlinear random vibrations using an amplitude-dependent autoregressive time series model , 1981 .

[26]  Yukihiro Toyoda,et al.  An Akaike State-Space Controller for RBF-ARX Models , 2009, IEEE Transactions on Control Systems Technology.

[27]  Kazushi Nakano,et al.  Nonlinear Predictive Control Using Neural Nets-Based Local Linearization ARX Model—Stability and Industrial Application , 2007, IEEE Transactions on Control Systems Technology.

[28]  Kazushi Nakano,et al.  Nonlinear system modeling and robust predictive control based on RBF-ARX model , 2007, Eng. Appl. Artif. Intell..

[29]  Jianqing Fan,et al.  Functional-Coefficient Regression Models for Nonlinear Time Series , 2000 .

[30]  Rong Chen.  Functional coefficient autoregressive models: Estimation and tests of hypotheses , 2001 .

[31]  Norman R. Swanson,et al.  A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks , 1995 .

[32]  Keith W. Hipel,et al.  Forecasting nonlinear time series with feed-forward neural networks: a case study of Canadian lynx data , 2005 .

[33]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[34]  Min Gan,et al.  A locally linear RBF network-based state-dependent AR model for nonlinear time series modeling , 2010, Inf. Sci..

[35]  H. Tong,et al.  On the use of the deterministic Lyapunov function for the ergodicity of stochastic difference equations , 1985, Advances in Applied Probability.

[36]  Qi Li,et al.  Functional-coefficient models for nonstationary time series data , 2009 .

[37]  Chien-Cheng Lee,et al.  Noisy time series prediction using M-estimator based robust radial basis function neural networks with growing and pruning techniques , 2009, Expert Syst. Appl..

[38]  Jun Wu,et al.  Nonlinear system modeling and predictive control using the RBF nets-based quasi-linear ARX model☆ , 2009 .

[39]  Hung Man Tong,et al.  Threshold models in non-linear time series analysis. Lecture notes in statistics, No.21 , 1983 .

[40]  M. Priestley.  STATE‐DEPENDENT MODELS: A GENERAL APPROACH TO NON‐LINEAR TIME SERIES ANALYSIS , 1980 .

[41]  Yukihiro Toyoda,et al.  A parameter optimization method for radial basis function type models , 2003, IEEE Trans. Neural Networks.

[42]  Ruey S. Tsay,et al.  Functional-Coefficient Autoregressive Models , 1993 .