Gradient Radial Basis Function Based Varying-Coefficient Autoregressive Model for Nonlinear and Nonstationary Time Series

We propose a gradient radial basis function based varying-coefficient autoregressive (GRBF-AR) model for modeling and predicting time series that exhibit nonlinearity and homogeneous nonstationarity. This GRBF-AR model is a synthesis of the gradient RBF and the functional-coefficient autoregressive (FAR) model. The gradient RBFs, which react to the gradient of the series, are used to construct varying coefficients of the FAR model. The Mackey-Glass chaotic time series are used to evaluate the performance of the proposed method. It is shown that the GRBF-AR model not only achieves much more parsimonious structure but also much better prediction performance than that of GRBF network.

[1]  Gene H. Golub,et al.  The differentiation of pseudo-inverses and non-linear least squares problems whose variables separate , 1972, Milestones in Matrix Computation.

[2]  P. Young,et al.  Stochastic, Dynamic Modelling and Signal Processing: Time Variable and State Dependent Parameter Estimation , 2000 .

[3]  Daniel Molina,et al.  Time Series Modeling and Forecasting Using Memetic Algorithms for Regime-Switching Models , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Min Gan,et al.  Stability analysis of RBF network-based state-dependent autoregressive model for nonlinear time series , 2012, Appl. Soft Comput..

[5]  Marcelo C. Medeiros,et al.  A flexible coefficient smooth transition time series model , 2005, IEEE Transactions on Neural Networks.

[6]  Chng Eng Siong,et al.  Gradient radial basis function networks for nonlinear and nonstationary time series prediction , 1996, IEEE Trans. Neural Networks.

[7]  Hong Wang,et al.  Recursive estimation and time-series analysis , 1986, IEEE Trans. Acoust. Speech Signal Process..

[8]  Matthias Durr,et al.  Smoothness Priors Analysis Of Time Series , 2016 .

[9]  George E. P. Box,et al.  Time Series Analysis: Box/Time Series Analysis , 2008 .

[10]  Melvin J. Hinich,et al.  Time Series Analysis by State Space Methods , 2001 .

[11]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[12]  Ruey S. Tsay,et al.  Functional-Coefficient Autoregressive Models , 1993 .

[13]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[14]  M. Priestley.  STATE‐DEPENDENT MODELS: A GENERAL APPROACH TO NON‐LINEAR TIME SERIES ANALYSIS , 1980 .

[15]  G. Golub,et al.  Separable nonlinear least squares: the variable projection method and its applications , 2003 .

[16]  Theodore W. Berger,et al.  Modeling of nonlinear nonstationary dynamic systems with a novel class of artificial neural networks , 1999, IEEE Trans. Neural Networks.

[17]  Min Gan,et al.  An Efficient Variable Projection Formulation for Separable Nonlinear Least Squares Problems , 2014, IEEE Transactions on Cybernetics.

[18]  Jianqing Fan,et al.  Statistical Methods with Varying Coefficient Models. , 2008, Statistics and its interface.

[19]  T. Ozaki,et al.  Non-linear time series models for non-linear random vibrations , 1980, Journal of Applied Probability.

[20]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[21]  Min Gan,et al.  A Variable Projection Approach for Efficient Estimation of RBF-ARX Model , 2015, IEEE Transactions on Cybernetics.

[22]  C. L. Philip Chen,et al.  An incremental adaptive implementation of functional-link processing for function approximation, time-series prediction, and system identification , 1998, Neurocomputing.

[23]  Rob J Hyndman,et al.  A state space framework for automatic forecasting using exponential smoothing methods , 2002 .

[24]  C. Gouriéroux,et al.  Non-Gaussian State-Space Modeling of Nonstationary Time Series , 2008 .

[25]  C. L. Philip Chen,et al.  A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[26]  Min Gan,et al.  A locally linear RBF network-based state-dependent AR model for nonlinear time series modeling , 2010, Inf. Sci..

[27]  Qi Li,et al.  Functional-coefficient models for nonstationary time series data , 2009 .