Optimization of Neuro-Coefficient Smooth Transition Autoregressive Models Using Differential Evolution

This paper presents a procedure for parameter estimation of the neuro-coefficient smooth transition autoregressive model, substituting the combination of grid search and local search of the original proposal of Medeiros and Veiga (2005, IEEE Trans. NN, 16(1):97-113) with a differential evolution scheme. The purpose of this novel fitting procedure is to obtain more accurate models under preservation of the most important model characteristics. These are, firstly, that the models are built using an iterative approach based on statistical tests, and therewith have a mathematically sound construction procedure. And secondly, that the models are interpretable in terms of fuzzy rules. The proposed procedure has been tested empirically by applying it to different real-world time series. The results indicate that, in terms of accuracy, significantly improved models can be achieved, so that accuracy of the resulting models is comparable to other standard time series forecasting methods.

[1]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[2]  José Manuel Benítez,et al.  Smooth transition autoregressive models and fuzzy rule-based systems: Functional equivalence and consequences , 2007, Fuzzy Sets Syst..

[3]  L. Blumenson A Derivation of n-Dimensional Spherical Coordinates , 1960 .

[4]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[5]  Marcelo C. Medeiros,et al.  A flexible coefficient smooth transition time series model , 2005, IEEE Transactions on Neural Networks.

[6]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[7]  José Manuel Benítez,et al.  Equivalences Between Neural-Autoregressive Time Series Models and Fuzzy Systems , 2010, IEEE Transactions on Neural Networks.

[8]  José Manuel Benítez,et al.  Linearity testing for fuzzy rule-based models , 2010, Fuzzy Sets Syst..

[9]  D. Dickey,et al.  Testing for unit roots in autoregressive-moving average models of unknown order , 1984 .

[10]  Francisco Herrera,et al.  IPADE: Iterative Prototype Adjustment for Nearest Neighbor Classification , 2010, IEEE Transactions on Neural Networks.

[11]  H. Tong Non-linear time series. A dynamical system approach , 1990 .

[12]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[13]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[14]  José Manuel Benítez,et al.  Testing for Remaining Autocorrelation of the residuals in the Framework of Fuzzy Rule-Based Time Series Modelling , 2010, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[15]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[16]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[17]  David Ardia,et al.  DEoptim: An R Package for Global Optimization by Differential Evolution , 2009 .

[18]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .