Short, medium and long term forecasting of time series using the L-Co-R algorithm

This paper describes the coevolutionary algorithm L-Co-R (Lags COevolving with Radial Basis Function Neural Networks - RBFNs), and analyzes its performance in the forecasting of time series in the short, medium and long terms. The method allows the coevolution, in a single process, of the RBFNs as the time series models, as well as the set of lags to be used for predictions, integrating two genetic algorithms with real and binary codification, respectively. The individuals of one population are radial basis neural networks (used as models), while sets of candidate lags are individuals of the second population. In order to test the behavior of the algorithm in a new context of a variable horizon, 5 different measures have been analyzed, for more than 30 different databases, comparing this algorithm against six existing algorithms and for seven different prediction horizons. Statistical analysis of the results shows that L-Co-R outperforms other methods, regardless of the horizon, and is capable of predicting short, medium or long horizons using real known values.

[1]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[2]  Ashu Jain,et al.  Hybrid neural network models for hydrologic time series forecasting , 2007, Appl. Soft Comput..

[3]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[4]  Robert Fildes,et al.  The evaluation of extrapolative forecasting methods , 1992 .

[5]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[6]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[7]  Minvydas Ragulskis,et al.  Evolutionary algorithms for the selection of time lags for time series forecasting by fuzzy inference systems , 2010, Neurocomputing.

[8]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[9]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[10]  Minqiang Li,et al.  Dual-population based coevolutionary algorithm for designing RBFNN with feature selection , 2010, Expert Syst. Appl..

[11]  J. Rustagi Optimization Techniques in Statistics , 1994 .

[12]  Ricardo de A. Araújo A quantum-inspired evolutionary hybrid intelligent approach for stock market prediction , 2010, Int. J. Intell. Comput. Cybern..

[13]  Amitava Chatterjee,et al.  Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization , 2006, Comput. Oper. Res..

[14]  Rob J. Hyndman,et al.  On continuous-time threshold autoregression☆ , 1992 .

[15]  Michael P. Clements,et al.  Forecasting economic and financial time-series with non-linear models , 2004 .

[16]  Robert L. Winkler,et al.  The accuracy of extrapolation (time series) methods: Results of a forecasting competition , 1982 .

[17]  Tiago Alessandro Espínola Ferreira,et al.  A New Intelligent System Methodology for Time Series Forecasting with Artificial Neural Networks , 2008, Neural Processing Letters.

[18]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[19]  C. Arizmendi,et al.  Time series predictions with neural nets: Application to airborne pollen forecasting , 1993 .

[20]  H. Tong,et al.  ON ESTIMATING THRESHOLDS IN AUTOREGRESSIVE MODELS , 1986 .

[21]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[22]  R. Paul Wiegand,et al.  An empirical analysis of collaboration methods in cooperative coevolutionary algorithms , 2001 .

[23]  Sven F. Crone,et al.  Forecasting and operational research: a review , 2008, J. Oper. Res. Soc..

[24]  Kadir Kavaklioglu,et al.  Modeling and prediction of Turkey’s electricity consumption using Support Vector Regression , 2011 .

[25]  Xin Ma,et al.  Power system short-term load forecasting based on cooperative co-evolutionary immune network model , 2010, 2010 2nd International Conference on Education Technology and Computer.

[26]  Chi-Chen Wang,et al.  A comparison study between fuzzy time series model and ARIMA model for forecasting Taiwan export , 2011, Expert Syst. Appl..

[27]  Haiping Du,et al.  Time series prediction using evolving radial basis function networks with new encoding scheme , 2008, Neurocomputing.

[28]  Peter R. Winters,et al.  Forecasting Sales by Exponentially Weighted Moving Averages , 1960 .

[29]  María José del Jesús,et al.  Coevolution of lags and RBFNs for time series forecasting: L-Co-R algorithm , 2011, Soft Computing.

[30]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[31]  Jianzhou Wang,et al.  A seasonal hybrid procedure for electricity demand forecasting in China , 2011 .

[32]  Anastasios Bezerianos,et al.  Radial basis function neural networks for the characterization of heart rate variability dynamics , 1999, Artif. Intell. Medicine.

[33]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[34]  Xiaodong Liu,et al.  A generalized method for forecasting based on fuzzy time series , 2011, Expert Syst. Appl..

[35]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[36]  Nicolás García-Pedrajas,et al.  A cooperative coevolutionary algorithm for instance selection for instance-based learning , 2010, Machine Learning.

[37]  Christian W. Dawson,et al.  The effect of different basis functions on a radial basis function network for time series prediction: A comparative study , 2006, Neurocomputing.

[38]  Ralph D. Snyder,et al.  Recursive Estimation of Dynamic Linear Models , 1985 .

[39]  Brian Carse,et al.  Fast Evolutionary Learning of Minimal Radial Basis Function Neural Networks Using a Genetic Algorithm , 1996, Evolutionary Computing, AISB Workshop.

[40]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[41]  Saifur Rahman,et al.  Building a fuzzy expert system for electric load forecasting using a hybrid neural network , 1995 .

[42]  Chia-Nan Ko,et al.  Time series prediction using RBF neural networks with a nonlinear time-varying evolution PSO algorithm , 2009, Neurocomputing.

[43]  Robert L. Winkler,et al.  The Accuracy of Extrapolation (Time Series) Methods , 1982 .

[44]  Ho-fung Leung,et al.  Biasing mutations in cooperative coevolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[45]  Kay Chen Tan,et al.  A distributed Cooperative coevolutionary algorithm for multiobjective optimization , 2006, IEEE Transactions on Evolutionary Computation.

[46]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[47]  Spyros Makridakis,et al.  The M3-Competition1 , 2000 .

[48]  R. Brown Statistical forecasting for inventory control , 1960 .

[49]  Kun-Huang Huarng,et al.  A neural network-based fuzzy time series model to improve forecasting , 2010, Expert Syst. Appl..

[50]  R. Paul Wiegand,et al.  Improving Coevolutionary Search for Optimal Multiagent Behaviors , 2003, IJCAI.

[51]  James W. Taylor,et al.  An evaluation of Bayesian techniques for controlling model complexity and selecting inputs in a neural network for short-term load forecasting , 2010, Neural Networks.

[52]  Minqiang Li,et al.  Improving multiclass pattern recognition with a co-evolutionary RBFNN , 2008, Pattern Recognit. Lett..

[53]  Francisco Herrera,et al.  A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability , 2009, Soft Comput..

[54]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[55]  César Hervás-Martínez,et al.  Evolutionary product unit based neural networks for regression , 2006, Neural Networks.

[56]  Antonio J. Rivera,et al.  CO2RBFN for Short and Medium Term Forecasting of the Extra-Virgin Olive Oil Price , 2010, NICSO.

[57]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[58]  José Manuel Benítez,et al.  Feature Selection for Time Series Forecasting: A Case Study , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[59]  Ricardo de A. Araújo,et al.  Hybrid intelligent methodology to design translation invariant morphological operators for Brazilian stock market prediction , 2010, Neural Networks.

[60]  Paul A. Fishwick,et al.  Time series forecasting using neural networks vs. Box- Jenkins methodology , 1991, Simul..

[61]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .

[62]  César Hervás-Martínez,et al.  Cooperative coevolution of artificial neural network ensembles for pattern classification , 2005, IEEE Transactions on Evolutionary Computation.

[63]  J. Sprott,et al.  Neural network method for determining embedding dimension of a time series , 2011 .

[64]  Ruxandra Stoean,et al.  Feature selection for a cooperative coevolutionary classifier in liver fibrosis diagnosis , 2011, Comput. Biol. Medicine.

[65]  Juan Julián Merelo Guervós,et al.  Evolving RBF neural networks for time-series forecasting with EvRBF , 2004, Inf. Sci..

[66]  Francisco Herrera,et al.  IFS-CoCo: Instance and feature selection based on cooperative coevolution with nearest neighbor rule , 2010, Pattern Recognit..

[67]  B. Samanta,et al.  Prediction of chaotic time series using computational intelligence , 2011, Expert Syst. Appl..

[68]  Hung Man Tong,et al.  Threshold models in non-linear time series analysis. Lecture notes in statistics, No.21 , 1983 .

[69]  Héctor Pomares,et al.  Parallel multiobjective memetic RBFNNs design and feature selection for function approximation problems , 2009, Neurocomputing.

[70]  Peng Hong,et al.  Multi-step-prediction of chaotic time series based on co-evolutionary recurrent neural network , 2008 .

[71]  Guoqiang Peter Zhang,et al.  Neural network forecasting for seasonal and trend time series , 2005, Eur. J. Oper. Res..