Multi-objective cooperative coevolution of neural networks for time series prediction

The use of neural networks for time series prediction has been an important focus of recent research. Multi-objective optimization techniques have been used for training neural networks for time series prediction. Cooperative coevolution is an evolutionary computation method that decomposes the problem into subcomponents and has shown promising results for training neural networks. This paper presents a multi-objective cooperative coevolutionary method for training neural networks where the training data set is processed to obtain the different objectives for multi-objective evolutionary training of the neural network. We use different time lags as multi-objective criterion. The trained multi-objective neural network can give prediction of the original time series for preprocessed data sets distinguished by their time lags. The proposed method is able to outperform the conventional cooperative coevolutionary methods for training neural networks and also other methods from the literature on benchmark problems.

[1]  Xiaodong Li,et al.  A Cooperative Coevolutionary Multiobjective Algorithm Using Non-dominated Sorting , 2004, GECCO.

[2]  Joarder Kamruzzaman,et al.  A hybrid of multiobjective Evolutionary Algorithm and HMM-Fuzzy model for time series prediction , 2012, Neurocomputing.

[3]  Stephen H. Kellert.  Books-Received - in the Wake of Chaos - Unpredictable Order in Dynamical Systems , 1995 .

[4]  C. E. Puente,et al.  The Essence of Chaos , 1995 .

[5]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[6]  Zhiping Lin,et al.  Wavelet Packet Multi-layer Perceptron for Chaotic Time Series Prediction: Effects of Weight Initialization , 2001, International Conference on Computational Science.

[7]  Víctor Manuel Rivas Santos,et al.  Time series forecasting: Automatic determination of lags and radial basis neural networks for a changing horizon environment , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[8]  Minvydas Ragulskis,et al.  Non-uniform attractor embedding for time series forecasting by fuzzy inference systems , 2009, Neurocomputing.

[9]  Nikolay I. Nikolaev,et al.  Recursive Bayesian Recurrent Neural Networks for Time-Series Modeling , 2010, IEEE Transactions on Neural Networks.

[10]  Tiago Alessandro Espínola Ferreira,et al.  A New Evolutionary Approach for Time Series Forecasting , 2007, 2007 IEEE Symposium on Computational Intelligence and Data Mining.

[11]  Via Andrea Pisano.  Solar cycle forecasting : A nonlinear dynamics approach , 2001 .

[12]  Mengjie Zhang,et al.  Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction , 2012, Neurocomputing.

[13]  J. Tennyson.  In the wake of chaos. Unpredictable order in dynamical systems , 1995 .

[14]  Pascal Bouvry,et al.  Achieving super-linear performance in parallel multi-objective evolutionary algorithms by means of cooperative coevolution , 2013, Comput. Oper. Res..

[15]  Saeed Zolfaghari,et al.  RESIDUAL ANALYSIS AND COMBINATION OF EMBEDDING THEOREM AND ARTIFICIAL INTELLIGENCE IN CHAOTIC TIME SERIES FORECASTING , 2011, Appl. Artif. Intell..

[16]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[17]  Kara M. Kockelman,et al.  Chaos Theory and Transportation Systems: Instructive Example , 2004 .

[18]  Babak Nadjar Araabi,et al.  Predicting Chaotic Time Series Using Neural and Neurofuzzy Models: A Comparative Study , 2006, Neural Processing Letters.

[19]  Saeed Zolfaghari,et al.  Chaotic time series prediction with residual analysis method using hybrid Elman-NARX neural networks , 2010, Neurocomputing.

[20]  Chin-Teng Lin,et al.  A Hybrid of Cooperative Particle Swarm Optimization and Cultural Algorithm for Neural Fuzzy Networks and Its Prediction Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[22]  Hubert Cardot,et al.  Predicting Chaotic Time Series by Boosted Recurrent Neural Networks , 2006, ICONIP.

[23]  Héctor Pomares,et al.  Soft-computing techniques and ARMA model for time series prediction , 2008, Neurocomputing.

[24]  Hui Jiang,et al.  Grey relational grade in local support vector regression for financial time series prediction , 2012, Expert Syst. Appl..

[25]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[26]  César Hervás-Martínez,et al.  Multi-objective cooperative coevolution of artificial neural networks (multi-objective cooperative networks) , 2002, Neural Networks.

[27]  Risto Miikkulainen,et al.  Accelerated Neural Evolution through Cooperatively Coevolved Synapses , 2008, J. Mach. Learn. Res..

[28]  Kay Chen Tan,et al.  A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design , 2010, Eur. J. Oper. Res..

[29]  Tiago Alessandro Espínola Ferreira,et al.  Morphological-Rank-Linear Time-lag Added Evolutionary Forecasting method for financial time series forecasting , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[30]  Abdullah Al Mamun,et al.  Multiobjective Evolutionary Neural Networks for Time Series Forecasting , 2006, EMO.

[31]  Tong Heng Lee,et al.  A cooperative coevolutionary algorithm for multiobjective optimization , 2003, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[32]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[33]  Mengjie Zhang,et al.  An Encoding Scheme for Cooperative Coevolutionary Feedforward Neural Networks , 2010, Australasian Conference on Artificial Intelligence.

[34]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[35]  Jonathan E. Fieldsend,et al.  Pareto evolutionary neural networks , 2005, IEEE Transactions on Neural Networks.

[36]  Mengjie Zhang,et al.  On the issue of separability for problem decomposition in cooperative neuro-evolution , 2012, Neurocomputing.

[37]  Sérgio Soares,et al.  A quantum-inspired hybrid methodology for financial time series prediction , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[38]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[39]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[40]  Héctor Pomares,et al.  RBF Neural Networks, Multiobjective Optimization and Time Series Forecasting , 2001, IWANN.

[41]  Jukka Saarinen,et al.  Time Series Prediction with Multilayer Perception, FIR and Elman Neural Networks , 1996 .