Multiobjective Evolutionary Neural Networks for Time Series Forecasting

This paper will investigate the application of multiobjective evolutionary neural networks in time series forecasting. The proposed algorithmic model considers training and validation accuracy as the objectives to be optimized simultaneously, so as to balance the accuracy and generalization of the evolved neural networks. To improve the overall generalization ability for the set of solutions attained by the multiobjective evolutionary optimizer, a simple algorithm to filter possible outliers, which tend to deteriorate the overall performance, is proposed also. Performance comparison with other existing evolutionary neural networks in several time series problems demonstrates the practicality and viability of the proposed time series forecasting model.

[1]  Paulo Cortez,et al.  Evolving Time Series Forecasting Neural Network Models , 2001 .

[2]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[3]  Luiz Eduardo Soares de Oliveira,et al.  Multi-objective Genetic Algorithms to Create Ensemble of Classifiers , 2005, EMO.

[4]  Richard M. Everson,et al.  Intelligent Data Engineering and Automated Learning – IDEAL 2004 , 2004, Lecture Notes in Computer Science.

[5]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[6]  Hussein A. Abbass,et al.  Pareto neuro-evolution: constructing ensemble of neural networks using multi-objective optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[7]  Ricardo H. C. Takahashi,et al.  A multi-objective optimization approach for training artificial neural networks , 2000, Proceedings. Vol.1. Sixth Brazilian Symposium on Neural Networks.

[8]  Ajith Abraham,et al.  Evolutionary Multiobjective Optimization Approach for Evolving Ensemble of Intelligent Paradigms for Stock Market Modeling , 2005, MICAI.

[9]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[10]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[11]  Timur Ash,et al.  Dynamic node creation in backpropagation networks , 1989 .

[12]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[13]  Robert Sabourin,et al.  An Evaluation of Over-Fit Control Strategies for Multi-Objective Evolutionary Optimization , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[14]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[15]  Alexander Gelbukh,et al.  MICAI 2005: Advances in Artificial Intelligence, 4th Mexican International Conference on Artificial Intelligence, Monterrey, Mexico, November 14-18, 2005, Proceedings , 2005, MICAI.

[16]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[17]  Mikko Lehtokangas.  Modelling with constructive backpropagation , 1999, Neural Networks.

[18]  Jonathan E. Fieldsend,et al.  Pareto evolutionary neural networks , 2005, IEEE Transactions on Neural Networks.

[19]  Xin Yao,et al.  DIVACE: Diverse and Accurate Ensemble Learning Algorithm , 2004, IDEAL.

[20]  Hussein A. Abbass,et al.  A Memetic Pareto Evolutionary Approach to Artificial Neural Networks , 2001, Australian Joint Conference on Artificial Intelligence.

[21]  Paulo Cortez,et al.  A Meta-Genetic Algorithm for Time Series Forecasting , 2001 .

[22]  Bernhard Sendhoff,et al.  Neural network regularization and ensembling using multi-objective evolutionary algorithms , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[23]  Hussein A. Abbass,et al.  An evolutionary artificial neural networks approach for breast cancer diagnosis , 2002, Artif. Intell. Medicine.

[24]  Hung Man Tong,et al.  Threshold models in non-linear time series analysis. Lecture notes in statistics, No.21 , 1983 .