Optimization of Ensemble Neural Networks with Type-2 Fuzzy Integration of Responses for the Dow Jones Time Series Prediction

This paper describes an optimization method based on genetic algorithms for designing ensemble neural networks with fuzzy response aggregation to forecast complex time series. The time series that was considered in this paper, to compare the hybrid approach with traditional methods, is the Dow Jones data, and the results are presented for the optimization of the structure of the ensemble neural network with type-1 and type-2 fuzzy response integration. Simulation results show that the ensemble approach produces 99% prediction accuracy for the Dow Jones time series and that using type-2 fuzzy logic improves the performance of the predictor.

[1]  S. Bertazzoni,et al.  Local meteorological forecasting by type-2 fuzzy systems time series prediction , 2005, CIMSA. 2005 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications, 2005..

[2]  Andrew Metcalfe,et al.  Time Series Data , 2009 .

[3]  Oscar Castillo,et al.  Simulation and forecasting complex economic time series using neural networks and fuzzy logic , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[4]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[5]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .

[6]  Oscar Castillo,et al.  Comparison of Hybrid Intelligent Systems, Neural Networks and Interval Type-2 Fuzzy Logic for Time Series Prediction , 2007, 2007 International Joint Conference on Neural Networks.

[7]  Mohammad Hossein Fazel Zarandi,et al.  A type-2 fuzzy rule-based expert system model for stock price analysis , 2009, Expert Syst. Appl..

[8]  Hujun Yin,et al.  Exchange rate prediction using hybrid neural networks and trading indicators , 2009, Neurocomputing.

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  Amanda J. C. Sharkey,et al.  Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems , 1999 .

[11]  Anders Krogh,et al.  Learning with ensembles: How overfitting can be useful , 1995, NIPS.

[12]  P. Cowpertwait,et al.  Introductory Time Series with R , 2009 .

[13]  Oscar Castillo,et al.  Design of Modular Neural Networks with Fuzzy Integration Applied to Time Series Prediction , 2007, Analysis and Design of Intelligent Systems using Soft Computing Techniques.

[14]  Oscar Castillo,et al.  Simulation and forecasting complex financial time series using neural networks and fuzzy logic , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[15]  Jerry M. Mendel,et al.  Applications of Type-2 Fuzzy Logic Systems to Forecasting of Time-series , 1999, Inf. Sci..

[16]  Athanasios Kehagias,et al.  Predictive Modular Neural Networks for Time Series Classification , 1997, Neural Networks.

[17]  L. Booker.  Foundations of genetic algorithms. 2: L. Darrell Whitley (Ed.), Morgan Kaufmann, San Mateo, CA, 1993, ISBN 1-55860-263-1, 322 pp., US$45.95 , 1994 .

[18]  Saeed Zolfaghari,et al.  Chaotic time series prediction with residual analysis method using hybrid Elman-NARX neural networks , 2010, Neurocomputing.

[19]  Oscar Castillo,et al.  Type-2 Fuzzy Logic: Theory and Applications , 2007, IEEE International Conference on Granular Computing.

[20]  Oscar Castillo,et al.  Hybrid intelligent systems for time series prediction using neural networks, fuzzy logic, and fractal theory , 2002, IEEE Trans. Neural Networks.

[21]  K. Huarng,et al.  A Type 2 fuzzy time series model for stock index forecasting , 2005 .

[22]  Neil Davey,et al.  Time Series Prediction and Neural Networks , 2001, J. Intell. Robotic Syst..

[23]  Jerry M. Mendel,et al.  Operations on type-2 fuzzy sets , 2001, Fuzzy Sets Syst..

[24]  Liang Zhao,et al.  PSO-based single multiplicative neuron model for time series prediction , 2009, Expert Syst. Appl..

[25]  Prem Kumar Kalra,et al.  Time series prediction with single multiplicative neuron model , 2007, Appl. Soft Comput..

[26]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Berkman Sahiner,et al.  Dual system approach to computer-aided detection of breast masses on mammograms. , 2006, Medical physics.

[28]  Dipti Srinivasan,et al.  A SOM-based hybrid linear-neural model for short-term load forecasting , 2011, Neurocomputing.

[29]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[30]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[31]  Oscar Castillo,et al.  A new approach for time series prediction using ensembles of ANFIS models , 2012, Expert Syst. Appl..

[32]  Oscar Castillo,et al.  An Interval Type-2 Fuzzy Neural Network for Chaotic Time Series Prediction with Cross-Validation and Akaike Test , 2011, Soft Computing for Intelligent Control and Mobile Robotics.

[33]  Tom Murray,et al.  Predicting sun spots using a layered perceptron neural network , 1996, IEEE Trans. Neural Networks.

[34]  Syed Muhammad Aqil Burney,et al.  A refined fuzzy time series model for stock market forecasting , 2008 .