Time series prediction using committee machines of evolutionary neural trees

Evolutionary neural trees (ENTs) are tree-structured neural networks constructed by evolutionary algorithms. We use ENTs to build predictive models of time series data. Time series data are typically characterized by dynamics of the underlying process and thus the robustness of predictions is crucial. We describe a method for making more robust predictions by building committees of ENTs, i.e. CENTs. The method extends the concept of mixing genetic programming (MGP) which makes use of the fact that evolutionary computation produces multiple models as output instead of just one best. Experiments have been performed on the laser time series in which the CENTs outperformed the single best ENTs. We also discuss a theoretical foundation of CENTs using the Bayesian framework for evolutionary computation.

[1]  Butong Zhang,et al.  Enhancing Robustness of Genetic Programming at the Species Level , 1996 .

[2]  Byoung-Tak Zhang,et al.  Evolutionary Induction of Sparse Neural Trees , 1997, Evolutionary Computation.

[3]  Byoung-Tak Zhang A Bayesian framework for evolutionary computation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[4]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[5]  Neal B. Abraham,et al.  Lorenz-like chaos in NH3-FIR lasers , 1995 .

[6]  Xin Yao,et al.  Making use of population information in evolutionary artificial neural networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[7]  David E. Rumelhart,et al.  Product Units: A Computationally Powerful and Biologically Plausible Extension to Backpropagation Networks , 1989, Neural Computation.

[8]  Heinz Mühlenbein,et al.  The Science of Breeding and Its Application to the Breeder Genetic Algorithm (BGA) , 1993, Evolutionary Computation.

[9]  Xin Yao,et al.  Time Series Prediction by Using Negatively Correlated Neural Networks , 1998, SEAL.

[10]  Sherif Hashem,et al.  Optimal Linear Combinations of Neural Networks , 1997, Neural Networks.

[11]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ted Jaditz Time series prediction: Forecasting the future and understanding the past : Andreas S. Weigend and Neil A. Gershenfeld, eds., (Reading, MA: Addison-Wesley Publishing Co., 1949) pp. xvii + 643, $29.95 , 1995 .