Evolving Teams of Multiple Predictors with Genetic Programming

This paper reports on the evolution of GP teams in di erent classi cation and regression problems and compares di erent methods for combining the outputs of the team programs. These include hybrid approaches where (1) a neural network is used to optimize the weights of programs in a team for a common decision and (2) a real-numbered vector of weights (the representation of evolution strategies) is evolved with each team in parallel. The cooperative team approach results in an improved training and generalization performance compared to the standard GP method. The higher computational overhead of coevolving several genetic programs is counteracted by using a fast variant of linear GP. In particular, the processing time of linear genetic programs is reduced signi cantly by removing intron code before program execution.

[1]  Peter Nordin,et al.  A compiling genetic programming system that directly manipulates the machine-code , 1994 .

[2]  Wolfgang Banzhaf,et al.  Genetic Programming: An Introduction , 1997 .

[3]  Xin Yao,et al.  Making use of population information in evolutionary artificial neural networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Sandip Sen,et al.  Evolving a Team , 1995 .

[5]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[6]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[7]  Lee Spector,et al.  Evolving teamwork and coordination with genetic programming , 1996 .

[8]  Terence Soule,et al.  Voting teams: a cooperative approach to non-typical problems using genetic programming , 1999 .

[9]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[10]  Walter Alden Tackett,et al.  Recombination, selection, and the genetic construction of computer programs , 1994 .

[11]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[12]  Wolfgang Banzhaf,et al.  A comparison of linear genetic programming and neural networks in medical data mining , 2001, IEEE Trans. Evol. Comput..

[13]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Sandip Sen,et al.  Crossover Operators for Evolving A Team , 1997 .

[15]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[16]  Butong Zhang,et al.  Enhancing Robustness of Genetic Programming at the Species Level , 1996 .