Continuously Evolving Programs in Genetic Programming Using Gradient Descent

This paper describes an approach to the use of gradient descent search in genetic programming for continuously evolving genetic programs for object classication problems. An inclusion factor is introduced to each node in a genetic program and gradient descent search is applied to the inclusion factors. Three new on-zero operators and two new continuous genetic operators are developed for evolution. This approach is examined and compared with a basic GP approach on three object classication problems of varying difculty . The results suggest that the new approach can evolve genetic programs continuously. The new method which uses the standard genetic operators and gradient descent applied to the inclusion factors substantially outperforms the basic GP approach which uses the standard genetic operators but does not use the gradient descent and inclusion factors. However, the new method with the continuous operators and the gradient descent on inclusion factors decreases the performance on all the problems.

[1]  Victor Ciesielski,et al.  A Domain-Independent Window Approach to Multiclass Object Detection Using Genetic Programming , 2003, EURASIP J. Adv. Signal Process..

[2]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[3]  Bangalore S. Manjunath,et al.  Genetic Programming for Object Detection , 1996 .

[4]  Una-May O'Reilly,et al.  Genetic Programming II: Automatic Discovery of Reusable Programs. , 1994, Artificial Life.

[5]  Daniel Howard,et al.  Target detection in SAR imagery by genetic programming , 1999 .

[6]  Victor Ciesielski,et al.  Genetic Programming for Multiple Class Object Detection , 1999, Australian Joint Conference on Artificial Intelligence.

[7]  David Andre,et al.  Automatically defined features: the simultaneous evolution of 2-dimensional feature detectors and an algorithm for using them , 1994 .

[8]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[9]  Conor Ryan,et al.  An Analysis of Diversity of Constants of Genetic Programming , 2003, EuroGP.

[10]  Vic Ciesielski,et al.  Texture classifiers generated by genetic programming , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[11]  Vic Ciesielski,et al.  Representing classification problems in genetic programming , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[12]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[13]  Mengjie Zhang,et al.  Genetic Programming with Gradient Descent Search for Multiclass Object Classification , 2004, EuroGP.

[14]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[15]  Walter Alden Tackett,et al.  Genetic Programming for Feature Discovery and Image Discrimination , 1993, ICGA.