Knowledge reuse for an ensemble of GP-based learners

We propose a method of knowledge reuse for an ensemble of genetic programming-based learners solving a visual learning task. First, we introduce a visual learning method that uses genetic programming individuals to represent hypotheses. Individuals-hypotheses process image representation composed of visual primitives derived from given training images that contain objects to be recognized. The process of recognition is generative, i.e., an individual is supposed to restore the shape of the processed object by drawing its reproduction on a separate canvas. This canonical method is in the following extended with a knowledge reuse mechanism that allows a learner to import genetic material from hypotheses that evolved for other decision classes (object classes). We compare the performance of the extended approach to the basic method on a real-world tasks of handwritten character recognition, and conclude that knowledge reuse leads to significant convergence speedup and reduces the risk of overfitting.

[1]  Sushil J. Louis,et al.  Learning with case-injected genetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[2]  John R. Koza,et al.  Scalable learning in genetic programming using automatic function definition , 1994 .

[3]  John R. Koza,et al.  Reuse, Parameterized Reuse, and Hierarchical Reuse of Substructures in Evolving Electrical Circuits Using Genetic Programming , 1996, ICES.

[4]  Scott J. Harmon,et al.  Empirical Comparison of Incremental Reuse Strategies in Genetic Programming for Keep-Away Soccer , 2004 .

[5]  Riccardo Poli,et al.  Reusing Code in Genetic Programming , 2004, EuroGP.

[6]  John R. Koza,et al.  Evolving Modules in Genetic Programming by Subtree Encapsulation , 2001, EuroGP.

[7]  Krzysztof Krawiec,et al.  Visual learning by coevolutionary feature synthesis , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[9]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[10]  Louis A. Tamburino,et al.  Evolving pattern recognition systems , 2002, IEEE Trans. Evol. Comput..

[11]  Sushil J. Louis,et al.  Genetic learning from experience , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[12]  Conor Ryan,et al.  Pragmatic Genetic Programming strategy for the problem of vehicle detection in airborne reconnaissance , 2006, Pattern Recognit. Lett..

[13]  Wojciech Ja-kowski,et al.  GENETIC PROGRAMMING WITH CROSS-TASK KNOWLEDGE SHARING FOR LEARNING OF VISUAL CONCEPTS , 2006 .