Cooperative Problem Decomposition in Pareto Competitive Classifier Models of Coevolution

Pareto competitive models of coevolution have the potential to provide a number of distinct advantages over the canonical approach to training under the Genetic Programming (GP) classifier domain. Recent work has specifically focused on the reformulation of training as a two-population competition, that is learners versus training exemplars. Such a scheme affords, for example, the capacity to decouple the fitness evaluation overhead from the data set size through sub sampling while naturally encouraging 'teams' or composite solutions as opposed to solutions based on a single individual alone. One outstanding question with respect to the latter characteristic is with regards to the nature of the team (archive) behavior in terms of pattern coverage. That is to say, which models are used when, and what are the implications for solution modularity as it relates, for example, to the assignment of exemplars to solution participants. The current work investigates two Pareto competitive approaches to classification under GP, with one configured to employ an explicitly cooperative multi-objective cost function based and the other employing the classical (error-based) cost function. We empirically demonstrate a critical distinction between the two with regards to problem decomposition, with the capacity to provide a decomposition into unique behaviors being much more prevalent when co-operative mechanisms are explicitly supported.

[1]  Edwin D. de Jong,et al.  A comparison of evaluation methods in coevolution , 2007, GECCO '07.

[2]  Alan Blair,et al.  A structure preserving crossover in grammatical evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[3]  Jordan B. Pollack,et al.  Pareto Optimality in Coevolutionary Learning , 2001, ECAL.

[4]  Andrew R. McIntyre,et al.  Multi-objective competitive coevolution for efficient GP classifier problem decomposition , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[5]  Michael O'Neill,et al.  Grammatical evolution - evolutionary automatic programming in an arbitrary language , 2003, Genetic programming.

[6]  R. Watson,et al.  Pareto coevolution: using performance against coevolved opponents in a game as dimensions for Pareto selection , 2001 .

[7]  Malcolm I. Heywood,et al.  Training Binary GP Classifiers Efficiently: A Pareto-coevolutionary Approach , 2007, EuroGP.

[8]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[9]  Rajeev Kumar,et al.  Improved Sampling of the Pareto-Front in Multiobjective Genetic Optimizations by Steady-State Evolution: A Pareto Converging Genetic Algorithm , 2002, Evolutionary Computation.

[10]  Malcolm I. Heywood,et al.  Pareto-coevolutionary genetic programming for problem decomposition in multi-class classification , 2007, GECCO '07.

[11]  Edwin D. de Jong,et al.  Ideal Evaluation from Coevolution , 2004, Evolutionary Computation.

[12]  Andrew R. McIntyre,et al.  Novelty detection + coevolution = automatic problem decomposition: a framework for scalable genetic programming classifiers , 2008 .