MOLeCS: Using Multiobjective Evolutionary Algorithms for Learning

MOLeCS is a classifier system (CS) which addresses its learning as a multiobjective task. Its aim is to develop an optimal set of rules, optimizing the accuracy and the generality of each rule simultaneously. This is achieved by considering these two goals in the rule fitness. The paper studies four multiobjective strategies that establish a compromise between accuracy and generality in different ways. The results suggest that including the decision maker's preferences in the search process improves the overall performance of the obtained rule set. The paper also studies a third major objective: covering (the maintenance of a set of different rules solving together the learning problem), through different niching mechanisms. After a performance analysis using some benchmark problems, MOLeCS is applied to a real-world categorization task: the diagnosis of breast cancer.

[1]  S. B. Prakash,et al.  of Electrical and Computer Engineering , 1984 .

[2]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.

[3]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[4]  Stewart W. Wilson.  Mining Oblique Data with XCS , 2000, IWLCS.

[5]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[6]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[7]  Stewart W. Wilson.  Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[8]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[9]  Manuel Valenzuela-Rendón,et al.  A Non-Generational Genetic Algorithm for Multiobjective Optimization , 1997, ICGA.

[10]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[11]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[12]  Gary B. Lamont,et al.  Multiobjective Evolutionary Algorithms: Analyzing the State-of-the-Art , 2000, Evolutionary Computation.

[13]  Samir W. Mahfoud.  Niching methods for genetic algorithms , 1996 .

[14]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[15]  Samir W. Mahfoud.  Crowding and Preselection Revisited , 1992, PPSN.

[16]  Ester Bernadó-Mansilla,et al.  MOLeCS: A MultiObjective Learning Classifier System , 2000, GECCO.

[17]  ZitzlerE.,et al.  Multiobjective evolutionary algorithms , 1999 .

[18]  T. Kovacs.  XCS Classifier System Reliably Evolves Accurate, Complete, and Minimal Representations for Boolean Functions , 1998 .

[19]  David E. Goldberg,et al.  Finite Markov Chain Analysis of Genetic Algorithms , 1987, ICGA.

[20]  David E. Goldberg,et al.  Implicit Niching in a Learning Classifier System: Nature's Way , 1994, Evolutionary Computation.

[21]  Stewart W. Wilson.  Get Real! XCS with Continuous-Valued Inputs , 1999, Learning Classifier Systems.

[22]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[23]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[24]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 , 2000 .