Class decomposition for GA-based classifier agents - a Pitt approach

This paper proposes a class decomposition approach to improve the performance of GA-based classifier agents. This approach partitions a classification problem into several class modules in the output domain, and each module is responsible for solving a fraction of the original problem. These modules are trained in parallel and independently, and results obtained from them are integrated to form the final solution by resolving conflicts. Benchmark classification data sets are used to evaluate the proposed approaches. The experiment results show that class decomposition can help achieve higher classification rate with training time reduced.

[1]  L. Su,et al.  Incremental Self-Growing Neural Networks with the Changing Environment , 2001 .

[2]  Eric Michielssen,et al.  The use of domain decomposition genetic algorithms exploiting model reduction for the design of frequency selective surfaces , 2000 .

[3]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[4]  Jianping Zhang,et al.  Selecting Typical Instances in Instance-Based Learning , 1992, ML.

[5]  Edwin P. D. Pednault,et al.  Decomposition of Heterogeneous Classification Problems , 1997, Intell. Data Anal..

[6]  Kishan G. Mehrotra,et al.  Efficient classification for multiclass problems using modular neural networks , 1995, IEEE Trans. Neural Networks.

[7]  Masami Ito,et al.  Task decomposition and module combination based on class relations: a modular neural network for pattern classification , 1999, IEEE Trans. Neural Networks.

[8]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Sandip Sen,et al.  Using real-valued genetic algorithms to evolve rule sets for classification , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[10]  Steven Guan,et al.  Incremental Learning with Respect to New Incoming Input Attributes , 2004, Neural Processing Letters.

[11]  Erick Cantú-Paz,et al.  Markov chain models of parallel genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[12]  Casimir A. Kulikowski,et al.  Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems , 1990 .

[13]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[14]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[15]  Kenneth A. De Jong,et al.  Learning Concept Classification Rules Using Genetic Algorithms , 1991, IJCAI.

[16]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[17]  K. D. Jong.  Learning with Genetic Algorithms: An Overview , 2005, Machine Learning.

[18]  El-Ghazali Talbi,et al.  A parallel genetic algorithm for rule mining , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[19]  H. Ishibuchi.  Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[20]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[21]  J. J. Merelo.  Optimization of Classifiers Using Genetic Algorithms , 1996 .

[22]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[23]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[24]  Robert E. Jenkins,et al.  A simplified neural network solution through problem decomposition: the case of the truck backer-upper , 1993, IEEE Trans. Neural Networks.

[25]  Steven Guan,et al.  Parallel growing and training of neural networks using output parallelism , 2002, IEEE Trans. Neural Networks.

[26]  D. M. Hutton,et al.  Advances in the Evolutionary Synthesis of Intelligent Agents , 2002 .

[27]  Lutz Prechelt,et al.  A Set of Neural Network Benchmark Problems and Benchmarking Rules , 1994 .