Multi-objective GA rule extraction in a parallel framework

Genetic algorithm (GA) has been used as a conventional method for classifiers to evolve solutions adaptively for classification problems. Multiobjective evolutionary algorithms (MOEAs) that use nondominated sorting and sharing have been criticized mainly for their: 1) O(MN3) or O(MN2) computational complexity (where M is the number of objectives and N is the population size); 2) nonelitism approach [?]; and 3) the need for specifying a sharing parameter. In this paper, a new simple yet efficient approach is proposed to improve the performance of Multi-objective GA-based classifiers; the computational complexity of the proposed technique is O(MN), we also used a class decomposition technique. A classification problem is fully partitioned into several small problems each of which is responsible for solving a fraction of the original problem. We experimentally evaluate our approach on three different datasets and demonstrate that our algorithm can improve classification rate compared with normal GA and nonpartioned techniques; our technique is optimized using OpenMP-like implementation to take advantage of multi-threads or multi-processors.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Amr M. Sauber,et al.  Using Class Decomposition for Building GA with Fuzzy Rule-Based Classifiers , 2011 .

[3]  Kenneth DeJong,et al.  Learning with genetic algorithms: An overview , 1988, Machine Learning.

[4]  Steven Guan,et al.  Feature selection for modular GA-based classification , 2004, Appl. Soft Comput..

[5]  Steven Guan,et al.  Cooperative co-evolution of GA-based classifiers based on input decomposition , 2008, Eng. Appl. Artif. Intell..

[6]  Hisao Ishibuchi,et al.  Effects of Three-Objective Genetic Rule Selection on the Generalization Ability of Fuzzy Rule-Based Systems , 2003, EMO.

[7]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[8]  Hisao Ishibuchi,et al.  Finding Simple Fuzzy Classification Systems with High Interpretability Through Multiobjective Rule Selection , 2006, KES.

[9]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[10]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[11]  Sheng-Uei Guan,et al.  Class decomposition for GA-based classifier agents - a Pitt approach , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  K. De Jong Learning with Genetic Algorithms: An Overview , 1988 .

[13]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[14]  Dipankar Dutta,et al.  Discovering Classification Rules by Real Coded MOGA , 2009 .

[15]  Steven Guan,et al.  Ordered incremental training for GA-based classifiers , 2005, Pattern Recognit. Lett..

[16]  Mehmet Kaya Autonomous classifiers with understandable rule using multi-objective genetic algorithms , 2010, Expert Syst. Appl..

[17]  Bhabesh Nath,et al.  Multi-objective rule mining using genetic algorithms , 2004, Inf. Sci..

[18]  Hisao Ishibuchi,et al.  Multiobjective Classification Rule Mining , 2008, Multiobjective Problem Solving from Nature.