Particle Swarm Algorithm for Classification Rules Generation

It is the core problem in building a fuzzy classification system to extract an optimal group of fuzzy classification rules from fuzzy data set. A new kind of algorithm is proposed for fuzzy rules' generating in this work. The idea behind the algorithm is mainly based on both, concepts of data mining and particle swarm optimization (PSO) algorithm. A fuzzy information entropy based measure which generalizes the one used in crisp domain is introduced to measure fuzzy rule's interestingness, and it combines with other two measures, accuracy and coverage, to construct the composite objective function which is called fitness function in the algorithm. Finally, the algorithm is utilized to solve the famous Saturday morning problem. The result is compared with that of fuzzy decision tree induction method

[1]  Yuhui Shi,et al.  Extracting rules from fuzzy neural network by particle swarm optimisation , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[2]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[3]  Alex A. Freitas,et al.  A survey of evolutionary algorithms for data mining and knowledge discovery , 2003 .

[4]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[5]  Alex Alves Freitas,et al.  On Objective Measures of Rule Surprisingness , 1998, PKDD.

[6]  M. Shaw,et al.  Induction of fuzzy decision trees , 1995 .

[7]  Wang Wei,et al.  The path planning of mobile manipulator with genetic-fuzzy controller in flexible manufacturing cell , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[8]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[9]  Alex A. Freitas,et al.  Discovering interesting prediction rules with a genetic algorithm , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[11]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[12]  Mehmet Kaya,et al.  Multi-objective genetic algorithm based approaches for mining optimized fuzzy association rules , 2006, Soft Comput..

[13]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[14]  Yufei Yuan,et al.  A genetic algorithm for generating fuzzy classification rules , 1996, Fuzzy Sets Syst..

[15]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.