SOM+PSO A Novel Method to Obtain Classification Rules

Currently, most processes have a volume of historical information that makes its manual processing difficult. Data mining, one of the most significant stages in the Knowledge Discovery in Databases (KDD) process, has a set of techniques capable of modeling and summarizing these historical data, making it easier to understand them and helping the decision making process in future situations. This article presents a new data mining adaptive technique called SOM+PSO that can build, from the available information, a reduced set of simple classification rules from which the most significant relations between the features recorded can be derived. These rules operate both on numeric and nominal attributes, and they are built by combining a variation of a population metaheuristic and a competitive neural network. The method proposed was compared with the PART method and measured over 19 databases (mostly from the UCI repository), and satisfactory results were obtained.

[1]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[2]  Tobias Scheffer.  Finding association rules that trade support optimally against confidence , 2005 .

[3]  Muhammad Amjad Iqbal,et al.  Data Mining by Discrete PSO Using Natural Encoding , 2010, 2010 5th International Conference on Future Information Technology.

[4]  Muhammad Amjad Iqbal,et al.  A New Discrete PSO for Data Classification , 2010, 2010 International Conference on Information Science and Applications.

[5]  Armando De Giusti,et al.  A New Binary PSO with Velocity Control , 2011, ICSI.

[6]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[7]  Bala Srinivasan,et al.  Dynamic self-organizing maps with controlled growth for knowledge discovery , 2000, IEEE Trans. Neural Networks Learn. Syst..

[8]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[9]  Simone A. Ludwig,et al.  Discrete Particle Swarm Optimization with local search strategy for Rule Classification , 2012, 2012 Fourth World Congress on Nature and Biologically Inspired Computing (NaBIC).

[10]  Hao Wang,et al.  Improvement of Discrete Particle Swarm classification system , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[11]  Gilles Venturini,et al.  SIA: A Supervised Inductive Algorithm with Genetic Search for Learning Attributes based Concepts , 1993, ECML.

[12]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[13]  Jianchao Zeng,et al.  Using Particle Swarm Optimization and Genetic Programming to Evolve Classification Rules , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[14]  Mehmet Kaya,et al.  Swarm optimized organizing map (SWOM): A swarm intelligence basedoptimization of self-organizing map , 2009, Expert Syst. Appl..

[15]  Chihli Hung,et al.  Extracting Rules from Optimal Clusters of Self-Organizing Maps , 2010, 2010 Second International Conference on Computer Modeling and Simulation.

[16]  Ziqiang Wang,et al.  A PSO-Based Classification Rule Mining Algorithm , 2009, ICIC.

[17]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[18]  Chia-Chu Chiang,et al.  A Parallel Apriori Algorithm for Frequent Itemsets Mining , 2006, Fourth International Conference on Software Engineering Research, Management and Applications (SERA'06).

[19]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[20]  Yi Jiang,et al.  A Hybrid Dynamical Evolutionary Algorithm for Classification Rule Discovery , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[21]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[22]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[23]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[24]  J.A. Anderson,et al.  Neurocomputing: Foundations of Research@@@Neurocomputing 2: Directions for Research , 1992 .

[25]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .