Novel associative classifier based on dynamic adaptive PSO: Application to determining candidates for thoracic surgery

Association rule mining is a data mining technique for discovering useful and novel patterns or relationships from databases. These rules are simple to infer and intuitive and can be easily used for classification in any domain that requires explanation for and investigation into how the classification works. Examples of such areas are medicine, agriculture, education, etc. For such a system to find wide adoptability, it should give output that is correct and comprehensible. The amount of data has been growing very fast and so has the search space of these problems. So we need to change traditional methods. This paper discusses a rule mining classifier called DA-AC (dynamic adaptive-associative classifier) which is based on a Dynamic Particle Swarm Optimizer. Due to its seeding method, exemplar selection, adaptive parameters, dynamic reconstruction of regions and velocity update, it avoids premature convergence and provides a better value in every dimension. Quality evaluation is done both for individual rules as well as entire rulesets. Experiments were conducted over fifteen benchmark datasets to evaluate performance of proposed algorithm in comparison with six other state-of-the-art non associative classifiers and eight associative classifiers. Results demonstrate competitive performance of proposed DA-AC while considering predictive accuracy and number of mined patterns as parameters. The method was then applied to predict life expectancy of post operative thoracic surgery patients.

[1]  Inés María Galván,et al.  A comparison between the Pittsburgh and Michigan approaches for the binary PSO algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[2]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[3]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[4]  Wynne Hsu,et al.  Integrating Classification and Association Rule Mining , 1998, KDD.

[5]  Alex Alves Freitas,et al.  Improving the interpretability of classification rules discovered by an ant colony algorithm , 2013, GECCO '13.

[6]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[7]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[8]  Farid Melgani,et al.  Classification of Electrocardiogram Signals With Support Vector Machines and Particle Swarm Optimization , 2008, IEEE Transactions on Information Technology in Biomedicine.

[9]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[10]  Charalampos Saridakis,et al.  Hybrid particle swarm optimization with mutation for optimizing industrial product lines: An application to a mixed solution space considering both discrete and continuous design variables , 2013 .

[11]  P. N. Suganthan,et al.  A dynamic neighborhood learning based particle swarm optimizer for global numerical optimization , 2012, Inf. Sci..

[12]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.

[13]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[14]  Sanjay Chawla,et al.  Using Significant, Positively Associated and Relatively Class Correlated Rules for Associative Classification of Imbalanced Datasets , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[15]  Ajith Abraham,et al.  A fuzzy-mining approach for solving rule based expert system unwieldiness in medical domain , 2013 .

[16]  Konstantinos E. Parsopoulos,et al.  UPSO: A Unified Particle Swarm Optimization Scheme , 2019, International Conference of Computational Methods in Sciences and Engineering 2004 (ICCMSE 2004).

[17]  Marek Lubicz,et al.  Boosted SVM for extracting rules from imbalanced data in application to prediction of the post-operative life expectancy in the lung cancer patients , 2014, Appl. Soft Comput..

[18]  Halina Kwaśnicka,et al.  Discovery of association rules from medical data -classical and evolutionary approaches , 2006, Ann. UMCS Informatica.

[19]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[20]  Gabriela Ochoa,et al.  A PSO/ACO approach to knowledge discovery in a pharmacovigilance context , 2009, GECCO '09.

[21]  Alex Alves Freitas,et al.  A New Sequential Covering Strategy for Inducing Classification Rules With Ant Colony Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[22]  Yi Wang,et al.  Particle Swarm Optimization (PSO) for the constrained portfolio optimization problem , 2011, Expert Syst. Appl..

[23]  Keiichiro Yasuda,et al.  Dynamic parameter tuning of particle swarm optimization , 2006 .

[24]  Hamid Soltanian-Zadeh,et al.  Medical Data Mining using Particle Swarm Optimization for Temporal Lobe Epilepsy , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[25]  Mehmet Fatih Tasgetiren,et al.  A discrete artificial bee colony algorithm for the total flowtime minimization in permutation flow shops , 2011, Inf. Sci..

[26]  Mounir Boukadoum,et al.  Particle swarm classification: A survey and positioning , 2013, Pattern Recognit..

[27]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[28]  Dimitris Kanellopoulos,et al.  Association Rules Mining: A Recent Overview , 2006 .

[29]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[30]  Alex A. Freitas,et al.  A hybrid PSO/ACO algorithm for discovering classification rules in data mining , 2008 .

[31]  Franz Oppacher,et al.  Techniques for evolutionary rule discovery in data mining , 2009, 2009 IEEE Congress on Evolutionary Computation.

[32]  Osmar R. Zaïane,et al.  Text document categorization by term association , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[33]  Sengul Dogan,et al.  Diagnosing Hyperlipidemia Using Association Rules , 2008 .

[34]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[35]  Mohd Afizi Mohd Shukran,et al.  Artificial bee colony based data mining algorithms for classification tasks , 2011 .

[36]  Mehmet Fatih Tasgetiren,et al.  Dynamic multi-swarm particle swarm optimizer with harmony search , 2011, Expert Syst. Appl..

[37]  Adel M. Alimi,et al.  The multi-objective hybridization of particle swarm optimization and fuzzy ant colony optimization , 2014, J. Intell. Fuzzy Syst..

[38]  Carlos Ordonez Comparing association rules and decision trees for disease prediction , 2006, HIKM '06.

[39]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[40]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[41]  Yu Liu,et al.  Rule Discovery with Particle Swarm Optimization , 2004, AWCC.

[42]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[43]  Mahamed G. H. Omran,et al.  Barebones particle swarm methods for unsupervised image classification , 2007, 2007 IEEE Congress on Evolutionary Computation.

[44]  Salima Nebti,et al.  Handwritten Digits Recognition Based on Swarm Optimization Methods , 2010, NDT.

[45]  Eloy Gonzales,et al.  Combination of Two Evolutionary Methods for Mining Association Rules in Large and Dense Databases , 2009, J. Adv. Comput. Intell. Intell. Informatics.

[46]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[47]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[48]  Lale Özbakir,et al.  Classifying defect factors in fabric production via DIFACONN-miner: A case study , 2011, Expert Syst. Appl..

[49]  María José del Jesús,et al.  Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data-sets , 2009, Int. J. Approx. Reason..

[50]  Noorhaniza Wahid A Novel Image Classification Algorithm Using Swarm-Based Technique for Image Database , 2011, UCMA.

[51]  Veenu Mangat Natural Intelligence Based Automatic Knowledge Discovery for Medical Practitioners , 2011 .

[52]  Jian Pei,et al.  CMAR: accurate and efficient classification based on multiple class-association rules , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[53]  Gang Xu,et al.  An adaptive parameter tuning of particle swarm optimization algorithm , 2013, Appl. Math. Comput..

[54]  Magdalene Marinaki,et al.  Ant colony and particle swarm optimization for financial classification problems , 2009, Expert Syst. Appl..

[55]  Andrew Lim,et al.  Example-based learning particle swarm optimization for continuous optimization , 2012, Information Sciences.

[56]  Zhijian Wu,et al.  Enhancing particle swarm optimization using generalized opposition-based learning , 2011, Inf. Sci..

[57]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[58]  Moncef Gabbouj,et al.  Multi-dimensional particle swarm optimization for dynamic environments , 2008, 2008 International Conference on Innovations in Information Technology.

[59]  Chengqi Zhang,et al.  Genetic algorithm-based strategy for identifying association rules without specifying actual minimum support , 2009, Expert Syst. Appl..

[60]  Fadi A. Thabtah,et al.  A review of associative classification mining , 2007, The Knowledge Engineering Review.

[61]  Jilles Vreeken,et al.  Krimp: mining itemsets that compress , 2011, Data Mining and Knowledge Discovery.

[62]  Ratna Babu Chinnam,et al.  mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification , 2011, Inf. Sci..