Parallel fuzzy rule learning using an ACO-based algorithm for medical data mining

Ant Colony Optimization (ACO), an inspired algorithm from nature, has been successfully applied to classification tasks of data mining in recent years. This paper proposes a rule-based system for medical data mining by using a combination of ACO and fuzzy set theory, named FACO-Miner. FACO-Miner utilizes an ACO algorithm to learn a set of fuzzy rules from labeled data in parallel manner which causes to reduce the computation time to build classifier. To detect the Don't Care (DC) attributes we have proposed a new heuristic information formula which measures the uniformity of attributes domain to find DC probability. Also, FACO-Miner has some new features that make it different from existing classifiers based on ACO meta-heuristic. To classify test samples we have defined the new fuzzy reasoning method based on averaging which takes account both the number of rules and the covering value to classify the input samples. To evaluate the performance of FACO-Miner, we use several well-known medical data sets from UCI repository. Our experiments have confirmed that FACO-Miner leads us to significant results and outperforms several famous methods in classification accuracy for medical classification.

[1]  Mostafa Fathi Ganji,et al.  Using fuzzy ant colony optimization for diagnosis of diabetes disease , 2010, 2010 18th Iranian Conference on Electrical Engineering.

[2]  Mohammad Saniee Abadeh,et al.  Induction of Fuzzy Classification Systems Using Evolutionary ACO-Based Algorithms , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[3]  Ian H. Witten,et al.  Data Mining: Practical Machine Learning Tools and Techniques, 3/E , 2014 .

[4]  Hisao Ishibuchi,et al.  Adaptive fuzzy rule-based classification systems , 1996, IEEE Trans. Fuzzy Syst..

[5]  Magne Setnes,et al.  Compact and transparent fuzzy models and classifiers through iterative complexity reduction , 2001, IEEE Trans. Fuzzy Syst..

[6]  Ivan Bratko,et al.  Machine Learning and Data Mining; Methods and Applications , 1998 .

[7]  Hussein A. Abbass,et al.  Classification rule discovery with ant colony optimization , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[8]  Gail A. Carpenter,et al.  ARTMAP-IC and medical diagnosis: Instance counting and inconsistent cases , 1998, Neural Networks.

[9]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[10]  Hisao Ishibuchi,et al.  Voting in fuzzy rule-based systems for pattern classification problems , 1999, Fuzzy Sets Syst..

[11]  Kemal Polat,et al.  A cascade learning system for classification of diabetes disease: Generalized Discriminant Analysis and Least Square Support Vector Machine , 2008, Expert Syst. Appl..

[12]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[13]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[14]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[15]  Esin Dogantekin,et al.  An intelligent diagnosis system for diabetes on Linear Discriminant Analysis and Adaptive Network Based Fuzzy Inference System: LDA-ANFIS , 2010, Digit. Signal Process..

[16]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Hamid Mohamadi,et al.  Data mining with a simulated annealing based fuzzy classification system , 2008, Pattern Recognit..

[18]  Bo Liu,et al.  Density-Based Heuristic for Rule Discovery with Ant-Miner , 2002 .

[19]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[20]  Mohammad Saniee Abadeh,et al.  Using fuzzy ant colony optimization for diagnosis of diabetes disease , 2010, ICEE 2010.

[21]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Marco Dorigo,et al.  Ant colony optimization theory: A survey , 2005, Theor. Comput. Sci..

[23]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[24]  Ian Witten,et al.  Data Mining , 2000 .

[25]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..