A new multiple classifier system for diagnosis of erythemato-squamous diseases based on rough set feature selection

The effectiveness of classification and recognition systems has improved in a great deal to help medical experts in diagnosing diseases as a second opinion. In this paper, we develop a diagnosis model based on a combination of classifiers, known as a multiple classifier system, to diagnose erythemato-squamous diseases. The proposed model consists of two major stages. First, rough set-based feature selection is used to select the optimal feature subset from the original feature set in order to both improve the accuracy and shorten the response time of our classification. Second, an ensemble of three classifiers including MLP, KNN and SVM is created to make their own decision on selected features independently; eventually, majority voting method is used to combine the obtained results from each classifier and return the final decision of this intelligent system as a diagnosis result. Experimental results show that the proposed ensemble model achieves 97.78% classification accuracy using 12 selected features of the erythemato-squamous diseases dataset taken from UCI (University of California at Irvine) machine learning database. Therefore, we can conclude that our proposed method is very promising compared to the previously reported results.

[1]  Z. Pawlak,et al.  Why rough sets? , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[2]  Dayou Liu,et al.  A support vector machine classifier with rough set-based feature selection for breast cancer diagnosis , 2011, Expert Syst. Appl..

[3]  Thomas G. Dietterich Machine-Learning Research , 1997, AI Mag..

[4]  Qiang Shen,et al.  Computational Intelligence and Feature Selection - Rough and Fuzzy Approaches , 2008, IEEE Press series on computational intelligence.

[5]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Abbas Z. Kouzani,et al.  Automated identification of lung nodules , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[7]  Z. Pawlak Rough set approach to knowledge-based decision support , 1997 .

[8]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[9]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[10]  Jason Bouhenguel,et al.  Improving Differential Diagnosis of Pathologically Similar Dermatological Conditions to Minimize Invasive Procedures , 2013 .

[11]  Mehmet Fatih Akay,et al.  Support vector machines combined with feature selection for breast cancer diagnosis , 2009, Expert Syst. Appl..

[12]  Inan Güler,et al.  Automatic detection of erthemato-squamous diseases using adaptive neuro- fuzzy inference systems. , 2005, Computers in biology and medicine.

[13]  S. Mutalib,et al.  Dermatology diagnosis with feature selection methods and artificial neural network , 2012, 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences.

[14]  Kenneth Revett,et al.  Evaluation of the Feature Space of an Erythematosquamous Dataset Using Rough Sets , 2009 .

[15]  Adel Al-Jumaily,et al.  Feature subset selection using differential evolution and a statistical repair mechanism , 2011, Expert Syst. Appl..

[16]  David S. Johnson,et al.  Approximation algorithms for combinatorial problems , 1973, STOC.

[17]  Shahenda Sarhan,et al.  A Hybrid Rough-Neuro model For Diagnosing Erythemato-Squamous Diseases , 2014 .

[18]  Mohammad Hossein Fazel Zarandi,et al.  Fuzzy rule based expert system for diagnosis of lung cancer , 2015, 2015 Annual Conference of the North American Fuzzy Information Processing Society (NAFIPS) held jointly with 2015 5th World Conference on Soft Computing (WConSC).

[19]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[20]  Latha Parthiban,et al.  An intelligent agent for detection of erythemato- squamous diseases using Co-active Neuro-Fuzzy Inference System and genetic algorithm , 2009, 2009 International Conference on Intelligent Agent & Multi-Agent Systems.

[21]  Abbas Z. Kouzani,et al.  Random forest based lung nodule classification aided by clustering , 2010, Comput. Medical Imaging Graph..

[22]  Safdar Ali,et al.  Prediction of human breast and colon cancers from imbalanced data using nearest neighbor and support vector machines , 2014, Comput. Methods Programs Biomed..

[23]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[24]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[25]  Seena,et al.  Prediction of Different Dermatological Conditions Using Naïve Bayesian Classification , 2014 .

[26]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[27]  Mohammad Hossein Fazel Zarandi,et al.  Lung nodule diagnosis from CT images based on ensemble learning , 2015, 2015 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB).

[28]  K. S. Ravichandran,et al.  Estimation of automatic detection of erythemato-squamous diseases through AdaBoost and its hybrid classifiers , 2015, Artificial Intelligence Review.

[29]  Elif Derya Übeyli,et al.  Automatic detection of erythemato-squamous diseases using adaptive neuro-fuzzy inference systems , 2004, Comput. Biol. Medicine.

[30]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[31]  H. Altay Güvenir,et al.  Learning differential diagnosis of erythemato-squamous diseases using voting feature intervals , 1998, Artif. Intell. Medicine.

[32]  A. H. El-Baz,et al.  Hybrid intelligent system-based rough set and ensemble classifier for breast cancer diagnosis , 2014, Neural Computing and Applications.

[33]  S. P. Rajagopalan,et al.  A Hybrid Feature Selection Method based on IGSBFS and Naïve Bayes for the Diagnosis of Erythemato - Squamous Diseases , 2012 .

[34]  Davar Giveki,et al.  Automatic detection of erythemato-squamous diseases using PSO-SVM based on association rules , 2013, Eng. Appl. Artif. Intell..

[35]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..