Estimation of automatic detection of erythemato-squamous diseases through AdaBoost and its hybrid classifiers

This paper focuses on efficient techniques based on AdaBoost and its hybrid (AdaBoost-SVM) classifiers for an automatic detection of the erythemato-squamous diseases (ESD). The classification of ESD requires an enormous amount of computational effort, as all the features of the diseases have more than 90 % commonality. Some of the approaches reported in literature are fuzzy logic, artificial neural networks, neuro-fuzzy models and support vector machine. Recently, AdaBoost and its hybrid algorithms are widely used to enhance the accuracy of the learning algorithms. In this paper, we propose AdaBoost and its hybrid algorithms for diagnosis of erythemato-squamous diseases for the first time. User-friendly-interface is designed to assist dermatologists to estimate the ESD with the help of 34 features includes patient’s histopathological and clinical data sets. Efficient interface design is based on the following steps: (1) feature selection for all the 34 parameters involved in the erythemato-squamous disease is done using association rule based Apriori algorithm, (2) association rules are used to find $$\upalpha \%$$α% of transactions (diseases) to meet $$\upbeta \%$$β% of the features of the diseases, (3) support value of all the subset of $$\upalpha $$α transaction from $$\upalpha \%$$α% of transactions is found and the dominant subset is found using Apriori algorithm, and (4) AdaBoost and its hybrid classifiers are used to classify the diseases. In this paper, the real, modest, gentle and hybrid AdaBoost algorithms are implemented and tested with the dataset of 366 patients. The data preprocessing reduces the dimensionality of the dataset and improves the time complexity of the estimation of the diseases. Proposed methodologies are proved as a potential solution for diagnosing ESD with significant improvement in computational time and accuracy compared to other models discussed in the recent literature.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  Gopinath Ganapathy,et al.  An efficient approach to an automatic detection of erythemato-squamous diseases , 2013, Neural Computing and Applications.

[3]  Elif Derya Übeyli,et al.  Automatic detection of erythemato-squamous diseases using adaptive neuro-fuzzy inference systems , 2004, Comput. Biol. Medicine.

[4]  Yoav Freund,et al.  Game theory, on-line prediction and boosting , 1996, COLT '96.

[5]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[6]  Howard B. Demuth,et al.  Neutral network toolbox for use with Matlab , 1995 .

[7]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[8]  K. S. Ravichandran,et al.  FELM based intelligent optimal switching capacitor placement , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[9]  Elif Derya íbeyli.  Multiclass support vector machines for diagnosis of erythemato-squamous diseases , 2008 .

[10]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[11]  Alexander Vezhnevets,et al.  ‘ Modest AdaBoost ’ – Teaching AdaBoost to Generalize Better , 2005 .

[12]  B. Efron.  The jackknife, the bootstrap, and other resampling plans , 1987 .

[13]  Edwin K. P. Chong,et al.  On relative convergence properties of principal component analysis algorithms , 1998, IEEE Trans. Neural Networks.

[14]  Elif Derya íbeyli.  Combined neural networks for diagnosis of erythemato-squamous diseases , 2009 .

[15]  Aníbal R. Figueiras-Vidal,et al.  Boosting by weighting critical and erroneous samples , 2006, Neurocomputing.

[16]  Elif Derya.  Automatic detection of erythemato-squamous diseases using adaptive neuro-fuzzy inference systems , 2005 .

[17]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[18]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[19]  Jin Xu,et al.  Adaboost with SVM-Based Classifier for the Classification of Brain Motor Imagery Tasks , 2011, HCI.

[20]  H. A. Güvenira,et al.  An expert system for the differential diagnosis of erythemato-squamous diseases , 1999 .

[21]  Loris Nanni,et al.  An ensemble of classifiers for the diagnosis of erythemato-squamous diseases , 2006, Neurocomputing.

[22]  Latha Parthiban,et al.  An intelligent agent for detection of erythemato- squamous diseases using Co-active Neuro-Fuzzy Inference System and genetic algorithm , 2009, 2009 International Conference on Intelligent Agent & Multi-Agent Systems.

[23]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[24]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[25]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[26]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[27]  Jyh-Shing Roger Jang,et al.  Self-learning fuzzy controllers based on temporal backpropagation , 1992, IEEE Trans. Neural Networks.

[28]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[29]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[30]  Piero P. Bonissone,et al.  SOFT COMPUTING APPLICATIONS IN PHM , 2008 .

[31]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[32]  Davar Giveki,et al.  Detection of erythemato-squamous diseases using AR-CatfishBPSO-KSVM , 2011 .

[33]  S. P. Rajagopalan,et al.  A Hybrid Feature Selection Method based on IGSBFS and Naïve Bayes for the Diagnosis of Erythemato - Squamous Diseases , 2012 .

[34]  Elif Derya Übeyli.  Combined neural networks for diagnosis of erythemato-squamous diseases , 2009, Expert Syst. Appl..

[35]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[36]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[37]  Mark Beale,et al.  Neural Network Toolbox™ User's Guide , 2015 .

[38]  Lakhmi C. Jain,et al.  Soft Computing Applications - Proceedings of the 6th International Workshop Soft Computing Applications, SOFA 2014, Volume 1, Timisoara, Romania, 24-26 July 2014 , 2016, SOFA.

[39]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[40]  H. Altay Güvenir,et al.  Learning differential diagnosis of erythemato-squamous diseases using voting feature intervals , 1998, Artif. Intell. Medicine.

[41]  Rakesh Agrawal,et al.  Parallel Mining of Association Rules , 1996, IEEE Trans. Knowl. Data Eng..

[42]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[43]  Giovanna Castellano,et al.  Diagnosis of dermatological diseases by a neuro-fuzzy system , 2003, EUSFLAT Conf..

[44]  Weixin Xie,et al.  Novel Hybrid Feature Selection Algorithms for Diagnosing Erythemato-Squamous Diseases , 2012, HIS.

[45]  Elif Derya Übeyli,et al.  Automatic Detection of Erythemato-Squamous Diseases Using k-Means Clustering , 2010, Journal of Medical Systems.