A hybrid FAM–CART model and its application to medical data classification

In this paper, a hybrid model consisting of the fuzzy ARTMAP (FAM) neural network and the classification and regression tree (CART) is formulated. FAM is useful for tackling the stability–plasticity dilemma pertaining to data-based learning systems, while CART is useful for depicting its learned knowledge explicitly in a tree structure. By combining the benefits of both models, FAM–CART is capable of learning data samples stably and, at the same time, explaining its predictions with a set of decision rules. In other words, FAM–CART possesses two important properties of an intelligent system, i.e., learning in a stable manner (by overcoming the stability–plasticity dilemma) and extracting useful explanatory rules (by overcoming the opaqueness issue). To evaluate the usefulness of FAM–CART, six benchmark medical data sets from the UCI repository of machine learning and a real-world medical data classification problem are used for evaluation. For performance comparison, a number of performance metrics which include accuracy, specificity, sensitivity, and the area under the receiver operation characteristic curve are computed. The results are quantified with statistical indicators and compared with those reported in the literature. The outcomes positively indicate that FAM–CART is effective for undertaking data classification tasks. In addition to producing good results, it provides justifications of the predictions in the form of a decision tree so that domain users can easily understand the predictions, therefore making it a useful decision support tool.

[1]  Boaz Lerner,et al.  Accurate and Fast Off and Online Fuzzy ARTMAP-Based Image Classification With Application to Genetic Abnormality Diagnosis , 2006, IEEE Transactions on Neural Networks.

[2]  Mansour Sheikhan,et al.  Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network , 2011, Neural Computing and Applications.

[3]  Yingtao Jiang,et al.  A multilayer perceptron-based medical decision support system for heart disease diagnosis , 2006, Expert Syst. Appl..

[4]  Xudong Zhao,et al.  Reliable fault diagnosis method using ensemble fuzzy ARTMAP based on improved Bayesian belief method , 2014, Neurocomputing.

[5]  Huibin Yu,et al.  Identifying changes in dissolved organic matter content and characteristics by fluorescence spectroscopy coupled with self-organizing map and classification and regression tree analysis during wastewater treatment. , 2014, Chemosphere.

[6]  Shereen M. El-Metwally,et al.  Decision tree classifiers for automated medical diagnosis , 2013, Neural Computing and Applications.

[7]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[8]  Yan-Ping Zhou,et al.  QSAR classification model for diverse series of antimicrobial agents using classification tree configured by modified particle swarm optimization , 2014 .

[9]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[10]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[11]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[12]  G.-P.K. Economou,et al.  A novel medical decision support system , 1996 .

[13]  CHEE PENG LIM,et al.  An Incremental Adaptive Network for On-line Supervised Learning and Probability Estimation , 1997, Neural Networks.

[14]  Chee Peng Lim,et al.  A Hybrid Neural Network System for Pattern Classification Tasks with Missing Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Dursun Delen,et al.  Predicting breast cancer survivability: a comparison of three data mining methods , 2005, Artif. Intell. Medicine.

[16]  Pasi Luukka,et al.  Feature selection using fuzzy entropy measures with similarity classifier , 2011, Expert Syst. Appl..

[17]  Esin Dogantekin,et al.  A new intelligent hepatitis diagnosis system: PCA-LSSVM , 2011, Expert Syst. Appl..

[18]  Kemal Polat,et al.  A new medical decision making system: Least square support vector machine (LSSVM) with Fuzzy Weighting Pre-processing , 2007, Expert Syst. Appl..

[19]  Chee Peng Lim,et al.  Motor fault detection and diagnosis using a hybrid FMM-CART model with online learning , 2016, J. Intell. Manuf..

[20]  Saroj Kumar Lenka,et al.  A novel image mining technique for classification of mammograms using hybrid feature selection , 2012, Neural Computing and Applications.

[21]  Wong-Ho Chow,et al.  Diet and lifestyle factors and risk of subtypes of esophageal and gastric cancers: classification tree analysis. , 2014, Annals of epidemiology.

[22]  Tomonobu Senjyu,et al.  A Novel Hybrid Approach Based on Wavelet Transform and Fuzzy ARTMAP Networks for Predicting Wind Farm Power Production , 2013 .

[23]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[24]  Constantin Zopounidis,et al.  Application of Quantitative Techniques for the Prediction of Bank Acquisition Targets , 2005, Series on Computers and Operations Research.

[25]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[26]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[27]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[28]  Seral Özsen,et al.  Attribute weighting via genetic algorithms for attribute weighted artificial immune system (AWAIS) and its application to heart disease and liver disorders problems , 2009, Expert Syst. Appl..

[29]  Mauro S. Tonelli-Neto,et al.  Robust fault diagnosis in power distribution systems based on fuzzy ARTMAP neural network-aided evidence theory , 2012 .

[30]  Eyke Hüllermeier,et al.  Why Fuzzy Decision Trees are Good Rankers , 2009, IEEE Transactions on Fuzzy Systems.

[31]  Okure Udo Obot,et al.  An experimental comparison of fuzzy logic and analytic hierarchy process for medical decision support systems , 2011, Comput. Methods Programs Biomed..

[32]  Hasan Bal,et al.  Comparing performances of backpropagation and genetic algorithms in the data classification , 2011, Expert Syst. Appl..

[33]  Jian Pei,et al.  2012- Data Mining. Concepts and Techniques, 3rd Edition.pdf , 2012 .

[34]  Shengyong Wang,et al.  Matrix decomposition based feature extraction for murmur classification. , 2012, Medical engineering & physics.

[35]  Aynur A. Dayanik Learning feature-projection based classifiers , 2012, Expert Syst. Appl..

[36]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[37]  Chee Peng Lim,et al.  An online pruning strategy for supervised ARTMAP-based neural networks , 2009, Neural Computing and Applications.

[38]  Chu Kiong Loo,et al.  Probabilistic ensemble Fuzzy ARTMAP optimization using hierarchical parallel genetic algorithms , 2014, Neural Computing and Applications.

[39]  Saroj Kumar Lenka,et al.  Texture-based features for classification of mammograms using decision tree , 2012, Neural Computing and Applications.

[40]  Paulo J. G. Lisboa,et al.  The Use of Artificial Neural Networks in Decision Support in Cancer: a Systematic Review , 2005 .

[41]  Ruxandra Stoean,et al.  Modeling medical decision making by support vector machines, explaining by rules of evolutionary algorithms with feature selection , 2013, Expert Syst. Appl..

[42]  Gary R. Weckman,et al.  Using artificial neural networks to enhance CART , 2012, Neural Computing and Applications.

[43]  Shiv O. Prasher,et al.  Measuring performance in precision agriculture: CART-A decision tree approach , 2006 .

[44]  Voula C. Georgopoulos,et al.  Fuzzy cognitive map architectures for medical decision support systems , 2008, Appl. Soft Comput..

[45]  Rosaria Romano,et al.  Classification trees in consumer studies for combining both product attributes and consumer preferences with additional consumer characteristics , 2014 .

[46]  Michael Margaliot,et al.  Are artificial neural networks white boxes? , 2005, IEEE Transactions on Neural Networks.

[47]  Yi-Ping Phoebe Chen,et al.  Computational intelligence for heart disease diagnosis: A medical knowledge driven approach , 2013, Expert Syst. Appl..

[48]  Gang Wang,et al.  A new hybrid method based on local fisher discriminant analysis and support vector machines for hepatitis disease diagnosis , 2011, Expert Syst. Appl..

[49]  Jayanta Basak,et al.  Interpretable hierarchical clustering by constructing an unsupervised decision tree , 2005, IEEE Transactions on Knowledge and Data Engineering.

[50]  Chu Kiong Loo,et al.  Accurate and reliable diagnosis and classification using probabilistic ensemble simplified fuzzy ARTMAP , 2005, IEEE Transactions on Knowledge and Data Engineering.

[51]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[52]  Zheru Chi,et al.  Intelligent characterization and evaluation of yarn surface appearance using saliency map analysis, wavelet transform and fuzzy ARTMAP neural network , 2012, Expert Syst. Appl..

[53]  Boualem Boashash,et al.  The bootstrap and its application in signal processing , 1998, IEEE Signal Process. Mag..