A hybrid FAM‐CART model for online data classification

In this paper, an online soft computing model based on an integration between the fuzzy ARTMAP (FAM) neural network and the classification and regression tree (CART) for undertaking data classification problems is presented. Online FAM network is useful for conducting incremental learning with data samples, whereas the CART model prevails in depicting the knowledge learned explicitly in a tree structure. Capitalizing on their respective advantages, the hybrid FAM‐CART model is capable of learning incrementally while explaining its predictions with knowledge elicited from data samples. To evaluate the usefulness of FAM‐CART, 2 sets of benchmark experiments with a total of 12 problems are used in both offline and online learning modes. The results are examined and compared with those published in the literature. The experimental outcome positively indicates that the online FAM‐CART model is useful for tackling data classification tasks. In addition, a decision tree is produced to allow users in understanding the predictions, which is an important property of the hybrid FAM‐CART model in supporting decision‐making tasks.

[1]  Masoud Yaghini,et al.  GOFAM: a hybrid neural network classifier combining fuzzy ARTMAP and genetic algorithm , 2011, Artificial Intelligence Review.

[2]  Chee Peng Lim,et al.  Fuzzy ARTMAP dynamic decay adjustment: An improved fuzzy ARTMAP model with a conflict resolving facility , 2008, Appl. Soft Comput..

[3]  Patrick Webb,et al.  Classification and Regression Trees, CART: A User Manual For Identifying Indicators of Vulnerability to Famine And Chronic Food Insecurity , 1999 .

[4]  Blum,et al.  [IEEE Fifth International Conference on Hybrid Intelligent Systems (HIS\'05) - Rio de Janeiro, Brazil (2005.11.6-2005.11.9)] Fifth International Conference on Hybrid Intelligent Systems (HIS\'05) - Training feed-forward neural networks with ant colony optimization: an application to pattern classifi , 2005 .

[5]  Vadlamani Ravi,et al.  Support vector regression based hybrid rule extraction methods for forecasting , 2010, Expert Syst. Appl..

[6]  Vassilios Petridis,et al.  Fuzzy Lattice Neurocomputing (FLN) models , 2000, Neural Networks.

[7]  Ahmad A. Kardan,et al.  A novel approach to hybrid recommendation systems based on association rules mining for content recommendation in asynchronous discussion groups , 2013, Inf. Sci..

[8]  Madan Gopal,et al.  A hybrid SVM based decision tree , 2010, Pattern Recognit..

[9]  Wagner Peron Ferreira,et al.  Transient stability analysis of electric energy systems via a fuzzy ART-ARTMAP neural network , 2006 .

[10]  Iulian B. Ciocoiu.  Hybrid Feedforward Neural Networks for Solving Classification Problems , 2004, Neural Processing Letters.

[11]  Ronen Feldman,et al.  TEG—a hybrid approach to information extraction , 2005, Knowledge and Information Systems.

[12]  Hayri Volkan Agun,et al.  A hybrid approach for extracting informative content from web pages , 2013, Inf. Process. Manag..

[13]  Jianzhou Wang,et al.  An efficient approach for electric load forecasting using distributed ART (adaptive resonance theory , 2011 .

[14]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[15]  R. J. Kuo,et al.  Evolutionary Algorithm‐Based Radial Basis Function Neural Network Training for Industrial Personal Computer Sales Forecasting , 2017, Comput. Intell..

[16]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[17]  CHEE PENG LIM,et al.  An Incremental Adaptive Network for On-line Supervised Learning and Probability Estimation , 1997, Neural Networks.

[18]  Chee Peng Lim,et al.  A Hybrid Neural Network System for Pattern Classification Tasks with Missing Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Kadir Alpaslan Demir,et al.  An Empirical Comparison of Search Approaches for Moving Agents , 2017, Comput. Intell..

[20]  Chee Peng Lim,et al.  Motor fault detection and diagnosis using a hybrid FMM-CART model with online learning , 2016, J. Intell. Manuf..

[21]  Tomonobu Senjyu,et al.  A Novel Hybrid Approach Based on Wavelet Transform and Fuzzy ARTMAP Networks for Predicting Wind Farm Power Production , 2013 .

[22]  Chee Peng Lim,et al.  Patient admission prediction using a pruned fuzzy min–max neural network with rule extraction , 2014, Neural Computing and Applications.

[23]  Masoud Yaghini,et al.  HIOPGA : A New Hybrid Metaheuristic Algorithm to Train Feedforward Neural Networks for Prediction , 2011 .

[24]  Mohammed Ramdani,et al.  A hybrid decision trees-adaptive neuro-fuzzy inference system in prediction of anti-HIV molecules , 2011, Expert Syst. Appl..

[25]  Manjeevan Seera,et al.  Detection and diagnosis of broken rotor bars and eccentricity faults in induction motors using the Fuzzy Min-Max neural network , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[26]  Abdulhamit Subasi,et al.  Breast cancer diagnosis using GA feature selection and Rotation Forest , 2015, Neural Computing and Applications.

[27]  Ibrahim F. Moawad,et al.  A New Hybrid Case-Based Reasoning Approach for Medical Diagnosis Systems , 2014, Journal of Medical Systems.

[28]  Enrique Romero,et al.  Comparing error minimized extreme learning machines and support vector sequential feed-forward neural networks , 2012, Neural Networks.

[29]  Madjid Tavana,et al.  A hybrid fuzzy rule-based multi-criteria framework for sustainable project portfolio selection , 2013, Inf. Sci..

[30]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[31]  Novruz Allahverdi,et al.  Extracting rules for classification problems: AIS based approach , 2009, Expert Syst. Appl..

[32]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[33]  Kwai-Sang Chin,et al.  A hybrid OLAP-association rule mining based quality management system for extracting defect patterns in the garment industry , 2013, Expert Syst. Appl..

[34]  R. Wehrens,et al.  Bootstrapping principal component regression models , 1997 .

[35]  Randall S. Sexton,et al.  Reliable classification using neural networks: a genetic algorithm and backpropagation comparison , 2000, Decis. Support Syst..

[36]  Gary R. Weckman,et al.  Using artificial neural networks to enhance CART , 2012, Neural Computing and Applications.

[37]  Carlos R. Minussi,et al.  Electric load forecasting using a fuzzy ART&ARTMAP neural network , 2005, Appl. Soft Comput..

[38]  Ivanoe De Falco,et al.  Differential Evolution for automatic rule extraction from medical databases , 2013, Appl. Soft Comput..

[39]  Paras Mandal,et al.  A novel hybrid approach using wavelet, firefly algorithm, and fuzzy ARTMAP for day-ahead electricity price forecasting , 2013, IEEE Transactions on Power Systems.

[40]  Masoud Yaghini,et al.  A hybrid algorithm for artificial neural network training , 2013, Eng. Appl. Artif. Intell..

[41]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[42]  Christian Blum,et al.  Training feed-forward neural networks with ant colony optimization: an application to pattern classification , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[43]  Hua Xu,et al.  Implicit feature identification via hybrid association rule mining , 2013, Expert Syst. Appl..

[44]  George A. Papakostas,et al.  Lattice Computing Extension of the FAM Neural Classifier for Human Facial Expression Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[45]  TWO-WEEK Loan COpy,et al.  University of California , 1886, The American journal of dental science.

[46]  Lutz Prechelt,et al.  A Set of Neural Network Benchmark Problems and Benchmarking Rules , 1994 .

[47]  Chee Peng Lim,et al.  A hybrid FAM–CART model and its application to medical data classification , 2015, Neural Computing and Applications.

[48]  Mansour Sheikhan,et al.  Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network , 2011, Neural Computing and Applications.

[49]  Chee Peng Lim,et al.  Evolutionary Fuzzy ARTMAP Neural Networks and their Applications to Fault Detection and Diagnosis , 2010, Neural Processing Letters.

[50]  Chee Peng Lim,et al.  A hybrid neural network model for rule generation and its application to process fault detection and diagnosis , 2007, Eng. Appl. Artif. Intell..

[51]  Enrique Alba,et al.  Training Neural Networks with GA Hybrid Algorithms , 2004, GECCO.