A reinforced fuzzy ARTMAP model for data classification

This paper presents a hybrid model consisting of fuzzy ARTMAP (FAM) and reinforcement learning (RL) for tackling data classification problems. RL is used as a feedback mechanism to reward the prototype nodes of data samples established by FAM. Specifically, Q-learning is adopted to develop the hybrid model known as QFAM. A Q-value is assigned to each prototype node, which is updated incrementally based on the prediction accuracy of the node pertaining to each data sample. To evaluate the performance of the proposed QFAM model, a series of experiments with benchmark problems and a real-world case study, i.e., human motion recognition, are conducted. The bootstrap method is used to quantify the results with the 95% confidence interval estimates. The results are also compared with those from FAM as well as other models reported in the literature. The outcomes indicate the effectiveness of QFAM in tackling data classification tasks.

[1]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[2]  Marzuki Khalid,et al.  Evolutionary Fuzzy ARTMAP Neural Networks for Classification of Semiconductor Defects , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[4]  Hon Keung Kwan,et al.  Fuzzy classifications using fuzzy inference networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[5]  CHEE PENG LIM,et al.  An Incremental Adaptive Network for On-line Supervised Learning and Probability Estimation , 1997, Neural Networks.

[6]  Shyi-Ming Chen,et al.  Fuzzy classification systems based on fuzzy information gain measures , 2009, Expert Syst. Appl..

[7]  Chee Peng Lim,et al.  A Hybrid Neural Network System for Pattern Classification Tasks with Missing Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Tielin Shi,et al.  A novel fault diagnosis method of bearing based on improved fuzzy ARTMAP and modified distance discriminant technique , 2009, Expert Syst. Appl..

[9]  Hasan Bal,et al.  Comparing performances of backpropagation and genetic algorithms in the data classification , 2011, Expert Syst. Appl..

[10]  Chee Peng Lim,et al.  A multi-objective evolutionary algorithm-based ensemble optimizer for feature selection and classification with neural network models , 2014, Neurocomputing.

[11]  Se-Young Oh,et al.  TD based reinforcement learning using neural networks in control problems with continuous action space , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[12]  Hiok Chai Quek,et al.  R-POPTVR: A Novel Reinforcement-Based POPTVR Fuzzy Neural Network for Pattern Classification , 2009, IEEE Transactions on Neural Networks.

[13]  Chee Peng Lim,et al.  A review of online learning in supervised neural networks , 2014, Neural Computing and Applications.

[14]  Gerald Tesauro,et al.  TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play , 1994, Neural Computation.

[15]  Theodore Lim,et al.  Edge-based identification of DP-features on free-form solids , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Moncef Gabbouj,et al.  Training Radial Basis Function Neural Networks for Classification via Class-Specific Clustering , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Friedhelm Schwenker,et al.  Neural Network Ensembles in Reinforcement Learning , 2013, Neural Processing Letters.

[18]  Hwa Jen Yap,et al.  A Truly Online Learning Algorithm using Hybrid Fuzzy ARTMAP and Online Extreme Learning Machine for Pattern Classification , 2015, Neural Processing Letters.

[19]  Ruowei Zhou,et al.  POPFNN: A Pseudo Outer-product Based Fuzzy Neural Network , 1996, Neural Networks.

[20]  Graham Leedham,et al.  Reinforcement learning combined with a fuzzy adaptive learning control network (FALCON-R) for pattern classification , 2005, Pattern Recognit..

[21]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..

[22]  James R. Williamson,et al.  Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps , 1996, Neural Networks.

[23]  Chee Peng Lim,et al.  Modified Fuzzy ARTMAP Approaches Bayes Optimal Classification Rates: An Empirical Demonstration , 1997, Neural Networks.

[24]  Sam Kwong,et al.  Incorporating Diversity and Informativeness in Multiple-Instance Active Learning , 2017, IEEE Transactions on Fuzzy Systems.

[25]  Aristidis Likas.  Reinforcement Learning Using the Stochastic Fuzzy Min–Max Neural Network , 2004, Neural Processing Letters.

[26]  Mansooreh Mollaghasemi,et al.  GFAM: A Genetic Algorithm Optimization of Fuzzy ARTMAP , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[27]  Hossein Nezamabadi-pour,et al.  Rule inducing by fuzzy lattice reasoning classifier based on metric distances (FLRC-MD) , 2014, Appl. Soft Comput..

[28]  Chee Peng Lim,et al.  An Enhanced Fuzzy Min–Max Neural Network for Pattern Classification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[29]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[30]  Konstantinos Blekas,et al.  A reinforcement learning approach based on the fuzzy min-max neural network , 2004, Neural Processing Letters.

[31]  Nor Ashidi Mat Isa,et al.  Modified Recursive Least Squares algorithm to train the Hybrid Multilayered Perceptron (HMLP) network , 2010, Appl. Soft Comput..

[32]  Anan Banharnsakun,et al.  Hybrid ABC-ANN for pavement surface distress detection and classification , 2017, Int. J. Mach. Learn. Cybern..

[33]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[34]  Chee Peng Lim,et al.  Fuzzy ARTMAP dynamic decay adjustment: An improved fuzzy ARTMAP model with a conflict resolving facility , 2008, Appl. Soft Comput..

[35]  Hongbing Ji,et al.  TPPFAM: Use of threshold and posterior probability for category reduction in fuzzy ARTMAP , 2014, Neurocomputing.

[36]  Chee Peng Lim,et al.  An incremental meta-cognitive-based scaffolding fuzzy neural network , 2016, Neurocomputing.

[37]  Mohammad Hassan Moradi,et al.  A Hybrid Higher Order Neural Classifier for handling classification problems , 2011, Expert Syst. Appl..

[38]  Witold Pedrycz,et al.  A Study on Relationship Between Generalization Abilities and Fuzziness of Base Classifiers in Ensemble Learning , 2015, IEEE Transactions on Fuzzy Systems.

[39]  Xizhao Wang,et al.  Impact of fuzziness categorization on divide and conquer strategy for instance selection , 2017, J. Intell. Fuzzy Syst..

[40]  Ran Wang,et al.  Discovering the Relationship Between Generalization and Uncertainty by Incorporating Complexity of Classification , 2018, IEEE Transactions on Cybernetics.

[41]  Xiao-Yun Sun,et al.  Improved probabilistic neural network PNN and its application to defect recognition in rock bolts , 2016, Int. J. Mach. Learn. Cybern..

[42]  P. K. Simpson,et al.  Fuzzy min-max neural networks , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[43]  Vijaykumar Gullapalli,et al.  A stochastic reinforcement learning algorithm for learning real-valued functions , 1990, Neural Networks.

[44]  Chee Peng Lim,et al.  Online Motor Fault Detection and Diagnosis Using a Hybrid FMM-CART Model , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Steven W. Su,et al.  Electromyography (EMG) based Classification of Neuromuscular Disorders using Multi-Layer Perceptron , 2015 .

[46]  Siu-Yeung Cho,et al.  A Modified Memory-Based Reinforcement Learning Method for Solving POMDP Problems , 2011, Neural Processing Letters.

[47]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[48]  Andrew G. Barto,et al.  Improving Elevator Performance Using Reinforcement Learning , 1995, NIPS.

[49]  Stephen Grossberg,et al.  A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems , 1995, IEEE Trans. Neural Networks.

[50]  Mansour Sheikhan,et al.  Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network , 2011, Neural Computing and Applications.

[51]  Chee Peng Lim,et al.  Evolutionary Fuzzy ARTMAP Neural Networks and their Applications to Fault Detection and Diagnosis , 2010, Neural Processing Letters.

[52]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[53]  B. Efron.  Bootstrap Methods: Another Look at the Jackknife , 1979 .

[54]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[55]  Chee Peng Lim,et al.  Segmentation of gray scale image based on intuitionistic fuzzy sets constructed from several membership functions , 2014, Pattern Recognit..

[56]  Robert H. Sloan,et al.  Reinforcement Learning and Function Approximation , 2005, FLAIRS.