Topological Kernel Bayesian ARTMAP

This paper proposes a robust supervised learning model based on ARTMAP framework by incorporating a topological clustering algorithm. The noise tolerance is one of the essential abilities for supervised learning because the supervised data from the practical environment may contain a certain level of noise information. The simulation experiment focuses on the supervised learning with incorrect supervised data for classification. Specifically, incorrect supervised data, which is defined by intentionally changing label data with an arbitrary ratio, is utilized in the learning sequence. The results show that the proposed model achieves superior noise tolerance ability comparing with the typical and state-of-the-art models of ARTMAP.

[1]  Boaz Lerner,et al.  The Bayesian ARTMAP , 2007, IEEE Transactions on Neural Networks.

[2]  Katya Scheinberg,et al.  Efficient SVM Training Using Low-Rank Kernel Representations , 2002, J. Mach. Learn. Res..

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[5]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[6]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[7]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[8]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[9]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[10]  Le Song,et al.  Kernel Bayes' rule: Bayesian inference with positive definite kernels , 2013, J. Mach. Learn. Res..

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[13]  James R. Williamson,et al.  Gaussian ARTMAP: A Neural Network for Fast Incremental Learning of Noisy Multidimensional Maps , 1996, Neural Networks.

[14]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[15]  Melih Inal,et al.  Comparison of neural network application for fuzzy and ANFIS approaches for multi-criteria decision making problems , 2014, Appl. Soft Comput..

[16]  Chu Kiong Loo,et al.  Kernel Bayesian ART and ARTMAP , 2018, Neural Networks.

[17]  Christopher D. Manning,et al.  Advances in natural language processing , 2015, Science.