Fuzzy ARTMAP Network And Clustering For Streaming Classification Under Emerging New Classes

Streaming classification with emerging new classes is a challenging problem receiving extensive attention. To date, most approaches simply detect novel classes without further recognizing them, and ignore conceptual drift and conceptual evolution problem. Therefore, in this paper, we propose an effective semi-supervised framework that combines ARTMAP neural network and clustering method to detect and identify simultaneously multiple known and unknown classes in data streams and update the network online. Experiments have been conducted on four benchmark datasets with different data forms including MNIST, CIFAR10, network attack analysis, and geospatial information of forests. The empirical evaluation shows effectiveness of the proposed approach, whose results are much better than many previous studies.

[1]  Yang Yu,et al.  Learning with Augmented Class by Exploiting Unlabeled Data , 2014, AAAI.

[2]  Hwa Jen Yap,et al.  A Truly Online Learning Algorithm using Hybrid Fuzzy ARTMAP and Online Extreme Learning Machine for Pattern Classification , 2015, Neural Processing Letters.

[3]  Michèle Sebag,et al.  Data Streaming with Affinity Propagation , 2008, ECML/PKDD.

[4]  Chee Peng Lim,et al.  A hybrid neural network classifier combining ordered fuzzy ARTMAP and the dynamic decay adjustment algorithm , 2008, Soft Comput..

[5]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[6]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[7]  Christoforos Anagnostopoulos,et al.  Online linear and quadratic discriminant analysis with adaptive forgetting for streaming classification , 2012, Stat. Anal. Data Min..

[8]  Alessandro Laio,et al.  Clustering by fast search and find of density peaks , 2014, Science.

[9]  Bin Zhou,et al.  Multi-window based ensemble learning for classification of imbalanced streaming data , 2015, World Wide Web.

[10]  Laurence T. Yang,et al.  An Incremental CFS Algorithm for Clustering Large Data in Industrial Internet of Things , 2017, IEEE Transactions on Industrial Informatics.

[11]  T. T. Mirnalinee,et al.  Streaming data classification , 2016, 2016 International Conference on Recent Trends in Information Technology (ICRTIT).

[12]  Meiguo Gao,et al.  Adaptive Matrix Sketching and Clustering for Semisupervised Incremental Learning , 2018, IEEE Signal Processing Letters.

[13]  Zhi-Hua Zhou,et al.  Classification Under Streaming Emerging New Classes: A Solution Using Completely-Random Trees , 2016, IEEE Transactions on Knowledge and Data Engineering.

[14]  Stephen Grossberg,et al.  A What-and-Where fusion neural network for recognition and tracking of multiple radar emitters , 2001, Neural Networks.

[15]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[16]  Hwa Jen Yap,et al.  A new hybrid fuzzy ARTMAP and radial basis function neural network with online pruning strategy , 2016, 2016 7th IEEE Control and System Graduate Research Colloquium (ICSGRC).

[17]  Zhi-Hua Zhou,et al.  Streaming Classification with Emerging New Class by Class Matrix Sketching , 2017, AAAI.

[18]  Chu Kiong Loo,et al.  Probabilistic ensemble Fuzzy ARTMAP optimization using hierarchical parallel genetic algorithms , 2014, Neural Computing and Applications.

[19]  Latifur Khan,et al.  SAND: Semi-Supervised Adaptive Novel Class Detection and Classification over Data Stream , 2016, AAAI.

[20]  Massimo Piccardi,et al.  An Infinite Adaptive Online Learning Model for Segmentation and Classification of Streaming Data , 2014, 2014 22nd International Conference on Pattern Recognition.

[21]  Jiwon Kim,et al.  Continual Learning with Deep Generative Replay , 2017, NIPS.

[22]  Razvan Pascanu,et al.  Overcoming catastrophic forgetting in neural networks , 2016, Proceedings of the National Academy of Sciences.

[23]  Bhavani M. Thuraisingham,et al.  Classification and Novel Class Detection in Concept-Drifting Data Streams under Time Constraints , 2011, IEEE Transactions on Knowledge and Data Engineering.

[24]  Lorenzo Bruzzone,et al.  Incremental and Decremental Affinity Propagation for Semisupervised Clustering in Multispectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.