A semisupervised learning model based on fuzzy min-max neural networks for data classification

Abstract Semisupervised learning (SSL) models are useful for undertaking classification problems with a small set of labeled samples and a large number of unlabeled samples. In this regard, the family of fuzzy min–max (FMM) neural networks offers the capability of online learning for addressing both unsupervised and supervised problems. As such, this paper proposes a novel two-stage SSL model based on FMM networks, denoted SSL–FMM. The first stage employs the unlabeled samples to generate a number of hyperboxes using the unsupervised FMM algorithm, while the second stage uses the labeled samples to associate the generated hyperboxes with their target classes using the supervised FMM algorithm. In addition, a neighborhood-labeling mechanism based on the Euclidean distance and hyperbox centroids is formulated to associate the unlabeled hyperboxes with the most likely target classes. A number of benchmark problems and a real-world case study are employed to evaluate the effectiveness of the proposed SSL–FMM model. The outcome indicates that SSL–FMM is able to use unlabeled samples effectively and improve the FMM performance, producing promising results compared with other SSL methods in the literature.

[1]  John D. Lafferty,et al.  Semi-supervised learning using randomized mincuts , 2004, ICML.

[2]  Holger H. Hoos,et al.  A survey on semi-supervised learning , 2019, Machine Learning.

[3]  Chee Peng Lim,et al.  A hybrid model of fuzzy ARTMAP and genetic algorithm for data classification and rule extraction , 2016, Expert Syst. Appl..

[4]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[5]  Chee Peng Lim,et al.  A modified fuzzy min-max neural network for data clustering and its application to power quality monitoring , 2015, Appl. Soft Comput..

[6]  Saeid Nahavandi,et al.  Analysis of Driver Performance Using Hybrid of Weighted Ensemble Learning Technique and Evolutionary Algorithms , 2021 .

[7]  U. Rajendra Acharya,et al.  Hybrid particle swarm optimization for rule discovery in the diagnosis of coronary artery disease , 2019, Expert Syst. J. Knowl. Eng..

[8]  Chee Peng Lim,et al.  A Modified Fuzzy Min–Max Neural Network With a Genetic-Algorithm-Based Rule Extractor for Pattern Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  Zhi-Hua Zhou,et al.  Improving Semi-Supervised Support Vector Machines Through Unlabeled Instances Selection , 2010, AAAI.

[10]  Moloud Abdar,et al.  Impact of Patients’ Gender on Parkinson’s disease using Classification Algorithms , 2018 .

[11]  Chee Peng Lim,et al.  A reinforced fuzzy ARTMAP model for data classification , 2018, International Journal of Machine Learning and Cybernetics.

[12]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[13]  O. Chapelle,et al.  Semi-Supervised Learning (Chapelle, O. et al., Eds.; 2006) [Book reviews] , 2009, IEEE Transactions on Neural Networks.

[14]  Martial Hebert,et al.  Semi-Supervised Self-Training of Object Detection Models , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[15]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[16]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[17]  Feiping Nie,et al.  Semi-Supervised Classification via Local Spline Regression , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Farhad Pourpanah,et al.  Fuzzy measure with regularization for gene selection and cancer prediction , 2021, International Journal of Machine Learning and Cybernetics.

[19]  Yi Liu,et al.  SemiBoost: Boosting for Semi-Supervised Learning , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ran Wang,et al.  A Study on the Uncertainty of Convolutional Layers in Deep Neural Networks , 2020, ArXiv.

[21]  Farhad Pourpanah,et al.  Recent advances in deep learning , 2020, International Journal of Machine Learning and Cybernetics.

[22]  S. AdhiHarmoko,et al.  Introduction to Algorithms , 2005 .

[23]  Jon Atli Benediktsson,et al.  Semisupervised Self-Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Ke Chen,et al.  Semi-Supervised Learning via Regularized Boosting Working on Multiple Semi-Supervised Assumptions , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[26]  Li Liu,et al.  A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges , 2020, Inf. Fusion.

[27]  Bin Zhang,et al.  Anomaly Detection and Condition Monitoring of UAV Motors and Propellers , 2018, 2018 IEEE SENSORS.

[28]  Chee Peng Lim,et al.  An improved fuzzy ARTMAP and Q-learning agent model for pattern classification , 2019, Neurocomputing.

[29]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[30]  Hongbin Sun,et al.  Utilizing Unlabeled Data to Detect Electricity Fraud in AMI: A Semisupervised Deep Learning Approach , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Qingsheng Zhu,et al.  Semi-Supervised Self-Training Method Based on an Optimum-Path Forest , 2019, IEEE Access.

[32]  Chee Peng Lim,et al.  A hybrid model of fuzzy min-max and brain storm optimization for feature selection and data classification , 2019, Neurocomputing.

[33]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[34]  Ying Tan,et al.  Semisupervised Text Classification by Variational Autoencoder , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Chee Peng Lim,et al.  Improving the Fuzzy Min-Max neural network with a K-nearest hyperbox expansion rule for pattern classification , 2017, Appl. Soft Comput..

[36]  Zhen Yang,et al.  Semi-Supervised Metric Learning-Based Anchor Graph Hashing for Large-Scale Image Retrieval , 2019, IEEE Transactions on Image Processing.

[37]  Alireza Shadman,et al.  An ANN-based ensemble model for change point estimation in control charts , 2021, Appl. Soft Comput..

[38]  Jinhai Liu,et al.  Semi-supervised Fuzzy Min–Max Neural Network for Data Classification , 2019, Neural Processing Letters.

[39]  M. Abdar,et al.  A Review of Generalized Zero-Shot Learning Methods , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[41]  Chee Peng Lim,et al.  A Critical Review on Selected Fuzzy Min-Max Neural Networks and Their Significance and Challenges in Pattern Classification , 2019, IEEE Access.

[42]  Chee Peng Lim,et al.  Survey of Fuzzy Min–Max Neural Network for Pattern Classification Variants and Applications , 2019, IEEE Transactions on Fuzzy Systems.

[43]  Chee Peng Lim,et al.  Feature selection based on brain storm optimization for data classification , 2019, Appl. Soft Comput..

[44]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[45]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[46]  Chee Peng Lim,et al.  A review of online learning in supervised neural networks , 2014, Neural Computing and Applications.

[47]  Jin Gao,et al.  Semi-Supervised Tensor-Based Graph Embedding Learning and Its Application to Visual Discriminant Tracking , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Dwarikanath Mahapatra,et al.  Combining multiple expert annotations using semi-supervised learning and graph cuts for medical image segmentation , 2016, Comput. Vis. Image Underst..

[49]  Philippe Thomas Review of Semi-supervised learning by O. Chapelle, B. Schölkopf, and A. Zien, Eds. London, UK, MIT Press, 2006 , 2009 .

[50]  Walid G. Morsi,et al.  Fault Detection and Classification Based on Co-training of Semisupervised Machine Learning , 2018, IEEE Transactions on Industrial Electronics.

[51]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..