Robust Adaptive Semi-supervised Classification Method based on Dynamic Graph and Self-paced Learning

Abstract Despite the computers have developed rapidly in recent years, there are still many difficulties to obtain a large number of labelled data in many practical problems, for example, medical image diagnosis, internet fraud, and pedestrian detection. To deal with learning problems with only a few labeled data, a novel semi-supervised learning method combined with dynamic graph learning with self-paced learning mechanism is present in this work, namely SS-GSELM. Firstly, according to the loss value of labeled samples in each training, the algorithm selects the sample with the smaller loss value for learning, and then gradually adds the sample with the larger loss value during the training process until all labeled samples are trained. In particular, different weights are given to samples through a regularization function to adjust the importance of different samples on the model results. Secondly, the algorithm uses local consistency property as supplementary information to enhance the performance of the learning machine, so an adaptive graph matrix is constructed to retain data similarity information. To do this, an alternative strategy is proposed to update graph matrices and self-paced weights to adapt to the classifier. Experimental results on real data sets exhibit that the proposed method superior to the classic methods in classification tasks.

[1]  Nan Zhang,et al.  Unsupervised and semi-supervised extreme learning machine with wavelet kernel for high dimensional data , 2016, Memetic Computing.

[2]  Shichao Zhang,et al.  Spectral clustering via half-quadratic optimization , 2019, World Wide Web.

[3]  Mahmood Yousefi-Azar,et al.  Semi-supervised convolutional extreme learning machine , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[4]  Shiguang Shan,et al.  Self-Paced Curriculum Learning , 2015, AAAI.

[5]  Xianzhong Long,et al.  Discriminative graph regularized extreme learning machine and its application to face recognition , 2015, Neurocomputing.

[6]  Wei Zheng,et al.  Supervised feature selection by self-paced learning regression , 2020, Pattern Recognit. Lett..

[7]  Daphne Koller,et al.  Self-Paced Learning for Latent Variable Models , 2010, NIPS.

[8]  Chen Zhang,et al.  Semi-supervised low rank kernel learning algorithm via extreme learning machine , 2016, International Journal of Machine Learning and Cybernetics.

[9]  Zenglin Xu,et al.  Auto-weighted multi-view clustering via kernelized graph learning , 2019, Pattern Recognit..

[10]  Jianpeng Zhang,et al.  Semi-supervised adversarial model for benign-malignant lung nodule classification on chest CT , 2019, Medical Image Anal..

[11]  Cheng Deng,et al.  Balanced Self-Paced Learning for Generative Adversarial Clustering Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Maosong Sun,et al.  Semi-Supervised Learning for Neural Machine Translation , 2016, ACL.

[13]  Yong Peng,et al.  Discriminative extreme learning machine with supervised sparsity preserving for image classification , 2017, Neurocomputing.

[14]  Maoguo Gong,et al.  Multi-Objective Self-Paced Learning , 2016, AAAI.

[15]  Stephen P. Boyd Convex optimization of graph Laplacian eigenvalues , 2006 .

[16]  Khan Muhammad,et al.  Random Forest with Self-Paced Bootstrap Learning in Lung Cancer Prognosis , 2020, ACM Trans. Multim. Comput. Commun. Appl..

[17]  Saihua Cai,et al.  Extreme Learning Machine for Supervised Classification with Self-paced Learning , 2020, Neural Processing Letters.

[18]  Heng Tao Shen,et al.  Half-Quadratic Minimization for Unsupervised Feature Selection on Incomplete Data , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[20]  Heng Tao Shen,et al.  Heterogeneous data fusion for predicting mild cognitive impairment conversion , 2021, Inf. Fusion.

[21]  Qingshan She,et al.  Safe Semi-Supervised Extreme Learning Machine for EEG Signal Classification , 2018, IEEE Access.

[22]  Xiaofeng Zhu,et al.  Robust SVM with adaptive graph learning , 2019, World Wide Web.

[23]  Xuelong Li,et al.  Learning k for kNN Classification , 2017, ACM Trans. Intell. Syst. Technol..

[24]  Xuebing Yang,et al.  Tensor Multi-Elastic Kernel Self-Paced Learning for Time Series Clustering , 2019, IEEE Transactions on Knowledge and Data Engineering.

[25]  Nannan Gu,et al.  Structure regularized self-paced learning for robust semi-supervised pattern classification , 2019, Neural Computing and Applications.

[26]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[27]  Yonghua Zhu,et al.  Unsupervised Spectral Feature Selection With Dynamic Hyper-Graph Learning , 2022, IEEE Transactions on Knowledge and Data Engineering.

[28]  Xiaofeng Zhu,et al.  Unsupervised feature selection by self-paced learning regularization , 2020, Pattern Recognit. Lett..

[29]  Ge Yu,et al.  Semi-supervised multi-graph classification using optimal feature selection and extreme learning machine , 2018, Neurocomputing.

[30]  Thomas Brox,et al.  Semi-Supervised Semantic Segmentation With High- and Low-Level Consistency , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Mingming Liu,et al.  A Semi-supervised Low Rank Kernel Learning Algorithm via Extreme Learning Machine , 2017 .

[32]  Zenglin Xu,et al.  Robust Softmax Regression for Multi-class Classification with Self-Paced Learning , 2017, IJCAI.

[33]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[34]  Carlos Busso,et al.  Semi-Supervised Speech Emotion Recognition With Ladder Networks , 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[35]  Bing Liu,et al.  Manifold regularized extreme learning machine , 2015, Neural Computing and Applications.

[36]  Wenyan Guo,et al.  Facial Expression Recognition Based on Regularized Semi-supervised Deep Learning , 2020 .

[37]  Zenglin Xu,et al.  Robust Graph Learning From Noisy Data , 2018, IEEE Transactions on Cybernetics.

[38]  Bo Liu,et al.  A new self-paced method for multiple instance boosting learning , 2020, Inf. Sci..

[39]  Qimai Li,et al.  Label Efficient Semi-Supervised Learning via Graph Filtering , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Deyu Meng,et al.  A theoretical understanding of self-paced learning , 2017, Inf. Sci..

[41]  Jianzhong Wang,et al.  Adaptive multiple graph regularized semi-supervised extreme learning machine , 2018, Soft Comput..

[42]  David M. W. Powers,et al.  A semi-supervised online sequential extreme learning machine method , 2016, Neurocomputing.

[43]  Ying Wu,et al.  Semi-Supervised Transfer Learning for Image Rain Removal , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Sheng-Jun Huang,et al.  Self-Paced Active Learning: Query the Right Thing at the Right Time , 2019, AAAI.

[45]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[46]  Dezheng Zhang,et al.  Semi-supervised Multi-kernel Extreme Learning Machine , 2017, IIKI.