Regularized correntropy criterion based semi-supervised ELM

Along with the explosive growing of data, semi-supervised learning attracts increasing attention in the past years due to its powerful capability in labeling unlabeled data and knowledge mining. As an emerging method, the semi-supervised extreme learning machine (SSELM), that builds on ELM, has been developed for data classification and shown superiorities in learning efficiency and accuracy. However, the optimization of SSELM as well as most of the other ELMs is generally based on the mean square error (MSE) criterion, which has been shown less effective in dealing with non-Gaussian noises. In this paper, a robust regularized correntropy criterion based SSELM (RC-SSELM) is developed. The optimization of the output weight matrix of RC-SSELM is derived by the fixed-point iteration based approach. A convergent analysis of the proposed RC-SSELM is presented based on the half-quadratic optimization technique. Experimental results on 4 synthetic datasets and 13 benchmark UCI datasets are provided to show the superiorities of the proposed RC-SSELM over SSELM and other state-of-the-art methods.

[1]  Chu Kiong Loo,et al.  Kernel Bayesian ART and ARTMAP , 2018, Neural Networks.

[2]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[3]  Raveendran Paramesran,et al.  Hessian semi-supervised extreme learning machine , 2016, Neurocomputing.

[4]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[5]  Badong Chen,et al.  Efficient and robust deep learning with Correntropy-induced loss function , 2015, Neural Computing and Applications.

[6]  Lin Feng,et al.  Robust activation function and its application: Semi-supervised kernel extreme learning method , 2014, Neurocomputing.

[7]  Panos M. Pardalos,et al.  Correntropy in Data Classification , 2012 .

[8]  Sun-Yuan Kung,et al.  Semi-Supervised Salient Object Detection Using a Linear Feedback Control System Model , 2019, IEEE Transactions on Cybernetics.

[9]  Liu Xi,et al.  Maximum Correntropy Kalman Filter With State Constraints , 2017, IEEE Access.

[10]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[11]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[13]  Xi Liu,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[14]  Andrzej Cichocki,et al.  A new nonlinear similarity measure for multichannel signals , 2008, Neural Networks.

[15]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.

[16]  Zhixin Yang,et al.  Multilayer one-class extreme learning machine , 2019, Neural Networks.

[17]  Jiuwen Cao,et al.  Kernel-Based Multilayer Extreme Learning Machines for Representation Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Kai Zhang,et al.  Extreme learning machine and adaptive sparse representation for image classification , 2016, Neural Networks.

[19]  Badong Chen,et al.  Extreme Learning Machine With Affine Transformation Inputs in an Activation Function , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[20]  David M. W. Powers,et al.  A semi-supervised online sequential extreme learning machine method , 2016, Neurocomputing.

[21]  Xi Liu,et al.  State space least p-power filter , 2017, Digit. Signal Process..

[22]  Fang Liu,et al.  Joint sparse regularization based Sparse Semi-Supervised Extreme Learning Machine (S3ELM) for classification , 2015, Knowl. Based Syst..

[23]  Chong Wang,et al.  A Semi-Supervised Method for Surveillance-Based Visual Location Recognition , 2017, IEEE Transactions on Cybernetics.

[24]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[25]  Paolo Gastaldo,et al.  Inductive bias for semi-supervised extreme learning machine , 2016, Neurocomputing.

[26]  Hong-Jie Xing,et al.  Training extreme learning machine via regularized correntropy criterion , 2012, Neural Computing and Applications.

[27]  Omer Karal,et al.  Maximum likelihood optimal and robust Support Vector Regression with lncosh loss function , 2017, Neural Networks.

[28]  Jiuwen Cao,et al.  A Maximally Split and Relaxed ADMM for Regularized Extreme Learning Machines , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Wenbin Hu,et al.  Epileptic Signal Classification With Deep EEG Features by Stacked CNNs , 2020, IEEE Transactions on Cognitive and Developmental Systems.

[30]  Jianzhong Wang,et al.  Excavation Equipment Recognition Based on Novel Acoustic Statistical Features , 2017, IEEE Transactions on Cybernetics.

[31]  Xin Wang,et al.  Mixture correntropy for robust learning , 2018, Pattern Recognit..

[32]  Badong Chen,et al.  Recursive least mean p-power Extreme Learning Machine , 2017, Neural Networks.

[33]  Nan Zhang,et al.  Unsupervised and semi-supervised extreme learning machine with wavelet kernel for high dimensional data , 2016, Memetic Computing.

[34]  Q. M. Jonathan Wu,et al.  Human face recognition based on multidimensional PCA and extreme learning machine , 2011, Pattern Recognit..

[35]  Rui Zhang,et al.  Semi-Supervised Hyperspectral Image Classification Using Spatio-Spectral Laplacian Support Vector Machine , 2014, IEEE Geoscience and Remote Sensing Letters.

[36]  Nanning Zheng,et al.  Robust Learning With Kernel Mean $p$ -Power Error Loss , 2016, IEEE Transactions on Cybernetics.

[37]  Badong Chen,et al.  Deep Weighted Extreme Learning Machine , 2018, Cognitive Computation.

[38]  Liang Chen,et al.  Semi-Supervised Learning Through Label Propagation on Geodesics , 2018, IEEE Transactions on Cybernetics.

[39]  Xin Wang,et al.  Robust Matching Pursuit Extreme Learning Machines , 2018, Sci. Program..

[40]  Sanyam Shukla,et al.  Class-specific extreme learning machine for handling binary class imbalance problem , 2018, Neural Networks.