Density-based semi-supervised online sequential extreme learning machine

This paper proposes a density-based semi-supervised online sequential extreme learning machine (D-SOS-ELM). The proposed method can realize online learning of unlabeled samples chunk by chunk. Local density and distance are used to measure the similarity of patterns, and the patterns with high confidence are selected by the ‘follow’ strategy for online learning, which can improve the accuracy of learning. Through continuous patterns selection, the proposed method ultimately achieves effective learning of unlabeled patterns. Furthermore, using local density and relative distance can effectively respond to the relationship between patterns. Compared with the traditional distance-based similarity measure, the ability to deal with complex data is improved. Empirical study on several standard benchmark data sets demonstrates that the proposed D-SOS-ELM model outperforms state-of-art methods in terms of accuracy.

[1]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[2]  Jianzhong Wang,et al.  Adaptive multiple graph regularized semi-supervised extreme learning machine , 2018, Soft Comput..

[3]  Huanhuan Chen,et al.  Efficient Cluster-Based Boosting for Semisupervised Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Baihai Zhang,et al.  Improved Meta-ELM with error feedback incremental ELM as hidden nodes , 2017, Neural Computing and Applications.

[5]  José-Luis Sancho-Gómez,et al.  Performance analysis of No-Propagation and ELM algorithms in classification , 2018, Neural Computing and Applications.

[6]  Xiaodong Li,et al.  Multiple-kernel-learning-based extreme learning machine for classification design , 2014, Neural Computing and Applications.

[7]  Tom M. Mitchell,et al.  Semi-Supervised Text Classification Using EM , 2006, Semi-Supervised Learning.

[8]  Takafumi Kanamori,et al.  Semi-supervised learning with density-ratio estimation , 2012, Machine Learning.

[9]  Raveendran Paramesran,et al.  Hessian semi-supervised extreme learning machine , 2016, Neurocomputing.

[10]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[11]  Qiang Zhang,et al.  The memory degradation based online sequential extreme learning machine , 2018, Neurocomputing.

[12]  Dong Sun Park,et al.  Online sequential extreme learning machine with forgetting mechanism , 2012, Neurocomputing.

[13]  William W. Cohen,et al.  Semi-Supervised Classification of Network Data Using Very Few Labels , 2010, 2010 International Conference on Advances in Social Networks Analysis and Mining.

[14]  Yanan Li,et al.  Haptic Identification by ELM-Controlled Uncertain Manipulator , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  M. Ackman,et al.  Development of a Global Interferometer Skin-Friction Meter , 1998 .

[16]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[17]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[18]  Paolo Gastaldo,et al.  Inductive bias for semi-supervised extreme learning machine , 2016, Neurocomputing.

[19]  Limin Fu,et al.  FLAME, a novel fuzzy clustering method for the analysis of DNA microarray data , 2007, BMC Bioinformatics.

[20]  David M. W. Powers,et al.  A semi-supervised online sequential extreme learning machine method , 2016, Neurocomputing.

[21]  Abdelmajid Ben Hamadou,et al.  SISR: System for integrating semantic relatedness and similarity measures , 2016, Soft Computing.

[22]  Bernhard Schölkopf,et al.  A Discussion of Semi-Supervised Learning and Transduction , 2006, Semi-Supervised Learning.

[23]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Anil K. Jain,et al.  Data Clustering: A User's Dilemma , 2005, PReMI.

[25]  Hani Hagras,et al.  Novel Levenberg-Marquardt based learning algorithm for unmanned aerial vehicles , 2017, Inf. Sci..

[26]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[27]  Lin Feng,et al.  Extend semi-supervised ELM and a frame work , 2014, Neural Computing and Applications.

[28]  Yu Liu,et al.  Parallel online sequential extreme learning machine based on MapReduce , 2015, Neurocomputing.

[29]  Yuying Li,et al.  Self-training with adaptive regularization for S3VM , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[30]  Danilo Comminiello,et al.  Online Sequential Extreme Learning Machine With Kernels , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Qiang Liu,et al.  Financial time series prediction using ℓ2, 1RF-ELM , 2018, Neurocomputing.

[32]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[33]  Shifei Ding,et al.  Extreme learning machine and its applications , 2013, Neural Computing and Applications.

[34]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..