Parameter-Free Extreme Learning Machine for Imbalanced Classification

Imbalanced data distribution is a common problem in classification situations, that is the number of samples in different categories varies greatly, thus increasing the classification difficulty. Although many methods have been used for the imbalanced data classification, there are still problems with low classification accuracy in minority class and adding additional parameter settings. In order to increase minority classification accuracy in imbalanced problem, this paper proposes a parameter-free weighting learning mechanism based on extreme learning machine and sample loss values to balance the number of samples in each training step. The proposed method mainly includes two aspects: the sample weight learning process based on the sample losses; the sample selection process and weight update process according to the constraint function and iterations. Experimental results on twelve datasets from the KEEL repository show that the proposed method could achieve more balanced and accurate results than other compared methods in this work.

[1]  Xin Yao,et al.  Resampling-Based Ensemble Methods for Online Class Imbalance Learning , 2015, IEEE Transactions on Knowledge and Data Engineering.

[2]  Vaishali Ganganwar,et al.  An overview of classification algorithms for imbalanced datasets , 2012 .

[3]  Victor S. Sheng,et al.  Cost-Sensitive Learning and the Class Imbalance Problem , 2008 .

[4]  Xuelong Li,et al.  Graph PCA Hashing for Similarity Search , 2017, IEEE Transactions on Multimedia.

[5]  Stan Matwin,et al.  Resampling and Cost-Sensitive Methods for Imbalanced Multi-instance Learning , 2013, 2013 IEEE 13th International Conference on Data Mining Workshops.

[6]  Nan Liu,et al.  Voting based extreme learning machine , 2012, Inf. Sci..

[7]  Yijing Li,et al.  Learning from class-imbalanced data: Review of methods and applications , 2017, Expert Syst. Appl..

[8]  Longbing Cao,et al.  Effective detection of sophisticated online banking fraud on extremely imbalanced data , 2012, World Wide Web.

[9]  Weitong Chen,et al.  Graph augmented triplet architecture for fine-grained patient similarity , 2020, World Wide Web.

[10]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[11]  Xiaofeng Zhu,et al.  Robust SVM with adaptive graph learning , 2019, World Wide Web.

[12]  Wei Zheng,et al.  Spectral rotation for deep one-step clustering , 2020, Pattern Recognit..

[13]  Yanhui Guo,et al.  A Novel Neutrosophic Weighted Extreme Learning Machine for Imbalanced Data Set , 2017, Symmetry.

[14]  ShangJennifer,et al.  Learning from class-imbalanced data , 2017 .

[15]  Yanchun Liang,et al.  A resampling ensemble algorithm for classification of imbalance problems , 2014, Neurocomputing.

[16]  Jian Sun,et al.  Cost-Sensitive Extreme Learning Machine , 2013, ADMA.

[17]  Xiaofeng Zhu,et al.  Unsupervised feature selection by self-paced learning regularization , 2020, Pattern Recognit. Lett..

[18]  Weidong Yang,et al.  Class-specific cost regulation extreme learning machine for imbalanced classification , 2017, Neurocomputing.

[19]  Wei Zheng,et al.  Supervised feature selection by self-paced learning regression , 2020, Pattern Recognit. Lett..

[20]  Francisco Charte,et al.  Addressing imbalance in multilabel classification: Measures and random resampling algorithms , 2015, Neurocomputing.

[21]  Xiaofeng Zhu,et al.  Efficient Utilization of Missing Data in Cost-Sensitive Learning , 2019, IEEE Transactions on Knowledge and Data Engineering.

[22]  Rushi Longadge,et al.  Class Imbalance Problem in Data Mining Review , 2013, ArXiv.

[23]  Chen Huang,et al.  Learning Deep Representation for Imbalanced Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Sanyam Shukla,et al.  Class-specific extreme learning machine for handling binary class imbalance problem , 2018, Neural Networks.

[25]  Li Li,et al.  A review of improved extreme learning machine methods for data stream classification , 2019, Multimedia Tools and Applications.

[26]  Ali Selamat,et al.  A Review of Advances in Extreme Learning Machine Techniques and Its Applications , 2017 .

[27]  Sanyam Shukla,et al.  Class-specific kernelized extreme learning machine for binary class imbalance learning , 2018, Appl. Soft Comput..

[28]  Evgeny Burnaev,et al.  Influence of resampling on accuracy of imbalanced classification , 2015, International Conference on Machine Vision.

[29]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[30]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[31]  Worachai Srimuang,et al.  Classification model of network intrusion using Weighted Extreme Learning Machine , 2015, 2015 12th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[32]  Badong Chen,et al.  Deep Weighted Extreme Learning Machine , 2018, Cognitive Computation.

[33]  Jianping Yin,et al.  Boosting weighted ELM for imbalanced learning , 2014, Neurocomputing.

[34]  Gaoyan Zhang,et al.  An improved weighted extreme learning machine for imbalanced data classification , 2019, Memetic Comput..

[35]  Shichao Zhang,et al.  Spectral clustering via half-quadratic optimization , 2019, World Wide Web.

[36]  Zenglin Xu,et al.  Balanced self-paced learning with feature corruption , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[37]  Xiaofeng Zhu,et al.  One-Step Multi-View Spectral Clustering , 2019, IEEE Transactions on Knowledge and Data Engineering.

[38]  WangGuangtao,et al.  A dissimilarity-based imbalance data classification algorithm , 2015 .