Cost-Sensitive Extreme Learning Machine

ELM is an effective machine learning technique, which works for the "generalized" single-hidden-layer feed-forward networks. However, like original SVM, ELM and majority of its variants have been extensively used in classification applications. Compared to SVM, ELM achieve optimal solutions and require lower computational complexity. More and more researchers have been attracted by ELM due to its fast learning speed and excellent generalization performance. Traditional ELM presumes higher accuracy based on the assumption that all classes have same cost, and the sample size of each class is approximate equal. However, the assumption is not valid in some real cases such as medical diagnosis, fault diagnosis, fraud detection and intrusion detection. To deal with classification applications where the cost of errors is classdependent. we propose a cost-sensitive ELM Experimental results using classification data show that CS-ELM is effective.

[1]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[2]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[3]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Robert K. L. Gay,et al.  Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning , 2009, IEEE Transactions on Neural Networks.

[5]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[6]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[7]  Amaury Lendasse,et al.  OP-ELM: Theory, Experiments and a Toolbox , 2008, ICANN.

[8]  Amaury Lendasse,et al.  OP-ELM: Optimally Pruned Extreme Learning Machine , 2010, IEEE Transactions on Neural Networks.

[9]  Zhi-Hua Zhou,et al.  ON MULTI‐CLASS COST‐SENSITIVE LEARNING , 2006, Comput. Intell..

[10]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[11]  Yuan Lan,et al.  Two-stage extreme learning machine for regression , 2010, Neurocomputing.

[12]  Qinghua Zheng,et al.  Regularized Extreme Learning Machine , 2009, 2009 IEEE Symposium on Computational Intelligence and Data Mining.

[13]  Wei Wu,et al.  Evolutionary Fuzzy Extreme Learning Machine for Mammographic Risk Analysis , 2011 .

[14]  Guang-Bin Huang,et al.  Convex Incremental Extreme Learning Machine , 2007 .

[15]  Klaus Neumann,et al.  Optimizing extreme learning machines via ridge regression and batch intrinsic plasticity , 2013, Neurocomputing.

[16]  Chee Kheong Siew,et al.  Incremental extreme learning machine with fully complex hidden nodes , 2008, Neurocomputing.

[17]  Han Wang,et al.  Ensemble Based Extreme Learning Machine , 2010, IEEE Signal Processing Letters.

[18]  Zhi-Hua Zhou,et al.  The Influence of Class Imbalance on Cost-Sensitive Learning: An Empirical Study , 2006, Sixth International Conference on Data Mining (ICDM'06).