A Composite Cost-Sensitive Neural Network for Imbalanced Classification

Imbalanced data with skewed class distributions and different misclassification costs is common in many real-world applications. Traditional classification approach does not work well for imbalanced data, because they assume equal costs for each class. To deal with this problem, cost-sensitive approaches assign different misclassification costs for different classes without disrupting the true original distributions of samples. However, due to lack of prior knowledge, the misclassification costs are usually unknown and hard to choose in practice. Whats more, even instances in the same class may have different misclassification costs. As an extension of class-dependent costs, this paper presents a composite cost-sensitive deep neural network (CCS-DNN) for imbalanced classification. A specifically-designed cost-sensitive matrix, which is composed of example-dependent costs and class-dependent costs, is embedded into the loss function to improve the classification performance. And the parameters of both the cost-sensitive matrix and the network are jointly optimized during training. The results of comparative experiments on some benchmark datasets indicate that the CCS-DNN performs better than other baseline methods.

[1]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[2]  Mohammed Bennamoun,et al.  Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Jianjun Wang,et al.  Margin calibration in SVM class-imbalanced learning , 2009, Neurocomputing.

[4]  Haizhou Li,et al.  A Cost-Sensitive Deep Belief Network for Imbalanced Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Prabhjot Kaur,et al.  Comparing the Behavior of Oversampling and Undersampling Approach of Class Imbalance Learning by Combining Class Imbalance Problem with Noise , 2018 .

[6]  Gerald Schaefer,et al.  Cost-sensitive decision tree ensembles for effective imbalanced classification , 2014, Appl. Soft Comput..

[7]  Igor Kononenko,et al.  Cost-Sensitive Learning with Neural Networks , 1998, ECAI.

[8]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[9]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[10]  Wenhuang Liu,et al.  A Measure Oriented Training Scheme for Imbalanced Classification Problems , 2011, PAKDD Workshops.

[11]  Hsuan-Tien Lin,et al.  Cost-Aware Pre-Training for Multiclass Cost-Sensitive Deep Learning , 2015, IJCAI.

[12]  Pei-Chann Chang,et al.  Parametric prediction on default risk of Chinese listed tourism companies by using random oversampling, isomap, and locally linear embeddings on imbalanced samples , 2013 .

[13]  Hadi Sadoghi Yazdi,et al.  Online cost-sensitive neural network classifiers for non-stationary and imbalanced data streams , 2012, Neural Computing and Applications.

[14]  Antônio de Pádua Braga,et al.  Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Longbing Cao,et al.  Training deep neural networks on imbalanced data sets , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).