Semi-Supervised Incremental Three-Way Decision Using Convolutional Neural Network

This paper aims to develop a novel cost-sensitive face recognition framework, which can gain the desirable recognition results with the least total cost. By combining two recently rising techniques: deep convolutional neural networks (CNNs) and sequential three-way decision (3WD) method, our framework can automatically label new samples and incorporates the delayed decision into decision-making process. We first explore the semi-supervised face recognition method in the case of the scarcity of labeled training data. By learning the class estimation and the deep convolution feature extraction of the unlabeled data jointly, the CNN trained by both labeled training data and unlabeled data is generated. Then, rather than getting a lower recognition error rate, we focus on seeking the minimum cost of misclassification at each decision step. For this purpose, we introduce the method of sequential 3WD in our cost-sensitive face recognition framework, which take each iteration of semi-supervised learning as a decision-making step. When there are insufficient labeled samples, a delayed decision will be adopted to reduce the decision cost. Finally, the test cost is also considered in the decision-making process, and the sum of misclassification cost and test cost is taken as the total cost. Using the total cost as the objective function, optimizing the performance indicators, training to get the classifier with the smallest total cost. In short, the model strives to get an optimal decision step, so that the reliable identification result can be obtained with only a small number of labeled data. The work value of this paper is to prove the effectiveness of our method in two face datasets.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Bo Wang,et al.  Dynamic Label Propagation for Semi-supervised Multi-class Multi-label Classification , 2013, ICCV.

[4]  Jiwen Lu,et al.  Cost-Sensitive Subspace Analysis and Extensions for Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[5]  Zeshui Xu,et al.  Method for three-way decisions using ideal TOPSIS solutions at Pythagorean fuzzy information , 2018, Inf. Sci..

[6]  Daoyi Dong,et al.  Incremental Reinforcement Learning With Prioritized Sweeping for Dynamic Environments , 2019, IEEE/ASME Transactions on Mechatronics.

[7]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Xiuyi Jia,et al.  A multiphase cost-sensitive learning method based on the multiclass three-way decision-theoretic rough set model , 2019, Inf. Sci..

[9]  Timo Aila,et al.  Temporal Ensembling for Semi-Supervised Learning , 2016, ICLR.

[10]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[11]  John S. Baras,et al.  Stable Consensus Decision Making for Spatially Distributed Multiagent Systems with Multiple Leaders , 2020, SIAM J. Control. Optim..

[12]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[13]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[14]  Lin Chen,et al.  Discriminative Semi-Supervised Dictionary Learning with Entropy Regularization for Pattern Classification , 2017, AAAI.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Zhi-Hua Zhou,et al.  Cost-Sensitive Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  William Zhu,et al.  Attribute reduction of data with error ranges and test costs , 2012, Inf. Sci..

[18]  D. Dong,et al.  Quantum reinforcement learning during human decision-making , 2020, Nature Human Behaviour.

[19]  Mohammed Bennamoun,et al.  Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Yiyu Yao,et al.  Sequential three-way decisions with probabilistic rough sets , 2011, IEEE 10th International Conference on Cognitive Informatics and Cognitive Computing (ICCI-CC'11).

[21]  Dong-Hyun Lee,et al.  Pseudo-Label : The Simple and Efficient Semi-Supervised Learning Method for Deep Neural Networks , 2013 .

[22]  Bin Gu,et al.  Chunk incremental learning for cost-sensitive hinge loss support vector machine , 2018, Pattern Recognit..

[23]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face Verification in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Fan Min,et al.  Cost-sensitive approximate attribute reduction with three-way decisions , 2019, Int. J. Approx. Reason..

[25]  Bing Huang,et al.  Cost-sensitive sequential three-way decision modeling using a deep neural network , 2017, Int. J. Approx. Reason..

[26]  Dun Liu,et al.  A matrix factorization based dynamic granularity recommendation with three-way decisions , 2020, Knowl. Based Syst..

[27]  Huaxiong Li,et al.  Co-Training Based Sequential Three-Way Decisions for Cost-Sensitive Classification , 2019, 2019 IEEE 16th International Conference on Networking, Sensing and Control (ICNSC).

[28]  Lin Chen,et al.  Semi-supervised convolutional neural networks with label propagation for image classification , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[29]  Guoyin Wang,et al.  An active three-way clustering method via low-rank matrices for multi-view data , 2020, Inf. Sci..

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.