Masked Face Recognition with Identification Association

In the crime scene, criminals often consciously conceal their facial identity through face-masked disguise, which poses a huge challenge to identity recognition. Existing disguised face recognition techniques aiming for light even slight occlusions are completely invalid for face-masked identification. To this end, this paper proposes a masked face recognition method based on person re-identification association, which converts the masked face recognition problem into an association uncovering problem between the masked face and the appearing faces of the same person. Based on the characteristics that person re-identification technique does not rely solely on facial information, it first takes advantages of re-identification to establish the association between face-masked pedestrians and face-unveiled pedestrians. It further provides an effective face image quality assessment to select the most identifiable faces for subsequent recognition from a variety of appearing candidate faces. Finally, the selected high-quality recognizable faces are used to replace masked faces for identification. The comparison experiments with the existing disguise face recognition methods show its superiority in terms of accuracy.

[1]  Xiaogang Wang,et al.  DeepID3: Face Recognition with Very Deep Neural Networks , 2015, ArXiv.

[2]  Daksha Yadav,et al.  Face Verification with Disguise Variations via Deep Disguise Recognizer , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Carlos D. Castillo,et al.  Deep Features for Recognizing Disguised Faces in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Chang-Tsun Li,et al.  Dynamic Image-to-Class Warping for Occluded Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[6]  Jian-Jiun Ding,et al.  Occluded face recognition using low-rank regression with generalized gradient direction , 2018, Pattern Recognit..

[7]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[8]  Richa Singh,et al.  Face recognition with disguise and single gallery images , 2009, Image Vis. Comput..

[9]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Shiming Ge,et al.  Detecting Masked Faces in the Wild with LLE-CNNs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Devendra Patil,et al.  Disguised Face Identification (DFI) with Facial KeyPoints Using Spatial Fusion Convolutional Network , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[12]  Juan M. Corchado,et al.  Inhibition of Occluded Facial Regions for Distance-Based Face Recognition , 2018, IJCAI.

[13]  Abhinav Dhall,et al.  DisguiseNet: A Contrastive Approach for Disguised Face Verification in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Jian Sun,et al.  AlignedReID: Surpassing Human-Level Performance in Person Re-Identification , 2017, ArXiv.

[15]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Rama Chellappa,et al.  Recognizing Disguised Faces in the Wild , 2018, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[17]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[18]  B. V. K. Vijaya Kumar,et al.  Masked correlation filters for partially occluded face recognition , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Kin-Man Lam,et al.  An efficient method for occluded face recognition , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[20]  Winston H. Hsu,et al.  Deep Disguised Faces Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Ajay Kumar,et al.  Recognizing human faces under disguise and makeup , 2016, 2016 IEEE International Conference on Identity, Security and Behavior Analysis (ISBA).

[23]  Rama Chellappa,et al.  Disguised Faces in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[24]  Tejas I. Dhamecha,et al.  Recognizing Disguised Faces: Human and Machine Evaluation , 2014, PloS one.

[25]  Aggelos K. Katsaggelos,et al.  Robust and Low-Rank Representation for Fast Face Identification With Occlusions , 2016, IEEE Transactions on Image Processing.