Weighted Module Linear Regression Classifications for Partially-Occluded Face Recognition

Face images with partially-occluded areas create huge deteriorated problems for face recognition systems. Linear regression classification (LRC) is a simple and powerful approach for face recognition, of course, it cannot perform well under occlusion situations as well. By segmenting the face image into small subfaces, called modules, the LRC system could achieve some improvements by selecting the best non-occluded module for face classification. However, the recognition performance will be deteriorated due to the usage of the module, a small portion of the face image. We could further enhance the performance if we can properly identify the occluded modules and utilize all the non-occluded modules as many as possible. In this chapter, we first analyze the texture histogram (TH) of the module and then use the HT difference to measure its occlusion tendency. Thus, based on TH difference, we suggest a general concept of the weighted module face recognition to solve the occlusion problem. Thus, the weighted module linear regression classification method, called WMLRC-TH, is proposed for partially-occluded fact recognition. To evaluate the performances, the proposed WMLRC-TH method, which is tested on AR and FRGC2.0 face databases with several synthesized occlusions, is compared to the well-known face recognition methods and other robust face recognition methods. Experimental results show that the proposed method achieves the best performance for recognize occluded faces. Due to its simplicity in both training and testing phases, a face recognition system based on the WMLRC-TH method is realized on Android phones for fast recognition of occluded faces.

[1]  Stefanos Zafeiriou,et al.  A survey on face detection in the wild: Past, present and future , 2015, Comput. Vis. Image Underst..

[2]  Zhang Yi,et al.  Learning locality-constrained collaborative representation for robust face recognition , 2012, Pattern Recognit..

[3]  Julian Fiérrez,et al.  Dealing with occlusions in face recognition by region-based fusion , 2016, 2016 IEEE International Carnahan Conference on Security Technology (ICCST).

[4]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Shengcai Liao,et al.  Partial Face Recognition: Alignment-Free Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Anil K. Jain,et al.  Component-Based Representation in Automated Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[7]  Jar-Ferr Yang,et al.  Improved Principal Component Regression for Face Recognition Under Illumination Variations , 2012, IEEE Signal Processing Letters.

[8]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Jar-Ferr Yang,et al.  Unitary Regression Classification With Total Minimum Projection Error for Face Recognition , 2013, IEEE Signal Processing Letters.

[10]  Dao-Qing Dai,et al.  Structured Sparse Error Coding for Face Recognition With Occlusion , 2013, IEEE Transactions on Image Processing.

[11]  Jiwen Lu,et al.  Context-Aware Local Binary Feature Learning for Face Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Qiang Ji,et al.  A Comparative Study of Local Matching Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[14]  Zhenhua Guo,et al.  Face recognition with occlusion , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[15]  A. Martínez,et al.  The AR face databasae , 1998 .

[16]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jiwen Lu,et al.  Learning Compact Binary Face Descriptor for Face Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[19]  Tao Zhang,et al.  Fast and robust occluded face detection in ATM surveillance , 2017, Pattern Recognit. Lett..

[20]  Yi-Qing Wang,et al.  An Analysis of the Viola-Jones Face Detection Algorithm , 2014, Image Process. Line.

[21]  Jar-Ferr Yang,et al.  Kernel linear regression for low resolution face recognition under variable illumination , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Abdenour Hadid,et al.  Improving the recognition of faces occluded by facial accessories , 2011, Face and Gesture 2011.

[23]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Abdenour Hadid,et al.  Efficient Detection of Occlusion prior to Robust Face Recognition , 2014, TheScientificWorldJournal.

[25]  Jiwen Lu,et al.  Topology Preserving Structural Matching for Automatic Partial Face Recognition , 2018, IEEE Transactions on Information Forensics and Security.

[26]  Fadi Dornaika,et al.  Adaptive Two Phase Sparse Representation Classifier for Face Recognition , 2013, ACIVS.

[27]  Gang Wang,et al.  Joint Feature Learning for Face Recognition , 2015, IEEE Transactions on Information Forensics and Security.

[28]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[29]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Xinge You,et al.  Robust face recognition via occlusion dictionary learning , 2014, Pattern Recognit..

[33]  Jia Lu,et al.  Robust Face Recognition Based on Supervised Sparse Representation , 2018, ICIC.

[34]  Zhi-Hua Zhou,et al.  Face Recognition Under Occlusions and Variant Expressions With Partial Similarity , 2009, IEEE Transactions on Information Forensics and Security.

[35]  Domingo Mery,et al.  Face recognition via adaptive sparse representations of random patches , 2014, 2014 IEEE International Workshop on Information Forensics and Security (WIFS).

[36]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[37]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Stefano Tornincasa,et al.  Occlusion detection and restoration techniques for 3D face recognition: a literature review , 2018, Machine Vision and Applications.

[39]  Jar-Ferr Yang,et al.  Partially-occluded face recognition using weighted module linear regression classification , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).