Dynamic Feature Learning for Partial Face Recognition

Partial face recognition (PFR) in unconstrained environment is a very important task, especially in video surveillance, mobile devices, etc. However, a few studies have tackled how to recognize an arbitrary patch of a face image. This study combines Fully Convolutional Network (FCN) with Sparse Representation Classification (SRC) to propose a novel partial face recognition approach, called Dynamic Feature Matching (DFM), to address partial face images regardless of size. Based on DFM, we propose a sliding loss to optimize FCN by reducing the intra-variation between a face patch and face images of a subject, which further improves the performance of DFM. The proposed DFM is evaluated on several partial face databases, including LFW, YTF and CASIA-NIR-Distance databases. Experimental results demonstrate the effectiveness and advantages of DFM in comparison with state-of-the-art PFR methods.

[1]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Shengcai Liao,et al.  Partial Face Recognition: Alignment-Free Approach , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jiwen Lu,et al.  Robust Point Set Matching for Partial Face Recognition , 2016, IEEE Transactions on Image Processing.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Xiang Li,et al.  Partial Person Re-Identification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  C. C. Teo,et al.  Development of Partial Face Recognition Framework , 2010, 2010 Seventh International Conference on Computer Graphics, Imaging and Visualization.

[11]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[14]  Haiqing Li,et al.  Multiscale representation for partial face recognition under near infrared illumination , 2016, 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[15]  Bhiksha Raj,et al.  SphereFace: Deep Hypersphere Embedding for Face Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[17]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[18]  Rama Chellappa,et al.  Partial face detection for continuous authentication , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[19]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[20]  Ahmed Bouridane,et al.  Random sampling for patch-based face recognition , 2017, 2017 5th International Workshop on Biometrics and Forensics (IWBF).

[21]  Jian Sun,et al.  Object Detection Networks on Convolutional Feature Maps , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[23]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Jianping Gou,et al.  Robust discriminative nonnegative dictionary learning for occluded face recognition , 2017, Pattern Recognit. Lett..

[26]  Horst Possegger,et al.  Grid Loss: Detecting Occluded Faces , 2016, ECCV.

[27]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Anil K. Jain,et al.  Periocular biometrics in the visible spectrum: A feasibility study , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Jiwen Lu,et al.  Robust partial face recognition using instance-to-class distance , 2013, 2013 Visual Communications and Image Processing (VCIP).

[31]  Zhenan Sun,et al.  A Lightened CNN for Deep Face Representation , 2015, ArXiv.

[32]  Shengcai Liao,et al.  Part-based Face Recognition Using Near Infrared Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Ran He,et al.  Masquer Hunter: Adversarial Occlusion-aware Face Detection , 2017, ArXiv.

[34]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[36]  Srinivas Gutta,et al.  An investigation into the use of partial-faces for face recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[37]  Jake K. Aggarwal,et al.  Partial face recognition using radial basis function networks , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[38]  S. Park,et al.  Partial & Holistic Face Recognition on FRGC-II data using Support Vector Machine , 2006, CVPR Workshops.

[39]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[40]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.