Multiscale representation for partial face recognition under near infrared illumination

Near infrared (NIR) partial face images acquired in iris recognition in less constrained environments contain plentiful identity information which have not been fully exploited. In this paper, a NIR partial face recognition (PFR) algorithm is designed according to the characteristics of NIR partial face images acquired in iris recognition systems. In the preprocessing stage, the eye corners are utilized for alignment because the eye regions are usually visible. In the feature representation stage, highly compact and discriminatory features are extracted based on Multiscale Double Supervision Convolutional Neural Network (MD-SCNN) from several multiscale patches which are cropped from the aligned images. Weights of each multiscale patch are learned to improve the performance of PFR. Finally, the dissimilarity between two partial face images is calculated as the weighted t2 distance between corresponding patches. A new NIR partial face (NIR-PF) database is constructed for extensive evaluation, which includes 5300 images acquired from 276 subjects when they walk towards an iris imaging device. Experimental results on the NIR-PF and CASIA-IrisV4-Distance databases demonstrate the effectiveness and efficiency of the proposed algorithm.

[1]  Shuo Yang,et al.  From Facial Parts Responses to Face Detection: A Deep Learning Approach , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Shengcai Liao,et al.  Partial Face Recognition: Alignment-Free Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Tony R. Martinez,et al.  The general inefficiency of batch training for gradient descent learning , 2003, Neural Networks.

[4]  Srinivas Gutta,et al.  An investigation into the use of partial-faces for face recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[5]  M MartínezAleix.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002 .

[6]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  S. Park,et al.  Partial & Holistic Face Recognition on FRGC-II data using Support Vector Machine , 2006, CVPR Workshops.

[9]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Shengcai Liao,et al.  Part-based Face Recognition Using Near Infrared Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Shengcai Liao,et al.  Partial Face Matching between Near Infrared and Visual Images in MBGC Portal Challenge , 2009, ICB.

[14]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Abdenour Hadid,et al.  Improving the recognition of faces occluded by facial accessories , 2011, Face and Gesture 2011.

[16]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  James R. Matey,et al.  Iris on the Move: Acquisition of Images for Iris Recognition in Less Constrained Environments , 2006, Proceedings of the IEEE.

[18]  Shengcai Liao,et al.  Automatic Partial Face Alignment in NIR Video Sequences , 2009, ICB.

[19]  F. Bashir,et al.  Eagle-Eyes: A System for Iris Recognition at a Distance , 2008, 2008 IEEE Conference on Technologies for Homeland Security.

[20]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Jiwen Lu,et al.  Robust partial face recognition using instance-to-class distance , 2013, 2013 Visual Communications and Image Processing (VCIP).

[22]  Jian Sun,et al.  Face Alignment at 3000 FPS via Regressing Local Binary Features , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[24]  Jiwen Lu,et al.  Robust Feature Set Matching for Partial Face Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[26]  C. C. Teo,et al.  Development of Partial Face Recognition Framework , 2010, 2010 Seventh International Conference on Computer Graphics, Imaging and Visualization.