Face Box Shape and Verification

Successful face verification and recognition require matching corresponding points in a pair of images, and it is commonly acknowledged that alignment is a critical step prior to matching. Once aligned, a portion of the image can be compared or features can be extracted. This portion of the image, which we will call the face box, is often just the output of a face detector. While a good deal of effort has been devoted to alignment, the choice of face box has been largely neglected. This paper presents the first systematic study of the shape and size of the face box on face verification accuracy. We use representative algorithms on a dataset that allows for experimentation with differing 3-D pose, blur, noise, misalignment, and background clutter. The experiments lead to clear conclusions and recommendations that can improve the accuracy of other face recognition methods and guide future research.

[1]  V. Bruce,et al.  Human Face Perception and Identification , 1998 .

[2]  Aristodemos Pnevmatikakis,et al.  Impact of Face Registration Errors on Recognition , 2006, AIAI.

[3]  Erik Learned-Miller,et al.  FDDB: A benchmark for face detection in unconstrained settings , 2010 .

[4]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[5]  Javier Ruiz-del-Solar,et al.  Recognition of Faces in Unconstrained Environments: A Comparative Study , 2009, EURASIP J. Adv. Signal Process..

[6]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[7]  David J. Kriegman,et al.  Pose, illumination and expression invariant pairwise face-similarity measure via Doppelgänger list comparison , 2011, 2011 International Conference on Computer Vision.

[8]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[9]  Rabia Jafri,et al.  A Survey of Face Recognition Techniques , 2009, J. Inf. Process. Syst..

[10]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[11]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[12]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Hossein Mobahi,et al.  Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Takeo Kanade,et al.  Object Detection Using the Statistics of Parts , 2004, International Journal of Computer Vision.

[15]  Philip J. Benson,et al.  When does the inner-face advantage in familiar face recognition arise and why? , 1999 .

[16]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..

[17]  Jun S. Huang,et al.  Human face profile recognition by computer , 1990, Pattern Recognit..

[18]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[19]  Horst Bischof,et al.  Annotated Facial Landmarks in the Wild: A large-scale, real-world database for facial landmark localization , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[20]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[22]  Ioannis A. Kakadiaris,et al.  Profile-based face recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[23]  Subhransu Maji,et al.  Semantic contours from inverse detectors , 2011, 2011 International Conference on Computer Vision.

[24]  Pawan Sinha,et al.  Relative Contributions of Internal and External Features to Face Recognition , 2003 .

[25]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[26]  King Ngi Ngan,et al.  FaceSeg: Automatic Face Segmentation for Real-Time Video , 2009, IEEE Transactions on Multimedia.

[27]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[28]  David D. Cox,et al.  A High-Throughput Screening Approach to Discovering Good Forms of Biologically Inspired Visual Representation , 2009, PLoS Comput. Biol..

[29]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.