Recognition of 3D faces with missing parts based on profile networks

3D face recognition solutions proposed so far compare face scans of a probe subject against archived face scans (gallery), assuming the entire scans are available for both probe and gallery. Though the assumption is reasonable for subjects in the gallery---gallery scans are typically acquired in controlled environments following a collaborative protocol---the same assumption is not general if applied to probes. In fact, when face recognition is performed in un-collaborative contexts, the acquired probes may correspond to just a part of the face or may be altered by occlusions. In this work, we explicitly address these difficulties and propose and experiment an original solution to 3D face recognition that is inherently capable to accomplish the recognition task even in cases where the probe scan represents just a part of the face. In the proposed approach, distinguishing traits of the face are captured by first extracting SIFT keypoints on the face scan and then measuring how the face changes along linear paths, namely profiles, built between pairs of keypoints. The approach is experimented using the Face Recognition Grand Challenge dataset.

[1]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  L. Akarun,et al.  A 3D Face Recognition System for Expression and Occlusion Invariance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[3]  Patrick J. Flynn,et al.  A Region Ensemble for 3-D Face Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[4]  Alberto Del Bimbo,et al.  3D Face Recognition Using Isogeodesic Stripes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[6]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Mohammed Bennamoun,et al.  Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition , 2007, International Journal of Computer Vision.

[8]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[9]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[10]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Michael Mayo,et al.  3D Face Recognition Using Multiview Keypoint Matching , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  Ryutarou Ohbuchi,et al.  Scale-weighted dense bag of visual features for 3D model retrieval from a partial view 3D model , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[14]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Alberto Del Bimbo,et al.  A Set of Selected SIFT Features for 3D Facial Expression Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[16]  Alberto Del Bimbo,et al.  3D Face Recognition using iso-Geodesic Surfaces , 2007, IRCDL.

[17]  Raimondo Schettini,et al.  Gappy PCA Classification for Occlusion Tolerant 3D Face Detection , 2009, Journal of Mathematical Imaging and Vision.

[18]  Thomas S. Huang,et al.  A novel approach to expression recognition from non-frontal face images , 2009, 2009 IEEE 12th International Conference on Computer Vision.