3D Face Recognition Using Spatial Relations

Identity recognition using 3D scans of the face has been recently proposed as an alternative or complementary solution to conventional 2D face recognition approaches based on still images or videos. In fact, face representations based on 3D data are expected to be more robust to pose changes and illumination variations than 2D images, thus allowing accurate face recognition in real-world applications with unconstrained acquisition. Based on these premises, in this chapter, the authors first introduce the general and main methodologies for 3D face recognition, shortly reviewing the related literature by distinguishing between global and local approaches. Then, the authors present and discuss two 3D face recognition approaches that are robust to facial expression variations and share the common idea of accounting for the spatial relations between local facial features. In the first approach, the face is partitioned into iso-geodesic stripes and spatial relations are computed by integral measures that capture the relative displacement between the sets of 3D points in each pair of stripes. In the second solution, the face is described by detecting keypoints in the depth map of the face and locally describing them. Then, facial curves on the surface are considered between each pair of keypoints, so as to capture the shape of the face along the curve as well as the relational information between keypoints. Future research directions and conclusions are drawn at the end of the chapter. Stefano Berretti University of Florence, Italy Alberto del Bimbo University of Florence, Italy Pietro Pala University of Florence, Italy DOI: 10.4018/978-1-4666-5966-7.ch005

[1]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Vinod Chandran,et al.  3D Face Recognition using Log-Gabor Templates , 2006, BMVC.

[4]  Ioannis A. Kakadiaris,et al.  Evaluation of 3D Face Recognition in the presence of facial expressions: an Annotated Deformable Model approach , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[5]  Alberto Del Bimbo,et al.  Sparse Matching of Salient Facial Curves for Recognition of 3-D Faces With Missing Parts , 2013, IEEE Transactions on Information Forensics and Security.

[6]  Anil K. Jain,et al.  Deformation Modeling for Robust 3D Face Matching , 2006, CVPR.

[7]  Alberto Del Bimbo,et al.  Efficient Matching and Indexing of Graph Models in Content-Based Retrieval , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Marc Acheroy,et al.  Face verification from 3D and grey level clues , 2001, Pattern Recognit. Lett..

[9]  Alberto Del Bimbo,et al.  Distinguishing Facial Features for Ethnicity-Based 3D Face Recognition , 2012, TIST.

[10]  Dong Xu,et al.  SHREC’08 entry: 3D face recognition using moment invariants , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[11]  Patrick J. Flynn,et al.  Using multi-instance enrollment to improve performance of 3D face recognition , 2008, Comput. Vis. Image Underst..

[12]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[13]  Evangelos E. Milios,et al.  Matching range images of human faces , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[14]  Paul Suetens,et al.  meshSIFT: Local surface features for 3D face recognition under expression variations and partial data , 2013, Comput. Vis. Image Underst..

[15]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hassen Drira,et al.  3D Face Recognition under Expressions, Occlusions, and Pose Variations , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Paul M. Thompson,et al.  Mutual information-based 3D surface matching with applications to face recognition and brain mapping , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Alexander M. Bronstein,et al.  Robust Expression-Invariant Face Recognition from Partially Missing Data , 2006, ECCV.

[21]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[23]  Michael G. Strintzis,et al.  Use of depth and colour eigenfaces for face recognition , 2003, Pattern Recognit. Lett..

[24]  Alan C. Bovik,et al.  Anthropometric 3D Face Recognition , 2010, International Journal of Computer Vision.

[25]  Berk Gökberk,et al.  Regional Registration for Expression Resistant 3-D Face Recognition , 2010, IEEE Transactions on Information Forensics and Security.

[26]  Anuj Srivastava,et al.  Three-Dimensional Face Recognition Using Shapes of Facial Curves , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Thomas Vetter,et al.  SHREC’08 entry: Shape based face recognition with a Morphable Model , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[29]  Alberto Del Bimbo,et al.  3D Face Recognition using iso-Geodesic Surfaces , 2007, IRCDL.

[30]  Frank B. ter Haar,et al.  A 3D face matching framework , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[31]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[32]  Zhaohui Wu,et al.  3D Face Recognition using Mapped Depth Images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[33]  Alice J. O'Toole,et al.  FRVT 2006 and ICE 2006 large-scale results , 2007 .

[34]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Maurício Pamplona Segundo,et al.  3D Face Recognition Using Simulated Annealing and the Surface Interpenetration Measure , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Chin-Seng Chua,et al.  Face recognition from 2D and 3D images using 3D Gabor filters , 2005, Image Vis. Comput..

[37]  Patrick J. Flynn,et al.  A Region Ensemble for 3-D Face Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[38]  Alberto Del Bimbo,et al.  Description and retrieval of 3D face models using iso-geodesic stripes , 2006, MIR '06.

[39]  A FischlerMartin,et al.  Random sample consensus , 1981 .

[40]  Xiaoou Tang,et al.  Robust 3D Face Recognition by Local Shape Difference Boosting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Luuk J. Spreeuwers,et al.  Fast and Accurate 3D Face Recognition , 2011, International Journal of Computer Vision.

[43]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[44]  Sen Wang,et al.  3D Surface Matching and Recognition Using Conformal Geometry , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[45]  T. Theoharis,et al.  Partial matching of interpose 3D facial data for face recognition , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[46]  Ping Yan,et al.  A fast algorithm for ICP-based 3D shape biometrics , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[47]  Alberto Del Bimbo,et al.  Facial curves between keypoints for recognition of 3D faces with missing parts , 2011, CVPR 2011 WORKSHOPS.

[48]  Alberto Del Bimbo,et al.  3D Face Recognition Using Isogeodesic Stripes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.