3D Face Recognition in Continuous Spaces

This work introduces a new approach for face recognition based on 3D scans. The main idea of the proposed method is that of converting the 3D face scans into a functional representation, performing all the subsequent processing in the continuous space. To this end, a model alignment problem is first solved by combining graph matching and clustering. Fiducial points of the face are initially detected by analysis of continuous functions computed on the surface. Then, the alignment is performed by transforming the geometric graphs whose nodes are the critical points of the representative function of the surface in previously determined subspaces. A clustering step is finally applied to correct small displacement in the models. The 3D face representation is then obtained on the aligned models by functions carefully selected according to mathematical and computational criteria. In particular, the face is divided into regions, which are treated as independent domains where a set of functions is determined by fitting the surface data using the least squares method. Experimental results demonstrate the feasibility of the method.

[1]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Raimondo Schettini,et al.  Gappy PCA Classification for Occlusion Tolerant 3D Face Detection , 2009, Journal of Mathematical Imaging and Vision.

[3]  Patrick J. Flynn,et al.  A Region Ensemble for 3-D Face Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[4]  Alberto Del Bimbo,et al.  Sparse Matching of Salient Facial Curves for Recognition of 3-D Faces With Missing Parts , 2013, IEEE Transactions on Information Forensics and Security.

[5]  Xiaoou Tang,et al.  Robust 3D Face Recognition by Local Shape Difference Boosting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Stefano Berretti,et al.  3D Face Recognition by Functional Data Analysis , 2014, CIARP.

[7]  Alberto Del Bimbo,et al.  3D Face Recognition Using Isogeodesic Stripes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[9]  Alberto Del Bimbo,et al.  Reconstructing High-Resolution Face Models From Kinect Depth Sequences , 2016, IEEE Transactions on Information Forensics and Security.

[10]  Ioannis A. Kakadiaris,et al.  Using Facial Symmetry to Handle Pose Variations in Real-World 3D Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Mariette Yvinec,et al.  Conforming Delaunay triangulations in 3D , 2002, SCG '02.

[12]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Di Huang,et al.  3-D Face Recognition Using eLBP-Based Facial Description and Local Feature Hybrid Matching , 2012, IEEE Transactions on Information Forensics and Security.

[14]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[15]  Alberto Del Bimbo,et al.  3D Face Recognition using iso-Geodesic Surfaces , 2007, IRCDL.

[16]  Alberto Del Bimbo,et al.  The florence 2D/3D hybrid face dataset , 2011, J-HGBU '11.

[17]  Hassen Drira,et al.  3D Face Recognition under Expressions, Occlusions, and Pose Variations , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Alexander M. Bronstein,et al.  Robust Expression-Invariant Face Recognition from Partially Missing Data , 2006, ECCV.