Fusion of an Isometric Deformation Modeling Approach Using Spectral Decomposition and a Region-Based Approach Using ICP for Expression-Invariant 3D Face Recognition

The recognition of faces under varying expressions is one of the current challenges in the face recognition community. In this paper, we propose a method fusing different complementary approaches each dealing with expression variations. The first approach uses an isometric deformation model and is based on the largest singular values of the geodesic distance matrix as an expression-invariant shape descriptor. The second approach performs recognition on the more rigid parts of the face that are less affected by expression variations. Several fusion techniques are examined for combining the approaches. The presented method is validated on a subset of 900 faces of the BU-3DFE face database resulting in an equal error rate of 5.85% for the verification scenario and a rank 1 recognition rate of 94.48% for the identification scenario using the sum rule as fusion technique. This result outperforms other 3D expression-invariant face recognition methods on the same database.

[1]  Patrick J. Flynn,et al.  3D Face Recognition with Region Committee Voting , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[2]  Frank B. ter Haar,et al.  A 3D face matching framework , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[3]  S. Malassiotis,et al.  Expression-Compensated 3D Face Recognition with Geodesically Aligned Bilinear Models , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[4]  Thomas Vetter,et al.  SHREC’08 entry: Shape based face recognition with a Morphable Model , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[5]  Gordon Erlebacher,et al.  A novel technique for face recognition using range imaging , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[6]  Jake K. Aggarwal,et al.  Three dimensional face recognition based on geodesic and Euclidean distances , 2007, Electronic Imaging.

[7]  Li Li,et al.  3D face recognition by constructing deformation invariant image , 2008, Pattern Recognit. Lett..

[8]  L. Akarun,et al.  A 3D Face Recognition System for Expression and Occlusion Invariance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[9]  Alberto Del Bimbo,et al.  Description and retrieval of 3D face models using iso-geodesic stripes , 2006, MIR '06.

[10]  Hao Zhang,et al.  Adapting Geometric Attributes for Expression-Invariant 3D Face Recognition , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[11]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[12]  Alexander M. Bronstein,et al.  Expression-Invariant 3D Face Recognition , 2003, AVBPA.

[13]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[14]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Michael G. Strintzis,et al.  3-D Face Recognition With the Geodesic Polar Representation , 2007, IEEE Transactions on Information Forensics and Security.

[16]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[17]  Evangelos E. Milios,et al.  Matching range images of human faces , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[18]  Jim Austin,et al.  Three-Dimensional Face Recognition Using Surface Space Combinations , 2004, BMVC.

[19]  Laurent D. Cohen,et al.  Heuristically Driven Front Propagation for Fast Geodesic Extraction , 2008 .

[20]  Paul Suetens,et al.  Isometric deformation modeling using singular value decomposition for 3D expression-invariant face recognition , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[21]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Faisal R. Al-Osaimi,et al.  An Expression Deformation Approach to Non-rigid 3D Face Recognition , 2009, International Journal of Computer Vision.

[23]  Zhaohui Wu,et al.  Exploring Facial Expression Effects in 3D Face Recognition Using Partial ICP , 2006, ACCV.

[24]  Patrick J. Flynn,et al.  Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.