3D face recognition: A robust multi-matcher approach to data degradations

Over the past decades, 3D face has emerged as a solution to face recognition due to its reputed invariance to lighting conditions and pose. While proposed approaches have proven their efficiency over renowned databases as FRGC, less effort was spent on studying the robustness of algorithms to quality degradations. In this paper, we present a study of the robustness of four state of the art algorithms and a multi-matcher framework to face model degradations such as Gaussian noise, decimation, and holes. The four state of the art algorithms were chosen for their different and complementary properties and exemplify the major classes of 3D face recognition solutions. As they displayed different behavior under data degradations, we further designed a fusion framework to best take into account their complementary properties. The proposed multi-matcher scheme is based on an offline and an online weight learning process. Experiments were conducted on a subset of the FRGC database, on which we generated degradations. Results demonstrate the competitive robustness of the proposed approach.

[1]  Tomaso A. Poggio,et al.  Model-based matching of line drawings by linear combinations of prototypes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[2]  Venu Govindaraju,et al.  Robustness of multimodal biometric fusion methods against spoof attacks , 2009, J. Vis. Lang. Comput..

[3]  Caifeng Shan,et al.  Learning Discriminative LBP-Histogram Bins for Facial Expression Recognition , 2008, BMVC.

[4]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Albert Ali Salah,et al.  Benchmarking Quality-Dependent and Cost-Sensitive Score-Level Multimodal Biometric Fusion Algorithms , 2009, IEEE Transactions on Information Forensics and Security.

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Mohammed Bennamoun,et al.  A survey of approaches to three-dimensional face recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Arun Ross,et al.  Handbook of Multibiometrics , 2006, The Kluwer international series on biometrics.

[11]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[13]  Alexander M. Bronstein,et al.  Robust Expression-Invariant Face Recognition from Partially Missing Data , 2006, ECCV.

[14]  Mohammed Bennamoun,et al.  Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition , 2007, International Journal of Computer Vision.

[15]  Liming Chen,et al.  A novel geometric facial representation based on multi-scale extended local binary patterns , 2011, Face and Gesture 2011.

[16]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  T. Faltemier.  Flexible and robust 3D face recognition , 2008 .

[18]  Raimondo Schettini,et al.  Detection and Restoration of Occlusions for 3D Face Recognition , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[19]  Hassen Drira,et al.  Pose and Expression-Invariant 3D Face Recognition using Elastic Radial Curves , 2010, BMVC.

[20]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Sen Wang,et al.  3D Surface Matching and Recognition Using Conformal Geometry , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Anil K. Jain,et al.  Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.