Bi-modal Face Recognition - How combining 2D and 3D Clues Can Increase the Precision

This paper introduces a bi-modal face recognition approach. The objective is to study how combining depth and intensity information can increase face recognition precision. In the proposed approach, local features based on LBP (Local Binary Pattern) and DLBP (Depth Local Binary Pattern) are extracted from intensity and depth images respectively. Our approach combines the results of classifiers trained on extracted intensity and depth cues in order to identify faces. Experiments are performed on three datasets: Texas 3D face dataset, BOSPHORUS 3D face dataset and FRGC 3D face dataset. The obtained results demonstrate the enhanced performance of the proposed method compared to mono-modal (2D or 3D) face recognition. Most processes of the proposed system are performed automatically. It leads to a potential prototype of face recognition using the latest RGB-D sensors, such as Microsoft Kinect or Intel RealSense 3D Camera.

[1]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[2]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Hyeran Byun,et al.  Applications of Support Vector Machines for Pattern Recognition: A Survey , 2002, SVM.

[4]  Tieniu Tan,et al.  Automatic 3D face recognition from depth and intensity Gabor features , 2009, Pattern Recognit..

[5]  Erkki Oja,et al.  Texture discrimination with multidimensional distributions of signed gray-level differences , 2001, Pattern Recognit..

[6]  Chabane Djeraba,et al.  DLBP: A novel descriptor for depth image based face recognition , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[7]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Kuo-Chin Fan,et al.  Local vector pattern in high-order derivative space for face recognition , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[11]  Kuo-Chin Fan,et al.  A Novel Local Pattern Descriptor—Local Vector Pattern in High-Order Derivative Space for Face Recognition , 2014, IEEE Transactions on Image Processing.

[12]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[13]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[15]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[16]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[17]  Liming Chen,et al.  Asymmetric 3D/2D face recognition based on LBP facial representation and canonical correlation analysis , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Alan C. Bovik,et al.  Texas 3D Face Recognition Database , 2010, 2010 IEEE Southwest Symposium on Image Analysis & Interpretation (SSIAI).

[19]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Tieniu Tan,et al.  Combining Statistics of Geometrical and Correlative Features for 3D Face Recognition , 2006, BMVC.

[21]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[22]  TanTieniu,et al.  Automatic 3D face recognition from depth and intensity Gabor features , 2009 .

[23]  Alan C. Bovik,et al.  Passive Multimodal 2-D+3-D Face Recognition Using Gabor Features and Landmark Distances , 2011, IEEE Transactions on Information Forensics and Security.

[24]  Yohan. jin,et al.  2013 Ieee Conference on Computer Vision and Pattern Recognition Workshops 2013 Ieee Conference on Computer Vision and Pattern Recognition Workshops 2013 Ieee Conference on Computer Vision and Pattern Recognition Workshops 2013 Ieee Conference on Computer Vision and Pattern Recognition Workshops , 2022 .