Three-dimensional face recognition under expression variation

In this paper, we introduce a fully automatic framework for 3D face recognition under expression variation. For 3D data preprocessing, an improved nose detection method is presented. The small pose is corrected at the same time. A new facial expression processing method which is based on sparse representation is proposed subsequently. As a result, this framework enhances the recognition rate because facial expression is the biggest obstacle for 3D face recognition. Then, the facial representation, which is based on the dual-tree complex wavelet transform (DT-CWT), is extracted from depth images. It contains the facial information and six subregions’ information. Recognition is achieved by linear discriminant analysis (LDA) and nearest neighbor classifier. We have performed different experiments on the Face Recognition Grand Challenge database and Bosphorus database. It achieves the verification rate of 98.86% on the all vs. all experiment at 0.1% false acceptance rate (FAR) in the Face Recognition Grand Challenge (FRGC) and 95.03% verification rate on nearly frontal faces with expression changes and occlusions in the Bosphorus database.

[1]  Alberto Del Bimbo,et al.  3D Face Recognition Using Isogeodesic Stripes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[3]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[4]  Hassen Drira,et al.  3D Face Recognition under Expressions, Occlusions, and Pose Variations , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Tieniu Tan,et al.  Learning efficient codes for 3D face recognition , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Gérard G. Medioni,et al.  Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[7]  Dao-Qing Dai,et al.  Face Recognition Using Dual-Tree Complex Wavelet Features , 2009, IEEE Transactions on Image Processing.

[8]  Sridha Sridharan,et al.  Robust 3D Face Recognition from Expression Categorisation , 2007, ICB.

[9]  Thomas Vetter,et al.  Expression invariant 3D face recognition with a Morphable Model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[10]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[11]  Dimitrios Hatzinakos,et al.  Iterative Closest Normal Point for 3D Face Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Tieniu Tan,et al.  Robust 3D Face Recognition Using Learned Visual Codebook , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hao Zhang,et al.  Expression-insensitive 3D face recognition using sparse representation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Patrick J. Flynn,et al.  A Region Ensemble for 3-D Face Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[16]  Berk Gökberk,et al.  Regional Registration for Expression Resistant 3-D Face Recognition , 2010, IEEE Transactions on Information Forensics and Security.

[17]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[18]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[19]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Alberto Del Bimbo,et al.  3D Face Recognition using iso-Geodesic Surfaces , 2007, IRCDL.

[21]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  D. Donoho For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution , 2006 .

[23]  Xiaoou Tang,et al.  Robust 3D Face Recognition by Local Shape Difference Boosting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[25]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Yunhong Wang,et al.  Robust 3D face recognition based on resolution invariant features , 2011, Pattern Recognit. Lett..

[28]  Qiuqi Ruan,et al.  Expression robust three-dimensional face recognition based on gaussian filter and dual-tree complex wavelet transform , 2014, J. Intell. Fuzzy Syst..