Bidirectional relighting for 3D-aided 2D face recognition

In this paper, we present a new method for bidirectional relighting for 3D-aided 2D face recognition under large pose and illumination changes. During subject enrollment, we build subject-specific 3D annotated models by using the subjects' raw 3D data and 2D texture. During authentication, the probe 2D images are projected onto a normalized image space using the subject-specific 3D model in the gallery. Then, a bidirectional relighting algorithm and two similarity metrics (a view-dependent complex wavelet structural similarity and a global similarity) are employed to compare the gallery and probe. We tested our algorithms on the UHDB11 and UHDB12 databases that contain 3D data with probe images under large lighting and pose variations. The experimental results show the robustness of our approach in recognizing faces in difficult situations.

[1]  Jean-Luc Dugelay,et al.  Geometric invariants for 2D/3D face recognition , 2007, Pattern Recognit. Lett..

[2]  Raghu Machiraju,et al.  Estimation of 3D faces and illumination from single photographs using a bilinear illumination model , 2005, EGSR '05.

[3]  Ioannis A. Kakadiaris,et al.  An Automated Method for Human Face Modeling and Relighting with Application to Face Recognition , 2007 .

[4]  Liming Chen,et al.  Asymmetric 3D/2D face recognition based on LBP facial representation and canonical correlation analysis , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Gang Hua,et al.  Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[9]  Lijun Yin,et al.  3D face recognition based on high-resolution 3D face modeling from frontal and profile views , 2003, WBMA '03.

[10]  Rama Chellappa,et al.  Robust Estimation of Albedo for Illumination-invariant Matching and Shape Recovery , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Zihan Zhou,et al.  Nearest-Subspace Patch Matching for face recognition under varying pose and illumination , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[12]  Michael G. Strintzis,et al.  A 2D+3D face identification system for surveillance applications , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[13]  PortillaJavier,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000 .

[14]  Edwin R. Hancock,et al.  Estimating the albedo map of a face from a single image , 2005, IEEE International Conference on Image Processing 2005.

[15]  Zhou Wang,et al.  Translation insensitive image similarity in complex wavelet domain , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[16]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[17]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[18]  Robert P. W. Duin,et al.  A Generalized Kernel Approach to Dissimilarity-based Classification , 2002, J. Mach. Learn. Res..

[19]  David W. Jacobs,et al.  Surface Dependent Representations for Illumination Insensitive Image Comparison , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Alice J. O'Toole,et al.  FRVT 2006 and ICE 2006 Large-Scale Experimental Results , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..