Illumination Normalization Using Self-lighting Ratios for 3D2D Face Recognition

3D2D face recognition is beginning to gain attention from the research community. It takes advantage of 3D facial geometry to normalize the head pose and registers it into a canonical 2D space. In this paper, we present a novel illumination normalization approach for 3D2D face recognition which does not require any training or prior knowledge on the type, number, and direction of the lighting sources. Estimated using an image-specific filtering technique in the frequency domain, a self-lighting ratio is employed to suppress illumination differences. Experimental results on the UHDB11 and FRGC databases indicate that the proposed approach improves the performance significantly for face images with large illumination variations.

[1]  Rama Chellappa,et al.  Robust Estimation of Albedo for Illumination-invariant Matching and Shape Recovery , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[3]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Michael J. Jones,et al.  Morphable Reflectance Fields for enhancing face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Thomas Deselaers,et al.  ClassCut for Unsupervised Class Segmentation , 2010, ECCV.

[7]  Lei Zhang,et al.  Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[9]  Alice J. O'Toole,et al.  FRVT 2006 and ICE 2006 Large-Scale Experimental Results , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jiebo Luo,et al.  A Subspace Model-Based Approach to Face Relighting Under Unknown Lighting and Poses , 2008, IEEE Transactions on Image Processing.

[11]  Gang Hua,et al.  Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Rama Chellappa,et al.  Pose-robust albedo estimation from a single image , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Josef Kittler,et al.  Robust albedo estimation from face image under unknown illumination , 2008, SPIE Defense + Commercial Sensing.

[14]  Volker Blanz,et al.  Face recognition based on a 3D morphable model , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[15]  Zihan Zhou,et al.  Nearest-Subspace Patch Matching for face recognition under varying pose and illumination , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[16]  Qinping Zhao,et al.  Face illumination transfer through edge-preserving filters , 2011, CVPR 2011.

[17]  Ioannis A. Kakadiaris,et al.  Bidirectional relighting for 3D-aided 2D face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Faisal R. Al-Osaimi,et al.  Illumination normalization of facial images by reversing the process of image formation , 2011, Machine Vision and Applications.

[19]  Chong-Ho Choi,et al.  Robust albedo estimation from a facial image with cast shadow , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  David R. Bull,et al.  Projective image restoration using sparsity regularization , 2013, 2013 IEEE International Conference on Image Processing.

[21]  Jian-Jun Zhang,et al.  Self quotient image for face recognition , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[22]  Jiansheng Chen,et al.  Face Image Relighting using Locally Constrained Global Optimization , 2010, ECCV.

[23]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Tatsuo Arai,et al.  Illumination Normalization for Outdoor Face Recognition by Using Ayofa-Filters , 2011 .

[25]  Wen Gao,et al.  Illumination transfer using homomorphic wavelet filtering and its application to light-insensitive face recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[26]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[27]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).