An efficient illumination invariant face recognition framework via illumination enhancement and DD-DTCWT filtering

In this paper, it is shown that multiscale analysis of facial structure and features of face images leads to superior recognition rates for images under varying illumination. The proposed method, which is computationally cost effective, significantly suppresses illumination effects. The problem is defined as how better to extract the reflectance portion from a given image. This can be used directly as an input to a dimensionality reduction unit followed by a classifier for recognition purposes. We first assume that an image I(x,y) is a black box consisting of a combination of illumination and reflectance. A new approximation is proposed to enhance the illumination removal phase. As illumination resides in the low-frequency part of image, it is reasonable to consider the use of a high-performance multiresolution transformation to first accurately separate the frequency components of an image. The double-density dual-tree complex wavelet transform (DD-DTCWT), possesses three core advantages, i.e., the transformation is (i) shift-invariant, (ii) directionally selective with no checkerboard effect, (iii) enriched by extra wavelets interpreted as double-density. The output of the first phase is sent to a DD-DTCWT unit to be decomposed into frequency subbands. High-frequency subbands are thresholded and an inverse DD-DTCWT is then applied to subbands to construct a low-frequency raw image, which is followed by a fine-tuning process. Finally, after extracting a mask, feature vector is formed and the principal component analysis (PCA) is used for dimensionality reduction which is then proceeded by the extreme learning machine (ELM) as a classifier to evaluate the performance of the proposed algorithm for face recognition under varying illumination. Unlike similar works, the proposed method is free of any prior information about the face shape, it is systematic and easy to implement, and it can be applied separately on each image. Furthermore, the proposed method which is significantly faster than similar techniques presents a robust behavior against the reduction in the number of images required for the training cycle. Several experiments are performed employing the available well-known databases such as the Yale B, Extended-Yale B, CMU-PIE, FERET, AT&T, and the Labeled Faces in the Wild (LFW). Illustrative examples are given and the results compare favorably to the current results in the literature.

[1]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[3]  Majid Ahmadi,et al.  Illumination invariant feature extraction and mutual-information-based local matching for face recognition under illumination variation and occlusion , 2011, Pattern Recognit..

[4]  Dorin Comaniciu,et al.  Total variation models for variable lighting face recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dimitris A. Karras,et al.  A new class of Zernike moments for computer vision applications , 2007, Inf. Sci..

[6]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  David J. Kriegman,et al.  Nine points of light: acquiring subspaces for face recognition under variable lighting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Siwei Luo,et al.  Illumination ratio image: synthesizing and recognition with varying illuminations , 2003, Pattern Recognit. Lett..

[9]  Driss Aboutajdine,et al.  Local appearance based face recognition method using block based steerable pyramid transform , 2011, Signal Process..

[10]  I. Jolliffe Principal Component Analysis , 2002 .

[11]  Tal Hassner,et al.  Multiple One-Shots for Utilizing Class Label Information , 2009, BMVC.

[12]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[13]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Wan-Chi Siu,et al.  Multiscale directional filter bank with applications to structured and random texture retrieval , 2007, Pattern Recognit..

[15]  Majid Ahmadi,et al.  Tunable halfband-pair wavelet filter banks and application to multifocus image fusion , 2012, Pattern Recognit..

[16]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  N. Kingsbury Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[18]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Manfred Bresch,et al.  Optimizing filter banks for supervised texture recognition , 2002, Pattern Recognit..

[20]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Haitao Wang,et al.  Face recognition under varying lighting conditions using self quotient image , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[22]  Kin-Man Lam,et al.  An efficient illumination normalization method for face recognition , 2006, Pattern Recognit. Lett..

[23]  Alaa Eleyan,et al.  Complex Wavelet Transform-Based Face Recognition , 2008, EURASIP J. Adv. Signal Process..

[24]  J.-C. Huang,et al.  Double-change-detection method for wavelet-based moving-object segmentation , 2004 .

[25]  Wen Gao,et al.  Illumination normalization for robust face recognition against varying lighting conditions , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[26]  Meng Joo Er,et al.  Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[28]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[29]  Javier Ruiz-del-Solar,et al.  Illumination compensation and normalization in eigenspace-based face recognition: A comparative study of different pre-processing approaches , 2008, Pattern Recognit. Lett..

[30]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[31]  Q. M. Jonathan Wu,et al.  Curvelet based face recognition via dimension reduction , 2009, Signal Process..

[32]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[33]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[34]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Xin Yang,et al.  MQI Based Face Recognition Under Uneven Illumination , 2007, ICB.

[36]  Yuan Yan Tang,et al.  Multiscale facial structure representation for face recognition under varying illumination , 2009, Pattern Recognit..

[37]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[38]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Ivan W. Selesnick,et al.  The double-density dual-tree DWT , 2004, IEEE Transactions on Signal Processing.

[40]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[43]  R. Fisher THE STATISTICAL UTILIZATION OF MULTIPLE MEASUREMENTS , 1938 .

[44]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[45]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[46]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[47]  Jing-Yu Yang,et al.  Illumination invariant extraction for face recognition using neighboring wavelet coefficients , 2012, Pattern Recognit..