Illumination compensation and normalization in eigenspace-based face recognition: A comparative study of different pre-processing approaches

The aim of this work is to investigate illumination compensation and normalization in eigenspace-based face recognition by carrying out an independent comparative study among several pre-processing algorithms. This research is motivated by the lack of direct and detailed comparisons of those algorithms in equal working conditions. The results of this comparative study intend to be a guide for the developers of face recognitions systems. The study focuses on algorithms with the following properties: (i) general purpose, (ii) no modeling steps or training images required, (iii) simplicity, (iv) high speed, and (v) high performance in terms of recognition rates. Thus, herein five different algorithms are compared, by using them as a pre-processing stage in 16 different eigenspace-based face recognition systems. The comparative study is carried out in a face identification scenario using a large amount of images from the PIE, Yale B and Notre Dame face databases. As a result of this study we concluded that the most suitable algorithms for achieving illumination compensation and normalization in eigenspace-based face recognition are SQI and the modified LBP transform.

[1]  David W. Jacobs,et al.  In search of illumination invariants , 2001, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Josef Kittler,et al.  A comparison of photometric normalisation algorithms for face verification , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[3]  Lei Zhang,et al.  Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Javier Ruiz-del-Solar,et al.  Eigenspace-based face recognition: a comparative study of different approaches , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[8]  Andreas Ernst,et al.  Face detection with the modified census transform , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[9]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  J Jobson Daniel,et al.  Retinex Image Processing: Improved Fidelity to Direct Visual Observation , 1996 .

[12]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Haitao Wang,et al.  Face recognition under varying lighting conditions using self quotient image , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[14]  Shimon Ullman,et al.  Face Recognition: The Problem of Compensating for Changes in Illumination Direction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Zia-ur Rahman,et al.  Retinex Image Processing: Improved Fidelity To Direct Visual Observation , 1996, CIC.

[16]  Wen Gao,et al.  Illumination normalization for robust face recognition against varying lighting conditions , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[17]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[18]  David J. Kriegman,et al.  What Is the Set of Images of an Object Under All Possible Illumination Conditions? , 1998, International Journal of Computer Vision.

[19]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[20]  Kin-Man Lam,et al.  An efficient illumination normalization method for face recognition , 2006, Pattern Recognit. Lett..

[21]  Ravi Ramamoorthi,et al.  Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[23]  Siwei Luo,et al.  Illumination ratio image: synthesizing and recognition with varying illuminations , 2003, Pattern Recognit. Lett..

[24]  Alice J. O'Toole,et al.  FRVT 2006 and ICE 2006 large-scale results , 2007 .

[25]  Patrick J. Flynn,et al.  Assessment of Time Dependency in Face Recognition: An Initial Study , 2003, AVBPA.

[26]  Daijin Kim,et al.  Illumination-robust face recognition using ridge regressive bilinear models , 2008, Pattern Recognit. Lett..

[27]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[30]  Meng Joo Er,et al.  Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Ralph Gross,et al.  An Image Preprocessing Algorithm for Illumination Invariant Face Recognition , 2003, AVBPA.

[32]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[33]  Lei Zhang,et al.  Face recognition under variable lighting using harmonic image exemplars , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..