Gaussian Mixture Models based on the Phase Spectra for Illumination Invariant Face Identification on the Yale Database

The appearance of a face is severely altered by illumination conditions that makes automatic face recognition a challenging task. In [14], we introduced an illumination- invariant face identification method based on Gaussian Mixture Models (GMM) and the phase spectra of the Fourier Transform of images. In this paper we explore the application of this identification scheme on the Yale database that contains images with a greater degree of illumination variations. The novelty of our approach is that the model is able to capture the illumination variations so aptly that it yields satisfactory results without an illumination normalization unlike most existing methods. Identification based on a MAP estimate achieves misclassitication error rate of 3.5% and a low verification rate of 0.4% on this database with 10 people and 64 different illumination conditions. Both these sets of results are significantly better than those obtained from traditional PCA and LDA classifiers. We next show that upon illumination normalization, our method succeeds in attaining near-perfect results using the reconstructed images. A rigorous comparison with existing state-of-the-art approaches demonstrates that our proposed technique outperforms all of those. Furthermore, some statistical analyses pertaining to Bayesian model selection and large-scale performance evaluation based on random effects model are included.

[1]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[2]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[3]  S. Mitra,et al.  Gaussian mixture models based on the frequency spectra for human identification and illumination classification , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[4]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  S. E. Hills,et al.  Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling , 1990 .

[6]  A. Yuille Deformable Templates for Face Recognition , 1991, Journal of Cognitive Neuroscience.

[7]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Song-Chun Zhu,et al.  Minimax Entropy Principle and Its Application to Texture Modeling , 1997, Neural Computation.

[9]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[10]  P. Khosla,et al.  Face Verification using Correlation Filters , 2002 .

[11]  Ralph Gross,et al.  Appearance-based face recognition and light-fields , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Raghu Machiraju,et al.  A bilinear illumination model for robust face recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  M. Hayes The reconstruction of a multidimensional sequence from the phase or magnitude of its Fourier transform , 1982 .

[14]  David J. Kriegman,et al.  Nine points of light: acquiring subspaces for face recognition under variable lighting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  Marios Savvides,et al.  Correction to "Statistical Performance Evaluation of Biometric Authentication Systems Using Random Effects Models" , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Haitao Wang,et al.  Face recognition under varying lighting conditions using self quotient image , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[17]  Dorin Comaniciu,et al.  Illumination normalization for face recognition and uneven background correction using total variation based image models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Meng Joo Er,et al.  Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Pradeep K. Khosla,et al.  "Corefaces" - robust shift invariant PCA based correlation filter for illumination tolerant face recognition , 2004, CVPR 2004.

[20]  T. Hassard,et al.  Applied Linear Regression , 2005 .

[21]  Kin-Man Lam,et al.  Face recognition under varying illumination based on a 2D face shape model , 2005, Pattern Recognit..

[22]  Song-Chun Zhu,et al.  Learning inhomogeneous Gibbs model of faces by minimax entropy , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Kin-Man Lam,et al.  Illumination invariant face recognition , 2005, Pattern Recognit..