"Corefaces" - robust shift invariant PCA based correlation filter for illumination tolerant face recognition

In this paper we present a novel method for performing robust illumination-tolerant face recognition. We show that this method works well even when presented with partial test faces which are also captured under variable illumination and outperforms other competing face recognition algorithms. Our method is a hybrid PCA-correlation filter which links the best of two major approaches in face recognition; principal component analysis (PCA) for capturing the variability in a set of training images and advanced correlation filters which have attractive features such as illumination tolerance, shift-invariance, and can handle occlusions. We examine how these filters work and why our proposed method is able to perform better. We call our method 'Corefaces' as it seeks to model the 'core' face representation that remains relatively invariant to illumination variations. We show comparative results using the illumination subset of CMU-PIE database consisting of 65 people, and Yale-B illumination database and compare with other standard methods such as the illumination subspace method and Fisherfaces.

[1]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  T. Kanade,et al.  Combining Models and Exemplars for Face Recognition: An Illuminating Example , 2001 .

[3]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Ralph Gross,et al.  Quo vadis Face Recognition , 2001 .

[5]  D. Casasent,et al.  Minimum average correlation energy filters. , 1987, Applied optics.

[6]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  A. Oppenheim,et al.  Signal reconstruction from phase or magnitude , 1980 .

[8]  Marios Savvides,et al.  Robust shift-invariant biometric identification from partial face images , 2004, SPIE Defense + Commercial Sensing.

[9]  B. V. K. Vijaya Kumar,et al.  Cancelable biometric filters for face recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  B. V. K. Vijaya Kumar,et al.  Illumination Normalization Using Logarithm Transforms for Face Authentication , 2003, AVBPA.

[11]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[12]  A. B. Vander Lugt,et al.  Signal detection by complex spatial filtering , 1964, IEEE Trans. Inf. Theory.

[13]  Horst Bischof,et al.  Dealing with occlusions in the eigenspace approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  B. V. Vijaya Kumar,et al.  Unconstrained correlation filters. , 1994, Applied optics.

[15]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[16]  B. V. K. Vijaya Kumar,et al.  Quad Phase Minimum Average Correlation Energy Filters for Reduced Memory Illumination Tolerant Face Authentication , 2003, AVBPA.

[17]  David J. Kriegman,et al.  What Is the Set of Images of an Object Under All Possible Illumination Conditions? , 1998, International Journal of Computer Vision.

[18]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[19]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[20]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.