Comparison of face matching techniques under pose variation

The ability to match faces in video is a crucial component for many multimedia applications such as searching and recognizing people in semantic video browsing, surveillance and home video management systems. Unfortunately, most face matching methods were designed for and tested on frontal face images only, which does not comply with the professional and home video scenarios. In video, faces appear at different poses and scales, and the image quality may vary as well. In this paper we analyzed to what extent well-known face matching methods are suitable for matching faces in video. We performed a comparison between the local method Elastic Bunch Graph Matching, the global approaches principle component analysis (PCA) and PCA with linear discriminant analysis (PCA+LDA). The outcome of this study is that while in cases of small face pose variations Elastic Bunch Graph Matching works slightly better, for large face pose variations the global methods provide better performance.

[1]  Dahua Lin,et al.  Recognize High Resolution Faces: From Macrocosm to Microcosm , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Rama Chellappa,et al.  From sample similarity to ensemble similarity: probabilistic distance measures in reproducing kernel Hilbert space , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ben A. M. Schouten,et al.  Learning a Sparse Representation from Multiple Still Images for On-Line Face Recognition in an Unconstrained Environment , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  Andrea Lagorio,et al.  On the Use of SIFT Features for Face Authentication , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[6]  Saman K. Halgamuge,et al.  Optimised landmark model matching for face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[7]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[8]  Phalguni Gupta,et al.  Illumination Invariant Elastic Bunch Graph Matching for Efficient Face Recognition , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[9]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[10]  Bruce A. Draper,et al.  The CSU Face Identification Evaluation System: Its Purpose, Features, and Structure , 2003, ICVS.

[11]  Paola Campadelli,et al.  A feature-based face recognition system , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[12]  Aristodemos Pnevmatikakis,et al.  Impact of Face Registration Errors on Recognition , 2006, AIAI.

[13]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Xiaoou Tang,et al.  Face recognition using discrete wavelet graph , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[15]  Andrew Zisserman,et al.  Person Spotting: Video Shot Retrieval for Face Sets , 2005, CIVR.

[16]  Roberto Cipolla,et al.  Face Recognition from Video Using the Generic Shape-Illumination Manifold , 2006, ECCV.

[17]  J. Crowley,et al.  Estimating Face orientation from Robust Detection of Salient Facial Structures , 2004 .

[18]  Joni-Kristian Kämäräinen,et al.  Invariance properties of Gabor filter-based features-overview and applications , 2006, IEEE Transactions on Image Processing.

[19]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[20]  Rama Chellappa,et al.  Discriminant analysis of principal components for face recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[21]  David Bordwell,et al.  Film Art: An Introduction , 1979 .