Fusion of appearance-based face recognition algorithms

Although many algorithms have been proposed, face recognition and verification systems can guarantee a good level of performances only for controlled environments. In order to improve the performance and robustness of face recognition and verification systems, multi-modal and mono-modal systems based on the fusion of multiple recognisers using different or similar biometrics have been proposed, especially for verification purposes. In this paper, a recognition and verification system based on the combination of two well-known appearance-based representations of the face, namely, principal component analysis (PCA) and linear discriminant analysis (LDA), is proposed. Both PCA and LDA are used as feature extractors from frontal view images. The benefits of such a fusion are shown for different environmental conditions, namely, ideal conditions, characterised by a very limited variability of environmental parameters, and real conditions with a large variability of lighting, scale and facial expression.

[1]  Olivier Y. de Vel,et al.  Line-Based Face Recognition under Varying Pose , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Gérard Chollet,et al.  Multilevel data fusion approach for gradually upgrading the performances of identity verification systems , 1999, Defense, Security, and Sensing.

[3]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[4]  Josef Kittler,et al.  Multiple Classifier Systems , 2004, Lecture Notes in Computer Science.

[5]  Jiri Matas,et al.  On Matching Scores for LDA-based Face Verification , 2000, BMVC.

[6]  Keinosuke Fukunaga,et al.  Statistical Pattern Recognition , 1993, Handbook of Pattern Recognition and Computer Vision.

[7]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[8]  Jing-Yu Yang,et al.  A generalized optimal set of discriminant vectors , 1992, Pattern Recognit..

[9]  Hong Yan,et al.  Face recognition by fractal transformations , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[10]  Jian Yang,et al.  Why can LDA be performed in PCA transformed space? , 2003, Pattern Recognit..

[11]  Kazuo Kyuma,et al.  Face Recognition System Using Local Autocorrelations and Multiscale Integration , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  S M Lucas.  The Continuous N-tuple Classiier and Its Application to Face Recognition , .

[13]  Alex Pentland,et al.  Eigenfaces for Face Recognition , 1991 .

[14]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[15]  Juergen Luettin,et al.  Evaluation Protocol for the extended M2VTS Database (XM2VTSDB) , 1998 .

[16]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[17]  Anastasios Tefas,et al.  Morphological elastic graph matching applied to frontal face authentication under well-controlled and real conditions , 2000, Pattern Recognit..

[18]  David G. Stork,et al.  Pattern Classification , 1973 .

[19]  Gian Luca Marcialis,et al.  Fusion of Face Recognition Algorithms for Video-Based Surveillance Systems , 2003 .

[20]  Rama Chellappa,et al.  Discriminant analysis of principal components for face recognition , 1998 .

[21]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Josef Kittler,et al.  Fixed and trained combiners for fusion of imbalanced pattern classifiers , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[23]  Sharath Pankanti,et al.  Biometrics, Personal Identification in Networked Society: Personal Identification in Networked Society , 1998 .

[24]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[25]  Rama Chellappa,et al.  Discriminant analysis of principal components for face recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[26]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[27]  Gian Luca Marcialis,et al.  Fusion of LDA and PCA for Face Verification , 2002, Biometric Authentication.

[28]  J. L. Wayman,et al.  Best practices in testing and reporting performance of biometric devices. , 2002 .

[29]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[31]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[32]  J. van Leeuwen,et al.  Audio- and Video-Based Biometric Person Authentication , 2001, Lecture Notes in Computer Science.

[33]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[34]  Penio S. Penev,et al.  Local feature analysis: A general statistical theory for object representation , 1996 .

[35]  Abdul Nasser S. Abu-Rezq,et al.  Combined Classifiers for Invariant Face Recognition , 2000, Pattern Analysis & Applications.

[36]  Sun-Yuan Kung,et al.  Face recognition/detection by probabilistic decision-based neural network , 1997, IEEE Trans. Neural Networks.

[37]  A. S. Tolba,et al.  Combined Classifiers for Invariant Face Recognition , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[38]  Horst Bunke,et al.  Combination of Classifiers on the Decision Level for Face Recognition , 1996 .

[39]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[40]  Anil K. Jain,et al.  Combining classifiers for face recognition , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[41]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.