Evidences of Equal Error Rate Reduction in Biometric Authentication Fusion

Multimodal biometric authentication (BA) has shown perennial successes both in research and applications. This paper casts a light on why BA systems can be improved by fusing opinions of different experts, principally due to diversity of biometric modalities, features, classifiers and samples. These techniques are collectively called variance reduction (VR) techniques. A thorough survey was carried out and showed that these techniques have been employed in one way or another in the literature, but there was no systematic comparison of these techniques, as done here. Despite the architectural diversity, we show that the improved classification result is due to reduced (class-dependent) variance. The analysis does not assume that scores to be fused are uncorrelated. It does however assume that the class-dependent scores have Gaussian distributions. As many as 180 independent experiments from different sources show that such assumption is acceptable in practice. The theoretical explanation has its root in regression problems. Our contribution is to relate the reduced variance to a reduced classification error commonly used in BA, called Equal Error Rate. In addition to the theoretical evidence, we carried out as many as 104 fusion experiments using commonly used classifiers on the XM2VTS multimodal database to measure the gain due to fusion. This investigation leads to the conclusion that different ways of exploiting diversity incur different hardware and computation cost. In particular, higher diversity incurs higher computation and sometimes hardware cost and vice-versa. Therefore, this study can serve as an engineering guide to choosing a VR technique that will provide a good trade-off between the level of accuracy required and its associated cost.

[1]  Kuldip K. Paliwal Spectral subband centroids as features for speech recognition , 1997, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings.

[2]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Samy Bengio,et al.  Non-Linear Variance Reduction Techniques in Biometric Authentication , 2003 .

[4]  Sadaoki Furui,et al.  Audio-Visual Person Authentication Using Speech and Ear Images , 2003 .

[5]  Kuldip K. Paliwal,et al.  Fast features for face authentication under illumination direction changes , 2003, Pattern Recognit. Lett..

[6]  Hong Yan,et al.  Comparison of face verification results on the XM2VTFS database , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[7]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[8]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Peter W. McOwan,et al.  Java-Based Internet Biometric Authentication System , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Bernhard Fröba,et al.  SESAM: A Biometric Person Identification System Using Sensor Fusion , 1997, AVBPA.

[11]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[12]  Jiri Matas,et al.  Combining evidence in personal identity verification systems , 1997, Pattern Recognit. Lett..

[13]  Larry S. Davis,et al.  EigenGait: Motion-Based Recognition of People Using Image Self-Similarity , 2001, AVBPA.

[14]  Ching Y. Suen,et al.  A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Juergen Luettin,et al.  Acoustic-labial speaker verification , 1997, Pattern Recognit. Lett..

[16]  Sharath Pankanti,et al.  Biometrics Systems: Anatomy of Performance , 2001 .

[17]  Ajay Kumar,et al.  Integrating palmprint with face for user authentication , 2003 .

[18]  Samy Bengio,et al.  Augmenting Frontal Face Models for Non-Frontal Verification , 2003 .

[19]  Patrick J. Flynn,et al.  Visible-light and Infrared Face Recognition , 2003 .

[20]  Florent Perronnin,et al.  A model of illumination variation for robust face recognition , 2003 .

[21]  Sébastien Marcel,et al.  Comparison of MLP and GMM Classifiers for Face Verification on XM2VTS , 2003, AVBPA.

[22]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[23]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[24]  Ben M. Herbst,et al.  On an automated signature verification system , 1998, IEEE International Symposium on Industrial Electronics. Proceedings. ISIE'98 (Cat. No.98TH8357).

[25]  Jiri Matas,et al.  Face Identification and Verification via ECOC , 2001, AVBPA.

[26]  Christine Marcel Multimodal Identity Verification at IDIAP , 2003 .

[27]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[28]  Arnon D. Cohen,et al.  ON FEATURE SELECTION FOR SPEAKER VERIFICATION , 2002 .

[29]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[30]  Gavin Brown,et al.  Diversity in neural network ensembles , 2004 .

[31]  Daniel P. W. Ellis,et al.  Feature extraction using non-linear transformation for robust speech recognition on the Aurora database , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[32]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[33]  William M. Campbell,et al.  Multimodal Speaker Authentication using Nonacoustic Sensors , 2003 .

[34]  Samy Bengio,et al.  Improving face verification using skin color information , 2002, Object recognition supported by user interaction for service robots.

[35]  Hervé Bourlard,et al.  Phase autocorrelation (PAC) derived robust speech features , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[36]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[37]  Conrad Sanderson,et al.  Automatic Person Verification Using Speech and Face Information , 2003 .

[38]  Juergen Luettin,et al.  Visual Speech and Speaker Recognition , 1997 .

[39]  Luc Vandendorpe,et al.  Independent component analysis for face authentication , 2002 .

[40]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[41]  L. Hong,et al.  Can multibiometrics improve performance , 1999 .

[42]  David Zhang,et al.  Automatic Palmprint Verification , 2001, Int. J. Image Graph..

[43]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Samy Bengio,et al.  Noise-robust multi-stream fusion for text-independent speaker authentication , 2004, Odyssey.

[45]  Sudeep Sarkar,et al.  Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[47]  Samy Bengio,et al.  Improving face authentication using virtual samples , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[48]  Kuldip K. Paliwal,et al.  Information Fusion and Person Verification Using Speech & Face Information , 2002 .

[49]  David Zhang,et al.  Online Palmprint Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Chin-Hui Lee,et al.  Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains , 1994, IEEE Trans. Speech Audio Process..

[51]  David W. Opitz,et al.  An Empirical Evaluation of Bagging and Boosting , 1997, AAAI/IAAI.

[52]  Pieter J. E. Vermeulen,et al.  Combining Information from Multiple Classifiers for Speaker Verification , 1998 .

[53]  Samy Bengio,et al.  An Investigation of Spectral Subband Centroids for Speaker Authentication , 2003 .