A Face and Speech Biometric Verification System Using a Simple Bayesian Structure

Identity verification systems that use a mono modal biometric always have to contend with sensor noise and limitations of the feature extractor and matcher, while combining information from different biometrics modalities may well provide higher and more consistent performance levels. However, an intelligent scheme is required to fuse the decisions produced by the individual sensors. This paper presents a decision fusion technique for a bimodal biometric verification system that makes use of facial and speech biometrics. The decision fusion schemes considered have simple Bayesian structures (SBS) that particularize the univariat Gaussian density function, Beta density function or Parzen window density estimation. SBS has advantages in terms of computation speed, storage space and its open framework. The performances of SBS is evaluated and compared with that of other classical classification approaches, such as sum rule and Multilayer Perceptron, on a bimodal database.

[1]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Rainer Martin,et al.  Spectral Subtraction Based on Minimum Statistics , 2001 .

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  Bernhard Fröba,et al.  SESAM: A Biometric Person Identification System Using Sensor Fusion , 1997, AVBPA.

[5]  Stefan Fischer,et al.  Expert Conciliation for Multi Modal Person Authentication Systems by Bayesian Statistics , 1997, AVBPA.

[6]  Souheil Ben-Yacoub Multi-Modal Data Fusion for Person Authentication using SVM , 1998 .

[7]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[8]  Richard J. Mammone,et al.  A fast algorithm for finding the adaptive component weighted cepstrum for speaker recognition , 1997, IEEE Trans. Speech Audio Process..

[9]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[10]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Andrew Beng Jin Teoh,et al.  Eye detection using hybrid rule based approach and contour mapping , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[12]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[13]  Tanzeem Choudhury,et al.  Multimodal person recognition using unconstrained audio and video , 1998 .

[14]  Stefan Fischer,et al.  Person Authentication by Fusing Face and Speech Information , 1997, AVBPA.

[15]  Belur V. Dasarathy,et al.  Decision fusion , 1994 .

[16]  Kuldip K. Paliwal,et al.  TRAINING METHOD OF A PIECEWISE LINEAR CLASSIFIER FOR A MULTI-MODAL PERSON VERIFICATION SYSTEM , 2007 .

[17]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Tieniu Tan,et al.  Combining Face and Iris Biometrics for Identity Verification , 2003, AVBPA.

[19]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[21]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .