Kernel-based multimodal biometric verification using quality signals

A novel kernel-based fusion strategy is presented. It is based on SVM classifiers, trade-off coefficients introduced in the standard SVM training and testing procedures, and quality measures of the input biometric signals. Experimental results on a prototype application based on voice and fingerprint traits are reported. The benefits of using the two modalities as compared to only using one of them are revealed. This is achieved by using a novel experimental procedure in which multi-modal verification performance tests are compared with multi-probe tests of the individual subsystems. Appropriate selection of the parameters of the proposed quality-based scheme leads to a quality-based fusion scheme outperforming the raw fusion strategy without considering quality signals. In particular, a relative improvement of 18% is obtained for small SVM training set size by using only fingerprint quality labels.

[1]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Gérard Chollet,et al.  Multi-modal identity verification using expert fusion , 2000, Inf. Fusion.

[3]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[4]  Anil K. Jain,et al.  FVC2000: Fingerprint Verification Competition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  E. Mayoraz,et al.  Fusion of face and speech data for person identity verification , 1999, IEEE Trans. Neural Networks.

[8]  Patrick Verlinde,et al.  Multi-modal identity verification using support vector machines (SVM) , 2000, Proceedings of the Third International Conference on Information Fusion.

[9]  B.S. Atal,et al.  Automatic recognition of speakers from their voices , 1976, Proceedings of the IEEE.

[10]  Xudong Jiang,et al.  Fingerprint quality and validity analysis , 2002, Proceedings. International Conference on Image Processing.

[11]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[12]  Arun Ross,et al.  Learning user-specific parameters in a multibiometric system , 2002, Proceedings. International Conference on Image Processing.

[13]  Stefan Fischer,et al.  Expert Conciliation for Multi Modal Person Authentication Systems by Bayesian Statistics , 1997, AVBPA.

[14]  Alvin F. Martin,et al.  The DET curve in assessment of detection task performance , 1997, EUROSPEECH.

[15]  David G. Stork,et al.  Pattern Classification , 1973 .

[16]  Sharath Pankanti,et al.  An identity-authentication system using fingerprints , 1997, Proc. IEEE.

[17]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[18]  J. González-Rodríguez,et al.  Image quality and position variability assessment in minutiae-based fingerprint verification , 2003 .

[19]  Elizabeth Saers Bigün,et al.  Risk analysis of catastrophes using experts' judgements: An empirical study on risk analysis of major civil aircraft accidents in Europe , 1995 .

[20]  Julian Fiérrez,et al.  A Comparative Evaluation of Fusion Strategies for Multimodal Biometric Verification , 2003, AVBPA.

[21]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[22]  Takeo Kanade,et al.  Picture Processing System by Computer Complex and Recognition of Human Faces , 1974 .

[23]  J. Bigun,et al.  Optimal Orientation Detection of Linear Symmetry , 1987, ICCV 1987.

[24]  Wei-Yun Yau,et al.  Fusion of Auxiliary Information for Multi-modal Biometrics Authentication , 2004, ICBA.

[25]  Julian Fiérrez,et al.  On the use of quality measures for text-independent speaker recognition , 2004, Odyssey.

[26]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[27]  Julian Fiérrez,et al.  Multimodal biometric authentication using quality signals in mobile communications , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[28]  Julian Fiérrez,et al.  Exploiting general knowledge in user-dependent fusion strategies for multimodal biometric verification , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[29]  Fabrizio Smeraldi,et al.  Multi-Modal Person Authentication , 1998 .