Multi-modal identity verification using expert fusion

The contribution of this paper is to compare paradigms coming from the classes of parametric, and non-parametric techniques to solve the decision fusion problem encountered in the design of a multi-modal biometrical identity verification system. The multimodal identity verification system under consideration is built of d modalities in parallel, each one delivering as output a scalar number, called score, stating how well the claimed identity is verified. A decision fusion module receiving as input the d scores has to take a binary decision: accept or reject the claimed identity. We have solved this fusion problem using parametric and non-parametric classifiers. The performances of all these fusion modules have been evaluated and compared with other approaches on a multi-modal database, containing both vocal and visual biometric modalities. ” 2000 Elsevier Science B.V. All rights reserved.

[1]  W. W. Daniel.  Applied Nonparametric Statistics , 1979 .

[2]  P. Verlinde,et al.  Decision fusion using a multi-linear classifier , 1998 .

[3]  Gilbert Saporta,et al.  Probabilités, Analyse des données et statistique , 1991 .

[4]  H. V. Trees.  Detection, Estimation, And Modulation Theory , 2001 .

[5]  Ramanarayanan Viswanathan,et al.  Optimal serial distributed decision fusion , 1988 .

[6]  L. Ljung.  Convergence analysis of parametric identification methods , 1978 .

[7]  Luc Vandendorpe,et al.  Profile Authentication Using a Chamfer Matching Algorithm , 1997, AVBPA.

[8]  James L. Wayman,et al.  Technical Testing and Evaluation of Biometric Identification Devices , 1996 .

[9]  Bernhard Fröba,et al.  SESAM: A Biometric Person Identification System Using Sensor Fusion , 1997, AVBPA.

[10]  P. Verlinde,et al.  Applying Bayes based classifiers for decision fusion in a multi-modal identity verification system , 1999 .

[11]  Ivan Magrin-Chagnolleau,et al.  Second-order statistical measures for text-independent speaker identification , 1995, Speech Commun..

[12]  D. F. Morrison,et al.  Multivariate Statistical Methods , 1968 .

[13]  Roberto Brunelli,et al.  Person identification using multiple cues , 1995, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[15]  Jiri Matas,et al.  Fast face localisation and verification , 1999, Image Vis. Comput..

[16]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[17]  G. Chollet,et al.  Evaluating speech recognizers and data bases , 1988 .

[18]  Gopal Kanji,et al.  100 Statistical Tests , 1994 .

[19]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ramanarayanan Viswanathan,et al.  Optimal serial distributed decision fusion , 1987, 26th IEEE Conference on Decision and Control.

[21]  Shaogang Gong,et al.  Audio- and Video-based Biometric Person Authentication , 1997, Lecture Notes in Computer Science.

[22]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[23]  L.W. Nolte,et al.  Design and Performance Comparison of Distributed Detection Networks , 1987, IEEE Transactions on Aerospace and Electronic Systems.

[24]  Tanzeem Choudhury,et al.  Multimodal person recognition using unconstrained audio and video , 1998 .

[25]  Juergen Luettin,et al.  Acoustic-labial Speaker Verification , 1997, AVBPA.

[26]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[27]  Gérard Chollet,et al.  Comparing decision fusion paradigms using -NN based classifiers, decision trees and logistic regression in a multi-modal identity verification ap plication , 1999 .

[28]  Stefan Fischer,et al.  Person Authentication by Fusing Face and Speech Information , 1997, AVBPA.

[29]  Gérard Chollet,et al.  Assessment of speaker verification systems , 1995 .

[30]  Stephane Pigeon,et al.  AUTHENTIFICATION MULTIMODALE D'IDENTIT ´ E , 1999 .

[31]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[32]  Souheil Ben-Yacoub.  Multi-Modal Data Fusion for Person Authentication using SVM , 1998 .

[33]  Khalid Choukri.  Several approaches to speaker adaptation in automatic speech recognizers : Original French title: Quelques approches pour l'adaptation aux locuteurs en reconnaissance automatique de la parole , 1988, Speech Commun..

[34]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Pierre A. Devijver.  Pattern recognition , 1982 .

[36]  Alvin F. Martin,et al.  The DET curve in assessment of detection task performance , 1997, EUROSPEECH.

[37]  Gérard Chollet,et al.  Audio- and Video-based Biometric Person Authentication: First International Conference, AVBPA '97, Crans-Montana, Switzerland, March 12 - 14, 1997, Proceedings , 1997 .

[38]  Gérard Chollet,et al.  Multilevel data fusion approach for gradually upgrading the performances of identity verification systems , 1999, Defense, Security, and Sensing.

[39]  John Oglesby.  What's in a number? Moving beyond the equal error rate , 1995, Speech Commun..

[40]  A. Gualtierotti.  H. L. Van Trees, Detection, Estimation, and Modulation Theory, , 1976 .

[41]  John S. D. Mason,et al.  Integration of acoustic and visual speech for speaker recognition , 1993, EUROSPEECH.

[42]  A Rubio.  First International Conference on Language Resources and Evaluation , 1998 .

[43]  D. V. Lindley,et al.  Applied nonparametric statistical methods , 1988 .

[44]  Belur V. Dasarathy,et al.  Decision fusion , 1994 .

[45]  Gérard Chollet,et al.  Proceedings of the First International Conference on Audio- and Video-Based Biometric Person Authentication , 1997 .

[46]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Stefan Fischer,et al.  Expert Conciliation for Multi Modal Person Authentication Systems by Bayesian Statistics , 1997, AVBPA.

[48]  Thomas G. Dietterich.  Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[49]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  S. Shott,et al.  Nonparametric Statistics , 2018, The Encyclopedia of Archaeological Sciences.

[51]  Anil K. Jain,et al.  Integrating Faces and Fingerprints for Personal Identification , 1998, IEEE Trans. Pattern Anal. Mach. Intell..