Optimal Score Level Fusion using Modalities Reliability and Separability Measures

This paper presents two optimal fusion techniques using reliability and separability measures for a multibiometric system, employing fingerprints and voice. In the first method, reliabilities of fingerprint and voice modalities are measured and the integration weights are computed as the ratio of these two reliabilities. The computed reliability ratio is then optimized against the recognition accuracy. The optimizing parameter is estimated in the training/validating phase. Latter is a multi-normalization based fusion scheme, where the separability measures are used as the integration weights to improve the performance of the biometric system. The inter/intra class separability measures and the d-prime separability measures, under various noise conditions are estimated in the training/validation stage. Performance of the proposed methods are compared with that of the baseline techniques using score level fusion. Experimental studies show that, the proposed methods improve global recognition rate and reduce the False Acceptance Rate (FAR) and False Rejection Rate (FRR) over the baseline systems. The advantage of the proposed biometric techniques is that they can be easily integrated into any multibiometric system with score level fusion and find extremely useful in applications especially with less number of available training samples.

[1]  P. S. Sathidevi,et al.  Adaptive Reliability Measure and Optimum Integration Weight for Decision Fusion Audio-visual Speech Recognition , 2011, Journal of Signal Processing Systems.

[2]  P. S. Sathidevi,et al.  Optimization of Integration Weights for a Multibiometric System with Score Level Fusion , 2012, ACITY.

[3]  P. S. Sathidevi,et al.  A new GA optimised Reliability Ratio based integration weight estimation scheme for decision fusion Audio-Visual Speech Recognition , 2011 .

[4]  Gérard Chollet,et al.  Introduction of quality measures in audio-visual identity verification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Aladdin M. Ariyaeeinia,et al.  Qualitative fusion of normalised scores in multimodal biometrics , 2009, Pattern Recognit. Lett..

[6]  Douglas A. Reynolds,et al.  Gaussian Mixture Models , 2018, Encyclopedia of Biometrics.

[7]  Sudeep Sarkar,et al.  Globally Linear Embedding of Biometric Scores: An Empirical Study , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[8]  Cheol Hoon Park,et al.  Robust Audio-Visual Speech Recognition Based on Late Integration , 2008, IEEE Transactions on Multimedia.

[9]  Rama Chellappa,et al.  Multi-biometric cohort analysis for biometric fusion , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Krzysztof Kryszczuk,et al.  Reliability-Based Decision Fusion in Multimodal Biometric Verification Systems , 2007, EURASIP J. Adv. Signal Process..

[11]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[12]  Wei-Yun Yau,et al.  Fingerprint and speaker verification decisions fusion using a functional link network , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Samy Bengio,et al.  Improving Fusion with Margin-Derived Confidence in Biometric Authentication Tasks , 2005, AVBPA.

[14]  Tieniu Tan,et al.  Combining Fingerprint and Voiceprint Biometrics for Identity Verification: an Experimental Comparison , 2004, ICBA.

[15]  Kar-Ann Toh,et al.  Fingerprint and speaker verification decisions fusion , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[16]  Anil K. Jain,et al.  FVC2002: Second Fingerprint Verification Competition , 2002, Object recognition supported by user interaction for service robots.