Subjective Logic Based Score Level Fusion: Combining Faces and Fingerprints

Biometric systems are prone to random and systematic errors which are typically attributed to the variations in terms of inter-session data capture and intra-session variability. Furthermore, these errors cannot be defined and modeled mathematically in many cases, but we can associate them with uncertainty based on certain conditions. In such cases, one of the possible approach to improve biometric system performance is to employ multi-biometric fusion by incorporating the uncertainties. In the literature, researchers have proposed many fusion techniques, but most of these techniques do not take uncertainty into account while performing fusion. Since the decision made by uni-modal biometric comparators do not consider the uncertainty involved in such decisions, it is essential first to model the uncertainty before combining the decision from multiple uni-modal biometric systems efficiently. To this end, we propose a score level multi-biometric fusion scheme using Subjective Logic which incorporates the uncertainty of the system's information channels while fusing the scores. Extensive experiments are carried out on the multi-biometric NIST BSSR1, and the proposed scheme has indicated a superior performance with a genuine match rate of 99.02 % at a false match rate fixed to 0.01 %.

[1]  A. Jøsang Artificial Reasoning with Subjective Logic , 2008 .

[2]  Renbiao Wu,et al.  Multi-fingerprint Information Fusion for Personal Identification Based on Improved Dempster-Shafer Evidence Theory , 2009, 2009 International Conference on Electronic Computer Technology.

[3]  Kiran B. Raja,et al.  Fusing Biometric Scores Using Subjective Logic for Gait Recognition on Smartphone , 2017, 2017 International Conference of the Biometrics Special Interest Group (BIOSIG).

[4]  Massimo Tistarelli,et al.  Face recognition by fusion of local and global matching scores using DS theory: An evaluation with uni-classifier and multi-classifier paradigm , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Audun Jøsang,et al.  Biometric data fusion based on subjective logic , 2014, 17th International Conference on Information Fusion (FUSION).

[6]  Mohamed A. Deriche,et al.  A New Technique for Combining Multiple Classifiers using The Dempster-Shafer Theory of Evidence , 2002, J. Artif. Intell. Res..

[7]  Messaoud Bengherabi,et al.  Score fusion of face and voice using Dempster-Shafer theory for person authentication , 2011, 2011 11th International Conference on Intelligent Systems Design and Applications.

[8]  Audun Jøsang,et al.  Subjective Logic , 2016, Artificial Intelligence: Foundations, Theory, and Algorithms.

[9]  Arun Ross,et al.  On the Dynamic Selection of Biometric Fusion Algorithms , 2010, IEEE Transactions on Information Forensics and Security.

[10]  Mohammad H. Mahoor,et al.  A Multimodal Approach for Face Modeling and Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[11]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[12]  Sridha Sridharan,et al.  Score-Level Multibiometric Fusion Based on Dempster–Shafer Theory Incorporating Uncertainty Factors , 2015, IEEE Transactions on Human-Machine Systems.

[13]  Nicole Vincent,et al.  A fusion methodology based on Dempster-Shafer evidence theory for two biometric applications , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Phalguni Gupta,et al.  Multimodal Belief Fusion for Face and Ear Biometrics , 2009, Intell. Inf. Manag..

[15]  Richa Singh,et al.  Dempster-Shafer Theory Based Classifier Fusion for Improved Fingerprint Verification Performance , 2006, ICVGIP.

[16]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.