Multimodal Biometric Fusion: Performance under Spoof Attacks

Abstract Biometrics is essentially a pattern recognition system that recognizes an individual using their unique anatomical or behavioral patterns such as face, fingerprint, iris, signature etc. Recent researches have shown that many biometric traits are vulnerable to spoof attacks. Moreover, recent works showed that, contrary to a common belief, multimodal biometric systems in parallel fusion mode can be intruded even if only one trait is spoofed. However, most of the results were obtained using simulated spoof attacks, under the assumption that the spoofed and genuine samples are indistinguishable, which may not be true for all biometric traits. In addition, so far vulnerability of multimodal biometric systems in serial fusion mode against spoof attacks has not been investigated. These issues raise a demand to investigate the robustness of multimodal systems under realistic spoof attacks. In this paper, we empirically investigate the performance of serial and parallel biometric fusion modes under realistic spoof attacks. Preliminary empirical results on real biometric systems made up of face, fingerprint and iris confirm that multimodal biometric systems in both fusion modes are not intrinsically robust against spoof attacks as believed so far. In particular, multimodal biometric systems in serial fusion mode can be even less robust than systems in parallel mode. We also experimentally found that incorporating the biometric sample quality in biometric fusion increases the robustness of the multimodal systems against spoof attacks. In the end, we study the trade-off between performance and robustness of the biometric systems under spoof attacks.

[1]  James J. Little,et al.  Biometric Gait Recognition , 2003, Advanced Studies in Biometrics.

[2]  Bernadette Dorizzi,et al.  Tuning cost and performance in multi-biometric systems: A novel and consistent view of fusion strategies based on the Sequential Probability Ratio Test (SPRT) , 2010, Pattern Recognit. Lett..

[3]  Zahid Akhtar,et al.  Secure Learning Algorithm for Multimodal Biometric Systems against Spoof Attacks , .

[4]  Satoshi Hoshino,et al.  Impact of artificial "gummy" fingers on fingerprint systems , 2002, IS&T/SPIE Electronic Imaging.

[5]  Zahid Akhtar,et al.  Security Analysis of Multimodal Biometric Systems against Spoof Attacks , 2011, ACC.

[6]  John Daugman,et al.  Probing the Uniqueness and Randomness of IrisCodes: Results From 200 Billion Iris Pair Comparisons , 2006, Proceedings of the IEEE.

[7]  Zhaohui Wu,et al.  Liveness Detection for Face Recognition , 2008 .

[8]  Gian Luca Marcialis,et al.  Perceptron-based Fusion of Multiple Fingerprint Matchers , 2003 .

[9]  Zahid Akhtar,et al.  Spoof Attacks on Multimodal Biometric Systems , 2011 .

[10]  Gian Luca Marcialis,et al.  Robustness analysis of likelihood ratio score fusion rule for multimodal biometric systems under spoof attacks , 2011, 2011 Carnahan Conference on Security Technology.

[11]  Mohammed Rizwan,et al.  Performance and Security of Biometric Fusion against Spoof Attacks , 2011, IICAI.

[12]  M.S. Nixon,et al.  On Model-Based Analysis of Ear Biometrics , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[13]  Samy Bengio,et al.  Why do multi-stream, multi-band and multi-modal approaches work on biometric user authentication tasks? , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Seongbeak Yoon,et al.  Masked fake face detection using radiance measurements. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Arun Ross,et al.  Handbook of Multibiometrics , 2006, The Kluwer international series on biometrics.

[16]  Stephanie Schuckers,et al.  Multimodal fusion vulnerability to non-zero effort (spoof) imposters , 2010, 2010 IEEE International Workshop on Information Forensics and Security.

[17]  Zahid Akhtar,et al.  Robustness of Serial and Parallel Biometric Fusion against Spoof Attacks , 2011 .

[18]  David Zhang,et al.  Robust palmprint verification using 2D and 3D features , 2010, Pattern Recognit..

[19]  Venu Govindaraju,et al.  Evaluation of biometric spoofing in a multimodal system , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[20]  Elham Tabassi,et al.  Fingerprint Image Quality , 2009, Encyclopedia of Biometrics.

[21]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Xin Chen,et al.  IR and visible light face recognition , 2005, Comput. Vis. Image Underst..

[23]  John Daugman,et al.  How iris recognition works , 2002, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Anil K. Jain,et al.  Quality-based Score Level Fusion in Multibiometric Systems , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[25]  Gian Luca Marcialis,et al.  Robustness of multi-modal biometric systems under realistic spoof attacks against all traits , 2011, 2011 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BIOMS).

[26]  Pengfei Shi,et al.  A Fake Iris Detection Method Based on FFT and Quality Assessment , 2008, 2008 Chinese Conference on Pattern Recognition.

[27]  Anil K. Jain,et al.  Likelihood Ratio-Based Biometric Score Fusion , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Venu Govindaraju,et al.  Robustness of multimodal biometric fusion methods against spoof attacks , 2009, J. Vis. Lang. Comput..

[29]  Anil K. Jain,et al.  Handbook of Fingerprint Recognition , 2005, Springer Professional Computing.

[30]  David Zhang,et al.  Improving Biometric Authentication Performance From the User Quality , 2010, IEEE Transactions on Instrumentation and Measurement.

[31]  Fabio Roli,et al.  Personal identity verification by serial fusion of fingerprint and face matchers , 2009, Pattern Recognit..

[32]  Kenta Takahashi,et al.  A secure and user-friendly multimodal biometric system , 2004, SPIE Defense + Commercial Sensing.

[33]  Gian Luca Marcialis,et al.  Robustness of multi-modal biometric verification systems under realistic spoofing attacks , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[34]  Nalini K. Ratha,et al.  An Analysis of Minutiae Matching Strength , 2001, AVBPA.

[35]  Julian Fiérrez,et al.  Multimodal biometric authentication using quality signals in mobile communications , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[36]  Gian Luca Marcialis,et al.  Robustness Evaluation of Biometric Systems under Spoof Attacks , 2011, ICIAP.

[37]  David Zhang,et al.  A New Framework for Adaptive Multimodal Biometrics Management , 2010, IEEE Transactions on Information Forensics and Security.

[38]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Tieniu Tan,et al.  Combine hierarchical appearance statistics for accurate palmprint recognition , 2008, 2008 19th International Conference on Pattern Recognition.