Single sensor-based multi-quality multi-modal biometric score database and its performance evaluation

We constructed a large-scale multi-quality multi-modal biometric score database to advance studies on quality-dependent score-level fusion. In particular, we focused on single sensor-based multi-modal biometrics because of their advantages of simple system construction, low cost, and wide availability in real situations such as CCTV footage-based criminal investigation, unlike conventional individual sensor-based multi-modal biometrics that require multiple sensors. As for the modalities of multiple biometrics, we extracted gait, head, and the height biometrics from a single walking image sequence, and considered spatial resolution (SR) and temporal resolution (TR) as quality measures that simultaneously affect the scores of individual modalities. We then computed biometric scores of 1912 subjects under a total of 130 combinations of the quality measures, i.e., 13 SRs and 10 TRs, and constructed a very large-scale biometric score database composed of 1,814,488 genuine scores and 3,467,486,568 imposter scores. We finally provide performance evaluation results both for quality-independent and quality-dependent score-level fusion approaches using two protocols that will be beneficial to the score-level fusion research community.

[1]  E. S. Pearson,et al.  On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1933 .

[2]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Norman Poh,et al.  Handling high dimensionality in biometric classification with multiple quality measures using Locality Preserving Projection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[4]  Maja Pantic,et al.  Gauss-Newton Deformable Part Models for Face Alignment In-the-Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Yasushi Makihara,et al.  Silhouette extraction based on iterative spatio-temporal local color transformation and graph-cut segmentation , 2008, 2008 19th International Conference on Pattern Recognition.

[6]  Austin Hicklin,et al.  Studies of Biometric Fusion Appendix C Evaluation of Selected Biometric Fusion Techniques , 2006 .

[7]  Josef Kittler,et al.  A multimodal biometric test bed for quality-dependent, cost-sensitive and client-specific score-level fusion algorithms , 2010, Pattern Recognit..

[8]  Chang-Tsun Li,et al.  Robust gait recognition from extremely low frame-rate videos , 2013, 2013 International Workshop on Biometrics and Forensics (IWBF).

[9]  Yasushi Makihara,et al.  Quality-dependent Score-level Fusion of Face, Gait, and the Height Biometrics , 2014, IPSJ Trans. Comput. Vis. Appl..

[10]  Roland Göcke,et al.  Pose Normalization via Learned 2D Warping for Fully Automatic Face Recognition , 2011, BMVC.

[11]  B. Solaiman,et al.  Multimodal Biometric System Based on Fingerprint Identification and Iris Recognition , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[12]  Yasushi Makihara,et al.  Video from nearly still: An application to low frame-rate gait recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[14]  E. S. Pearson,et al.  On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1933 .

[15]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[16]  Chun-Wei Tan,et al.  Towards Online Iris and Periocular Recognition Under Relaxed Imaging Constraints , 2013, IEEE Transactions on Image Processing.

[17]  Z. Liu,et al.  Simplest representation yet for gait recognition: averaged silhouette , 2004, ICPR 2004.

[18]  Yasushi Makihara,et al.  Score-level fusion by generalized Delaunay triangulation , 2014, IEEE International Joint Conference on Biometrics.

[19]  Julian Fierrez,et al.  Dealing with sensor interoperability in multi-biometrics: the UPM experience at the Biosecure Multimodal Evaluation 2007 , 2008, SPIE Defense + Commercial Sensing.

[20]  Shaogang Gong,et al.  Gait Representation Using Flow Fields , 2009, BMVC.

[21]  Yasushi Makihara,et al.  Multi-view multi-modal person authentication from a single walking image sequence , 2013, 2013 International Conference on Biometrics (ICB).

[22]  Samy Bengio,et al.  Database, protocols and tools for evaluating score-level fusion algorithms in biometric authentication , 2006, Pattern Recognit..

[23]  Anil K. Jain,et al.  A Principled Approach to Score Level Fusion in Multimodal Biometric Systems , 2005, AVBPA.

[24]  Wei-Yun Yau,et al.  Fusion of Auxiliary Information for Multi-modal Biometrics Authentication , 2004, ICBA.

[25]  Anil K. Jain,et al.  Likelihood Ratio-Based Biometric Score Fusion , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Samy Bengio,et al.  Confidence measures for multimodal identity verification , 2002, Inf. Fusion.

[27]  Imed Bouchrika,et al.  On Using Gait in Forensic Biometrics , 2011, Journal of forensic sciences.

[28]  Arun Ross,et al.  Relating ROC and CMC curves via the biometric menagerie , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[29]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Yasushi Makihara,et al.  Gait Verification System for Criminal Investigation , 2013, IPSJ Trans. Comput. Vis. Appl..

[31]  Julian Fiérrez,et al.  Rapid and brief communication: Discriminative multimodal biometric authentication based on quality measures , 2005 .

[32]  Xiaoli Zhou,et al.  Integrating Face and Gait for Human Recognition at a Distance in Video , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Chen Wang,et al.  Human Identification Using Temporal Information Preserving Gait Template , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Koichi Ito,et al.  Face recognition using phase-based correspondence matching , 2011, Face and Gesture 2011.

[35]  Gerhard Rigoll,et al.  Combined face and gait recognition using alpha matte preprocessing , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[36]  Pingzhi Fan,et al.  Performance evaluation of score level fusion in multimodal biometric systems , 2010, Pattern Recognit..

[37]  Xiaoli Zhou,et al.  Feature fusion of side face and gait for video-based human identification , 2008, Pattern Recognit..

[38]  Arun Ross,et al.  Mitigating effects of plastic surgery: Fusing face and ocular biometrics , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[39]  Kanta Matsuura,et al.  Towards optimal countermeasures against wolves and lambs in biometrics , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[40]  Julian Fiérrez,et al.  Analysis of the Utility of Classical and Novel Speech Quality Measures for Speaker Verification , 2009, ICB.

[41]  B. Dorizzi,et al.  A new probabilistic Iris Quality Measure for comprehensive noise detection , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[42]  Krzysztof Kryszczuk,et al.  Improving Classification with Class-Independent Quality Measures: Q-stack in Face Verification , 2007, ICB.