MMU GASPFA: A COTS multimodal biometric database

This paper describes the baseline corpus of a new multimodal biometric database, the MMU GASPFA (Gait-Speech-Face) database. The corpus in GASPFA is acquired using commercial off the shelf (COTS) equipment including digital video cameras, digital voice recorder, digital camera, Kinect camera and accelerometer equipped smart phones. The corpus consists of frontal face images from the digital camera, speech utterances recorded using the digital voice recorder, gait videos with their associated data recorded using both the digital video cameras and Kinect camera simultaneously as well as accelerometer readings from the smart phones. A total of 82 participants had their biometric data recorded. MMU GASPFA is able to support both multimodal biometric authentication as well as gait action recognition. This paper describes the acquisition setup and protocols used in MMU GASPFA, as well as the content of the corpus. Baseline results from a subset of the participants are presented for validation purposes.

[1]  R. Khanna,et al.  Automated fingerprint identification system (AFIS) benchmarking using the National Institute of Standards and Technology (NIST) Special Database 4 , 1994, 1994 Proceedings of IEEE International Carnahan Conference on Security Technology.

[2]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[3]  Huiru Zheng,et al.  Feasibility study on iPhone accelerometer for gait detection , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[4]  Rafael R. Torrealba,et al.  Characterisation of gait cycle from accelerometer data , 2007 .

[5]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Alan Mink,et al.  Multimodal Biometric Authentication Methods: A COTS Approach | NIST , 2003 .

[7]  Patrick Bours,et al.  Improved Cycle Detection for Accelerometer Based Gait Authentication , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[8]  Luc Vandendorpe,et al.  Face authentication test on the BANCA database , 2004, ICPR 2004.

[9]  Yan Huang,et al.  Tracking multiple objects through occlusions , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Marjorie Skubic,et al.  Evaluation of an inexpensive depth camera for in-home gait assessment , 2011, J. Ambient Intell. Smart Environ..

[11]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[12]  Christoph Busch,et al.  Using Hidden Markov Models for accelerometer-based biometric gait recognition , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[13]  Kimio Oguchi,et al.  Gait Authentication using a wearable sensor , 2011, 2011 Defense Science Research Conference and Expo (DSR).

[14]  Tatiana Witjas,et al.  Comparative analysis of gait and speech in Parkinson's disease: hypokinetic or dysrhythmic disorders? , 2009, Journal of Neurology, Neurosurgery & Psychiatry.

[15]  Anil K. Jain,et al.  FVC2002: Second Fingerprint Verification Competition , 2002, Object recognition supported by user interaction for service robots.

[16]  Mubarak Shah,et al.  Recognizing human actions in videos acquired by uncalibrated moving cameras , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[17]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Alejandro F. Frangi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. , 2022 .

[19]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Rolf Ingold,et al.  MYIDEA - MULTIMODAL BIOMETRICS DATABASE, DESCRIPTION OF ACQUISITION PROTOCOLS , 2005 .

[21]  B. Prabhakaran,et al.  Analysis of human motions with arm constraint , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Julian Fiérrez,et al.  Biosec baseline corpus: A multimodal biometric database , 2007, Pattern Recognit..

[23]  Larry S. Davis,et al.  AVSS 2011 demo session: A large-scale benchmark dataset for event recognition in surveillance video , 2011, AVSS.

[24]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[25]  Kimio Oguchi,et al.  Performance of gait authentication using an acceleration sensor , 2011, 2011 34th International Conference on Telecommunications and Signal Processing (TSP).

[26]  Max Mignotte,et al.  Depth energy image for gait symmetry quantification , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[28]  Fabio Tozeto Ramos,et al.  Unsupervised clustering of people from ‘skeleton’ data , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, ICPR 2004.

[30]  Sudeep Sarkar,et al.  Outdoor recognition at a distance by fusing gait and face , 2007, Image Vis. Comput..

[31]  Sridha Sridharan,et al.  Gait energy volumes and frontal gait recognition using depth images , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[32]  Kirsi Helkala,et al.  Biometric Gait Authentication Using Accelerometer Sensor , 2006, J. Comput..

[33]  Einar Snekkenes,et al.  Gait Authentication and Identification Using Wearable Accelerometer Sensor , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[34]  Darren Leigh,et al.  The MERL Motion Detector Dataset: 2007 Workshop on Massive Datasets , 2007 .

[35]  Michael Wagner,et al.  Aspects of speaking-face data corpus design methodology , 2004, INTERSPEECH.

[36]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[37]  Marjorie Skubic,et al.  Passive in-home measurement of stride-to-stride gait variability comparing vision and Kinect sensing , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[38]  Martin Hynes,et al.  Off-the-shelf mobile handset environments for deploying accelerometer based gait and activity analysis algorithms , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Kazuya Okamoto,et al.  Reliability and validity of gait analysis by android-based smartphone. , 2012, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[40]  David C. Minnen,et al.  Propagation networks for recognition of partially ordered sequential action , 2004, CVPR 2004.

[41]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[42]  Peter H Veltink,et al.  Accelerometer and rate gyroscope measurement of kinematics: an inexpensive alternative to optical motion analysis systems. , 2002, Journal of biomechanics.

[43]  Javier Garrido Salas,et al.  BiosecurID: a multimodal biometric database , 2009, Pattern Analysis and Applications.

[44]  Davrondzhon Gafurov.  Emerging Biometric Modalities: Challenges and Opportunities , 2010, FGIT-SecTech/DRBC.

[45]  David Pallett,et al.  A look at NIST'S benchmark ASR tests: past, present, and future , 2003, 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721).

[46]  A. Martínez,et al.  The AR face databasae , 1998 .

[47]  C. Champod,et al.  Multimodal biometrics for identity documents ( ) , 2007 .

[48]  Eli Shechtman,et al.  Space-Time Behavior-Based Correlation-OR-How to Tell If Two Underlying Motion Fields Are Similar Without Computing Them? , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[50]  Anil K. Jain,et al.  Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Darren Leigh,et al.  The MERL motion detector dataset , 2007, MD '07.

[52]  Chung-Lin Huang,et al.  Gait analysis for human walking paths and identities recognition , 2009, 2009 IEEE International Conference on Multimedia and Expo.