Spatiotemporal analysis of human activities for biometric authentication

This paper presents a novel framework for unobtrusive biometric authentication based on the spatiotemporal analysis of human activities. Initially, the subject's actions that are recorded by a stereoscopic camera, are detected utilizing motion history images. Then, two novel unobtrusive biometric traits are proposed, namely the static anthropometric profile that accurately encodes the inter-subject variability with respect to human body dimensions, while the activity related trait that is based on dynamic motion trajectories encodes the behavioral inter-subject variability for performing a specific action. Subsequently, score level fusion is performed via support vector machines. Finally, an ergonomics-based quality indicator is introduced for the evaluation of the authentication potential for a specific trial. Experimental validation on data from two different datasets, illustrates the significant biometric authentication potential of the proposed framework in realistic scenarios, whereby the user is unobtrusively observed, while the use of the static anthropometric profile is seen to significantly improve performance with respect to state-of-the-art approaches.

[1]  Mark Kucente Natural interaction , 1998, SIGGRAPH '98.

[2]  Ralph Gross,et al.  Robust Biometric Person Identification Using Automatic Classifier Fusion of Speech, Mouth, and Face Experts , 2007, IEEE Transactions on Multimedia.

[3]  M. Grgic,et al.  A survey of biometric recognition methods , 2004, Proceedings. Elmar-2004. 46th International Symposium on Electronics in Marine.

[4]  D. Rosenbaum,et al.  Posture-based motion planning: applications to grasping. , 2001, Psychological review.

[5]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[6]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Takayuki Okatani,et al.  HHMM Based Recognition of Human Activity , 2006, IEICE Trans. Inf. Syst..

[8]  B. J. van Wyk,et al.  Kronecker product graph matching , 2003, Pattern Recognit..

[9]  Dimitrios Tzovaras,et al.  Event-based unobtrusive authentication using multi-view image sequences , 2010, ARTEMIS '10.

[10]  P. Fihl,et al.  View-invariant gesture recognition using 3D optical flow and harmonic motion context , 2010, Comput. Vis. Image Underst..

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[13]  Patrick Pérez,et al.  View-Independent Action Recognition from Temporal Self-Similarities , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Matti Pietikäinen,et al.  Learning Personal Specific Facial Dynamics for Face Recognition from Videos , 2007, AMFG.

[15]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[16]  E. Morales,et al.  Automatic Feature Construction and a Simple Rule Induction Algorithm for Skin Detection , 2002 .

[17]  Richard Bowden,et al.  Real-Time Upper Body Detection and 3D Pose Estimation in Monoscopic Images , 2006, ECCV.

[18]  Farhan A. Qazi A Survey of Biometric Authentication Systems , 2004, Security and Management.

[19]  Qinghan Xiao,et al.  Security issues in biometric authentication , 2005, Proceedings from the Sixth Annual IEEE SMC Information Assurance Workshop.

[20]  François Brémond,et al.  Video understanding for complex activity recognition , 2006, Machine Vision and Applications.

[21]  Michael D. Garris,et al.  NIST Fingerprint Evaluations and Developments , 2006, Proceedings of the IEEE.

[22]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[23]  R. Shaw,et al.  Perceiving, Acting and Knowing : Toward an Ecological Psychology , 1978 .

[24]  Paul Lukowicz,et al.  User Activity Related Data Sets for Context Recognition , 2004 .

[25]  Mark S. Nixon,et al.  Performance analysis for automated gait extraction and recognition in multi-camera surveillance , 2010, Multimedia Tools and Applications.

[26]  Rama Chellappa,et al.  A framework for activity-specific human identification , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[27]  Simon R. Goodman,et al.  Analysis of kinematic invariances of multijoint reaching movement , 1995, Biological Cybernetics.

[28]  Bruce H. Thomas,et al.  Considering reach in tangible and table top design , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[29]  Liang Wang,et al.  Learning and Matching of Dynamic Shape Manifolds for Human Action Recognition , 2007, IEEE Transactions on Image Processing.

[30]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Dimitrios Tzovaras,et al.  On the Potential of Activity Related Recognition , 2010, VISAPP.

[32]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[33]  J. F. Soechting,et al.  Coordination of arm and wrist motion during a reaching task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Gang Zheng,et al.  Application of Projective Invariants in Hand Geometry Biometrics , 2007, IEEE Transactions on Information Forensics and Security.

[35]  Pascal Fua,et al.  Articulated Soft Objects for Multiview Shape and Motion Capture , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Montse Pardàs,et al.  Skeleton and Shape Adjustment and Tracking in Multicamera Environments , 2010, AMDO.

[37]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[38]  A. Glascock,et al.  Behavioral Telemedicine: A New Approach to the Continuous Nonintrusive Monitoring of Activities of Daily Living , 2000 .

[39]  Paul L. Rosin,et al.  Assessing the Uniqueness and Permanence of Facial Actions for Use in Biometric Applications , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[40]  Radha Poovendran,et al.  Activity Recognition Using a Combination of Category Components and Local Models for Video Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Mario Ganzeboom Natural interaction , 2008 .

[43]  Dimitrios Tzovaras,et al.  Gait Identification using the 3D Protrusion Transform , 2007, 2007 IEEE International Conference on Image Processing.

[44]  Monique Thonnat,et al.  Multi-sensors Analysis for Everyday Activity Monitoring , 2007 .

[45]  Katsushi Ikeuchi,et al.  Automatic Gait Recognition , 2014, Computer Vision, A Reference Guide.

[46]  Natalia A. Schmid,et al.  Performance analysis of iris-based identification system at the matching score level , 2005, IEEE Transactions on Information Forensics and Security.

[47]  Zhanyi Hu,et al.  Pointwise Motion Image (PMI): A Novel Motion Representation and Its Applications to Abnormality Detection and Behavior Recognition , 2009, IEEE Trans. Circuits Syst. Video Technol..

[48]  Julius Ziegler,et al.  Tracking of the Articulated Upper Body on Multi-View Stereo Image Sequences , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[49]  Anil K. Jain,et al.  Latent Palmprint Matching , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.