Attribute-based learning for gait recognition using spatio-temporal interest points

This paper proposes a new method to extract a gait feature from a raw gait video directly. The Space-Time Interest Points (STIPs) are detected where there are significant movements of human body along both spatial and temporal directions in local spatio-temporal volumes of a raw gait video. Then, a histogram of STIP descriptors (HSD) is constructed as a gait feature. Display Omitted A new gait feature is extracted from a raw gait video directly.The proposed gait feature extraction is performed in the spatio-temporal domain.The attribute-based learning is used to enhance the SVM-based gait classification.The proposed method has outstanding performances under changes of clothing types.The proposed method has outstanding performances under changes of carry conditions.

[1]  Alexander Belyaev,et al.  GEI + HOG for Action Recognition , 2012 .

[2]  Alan W. C. Tan,et al.  Time-sliced averaged motion history image for gait recognition , 2014, J. Vis. Commun. Image Represent..

[3]  Clifford Stein,et al.  Introduction to algorithms. Chapter 16. 2nd Edition , 2001 .

[4]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Bernt Schiele,et al.  What helps where – and why? Semantic relatedness for knowledge transfer , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[7]  Neha Jain,et al.  Gait recognition based on gait pal and pal entropy image , 2013, 2013 IEEE International Conference on Image Processing.

[8]  Qiang Wu,et al.  Pairwise Shape configuration-based PSA for gait recognition under small viewing angle change , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[9]  Chiraz Ben Abdelkader Motion-Based Recognition of People in EigenGait Space , 2002 .

[10]  James J. Little,et al.  Incremental Learning for Video-Based Gait Recognition With LBP Flow , 2013, IEEE Transactions on Cybernetics.

[11]  Ronald L. Rivest,et al.  Introduction to Algorithms, third edition , 2009 .

[12]  Rama Chellappa,et al.  Gait Analysis for Human Identification , 2003, AVBPA.

[13]  Yohan Dupuis,et al.  Feature subset selection applied to model-free gait recognition , 2013, Image Vis. Comput..

[14]  Shaogang Gong,et al.  Gait recognition using Gait Entropy Image , 2009, ICDP.

[15]  Khalid Saeed,et al.  Gait recognition using partial silhouette-based approach , 2014, 2014 International Conference on Signal Processing and Integrated Networks (SPIN).

[16]  Dong Ming,et al.  Infrared gait recognition based on wavelet transform and support vector machine , 2010, Pattern Recognit..

[17]  Rama Chellappa,et al.  Role of shape and kinematics in human movement analysis , 2004, CVPR 2004.

[18]  Larry S. Davis,et al.  Motion-based recognition of people in EigenGait space , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[19]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .

[20]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[21]  Tieniu Tan,et al.  Efficient Night Gait Recognition Based on Template Matching , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  M. Nixon,et al.  Model-based Gait Recognition , 2009 .

[23]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Chin-Pan Huang,et al.  Human Action Recognition Using Histogram of Oriented Gradient of Motion History Image , 2011, 2011 First International Conference on Instrumentation, Measurement, Computer, Communication and Control.

[25]  Tieniu Tan,et al.  Automatic gait recognition based on statistical shape analysis , 2003, IEEE Trans. Image Process..

[26]  Daehee Kim,et al.  Active Shape Model-Based Gait Recognition Using Infrared Images , 2009, FGIT-SIP.

[27]  Kate Smith-Miles,et al.  Distance-driven Fusion of Gait and Face for Human Identification in Video , 2007 .

[28]  Jason Weston,et al.  Label Embedding Trees for Large Multi-Class Tasks , 2010, NIPS.

[29]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[30]  Tardi Tjahjadi,et al.  Silhouette-based gait recognition using Procrustes shape analysis and elliptic Fourier descriptors , 2012, Pattern Recognit..

[31]  Tieniu Tan,et al.  Orthogonal Diagonal Projections for Gait Recognition , 2007, 2007 IEEE International Conference on Image Processing.

[32]  Shaogang Gong,et al.  Gait recognition without subject cooperation , 2010, Pattern Recognit. Lett..

[33]  Cordelia Schmid,et al.  Evaluation of Local Spatio-temporal Features for Action Recognition , 2009, BMVC.

[34]  Arun Ross,et al.  Gait curves for human recognition, backpack detection, and silhouette correction in a nighttime environment , 2010, Defense + Commercial Sensing.

[35]  Christoph H. Lampert,et al.  Learning to detect unseen object classes by between-class attribute transfer , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Tieniu Tan,et al.  A Framework for Evaluating the Effect of View Angle, Clothing and Carrying Condition on Gait Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[37]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Aaron F. Bobick,et al.  Gait recognition using static, activity-specific parameters , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[39]  Fei-Fei Li,et al.  What Does Classifying More Than 10, 000 Image Categories Tell Us? , 2010, ECCV.

[40]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[41]  Tieniu Tan,et al.  Uniprojective Features for Gait Recognition , 2007, ICB.

[42]  Philippe De Wilde,et al.  Robust Gait Recognition by Learning and Exploiting Sub-gait Characteristics , 2010, International Journal of Computer Vision.

[43]  Neil A. Thacker,et al.  Tutorial: Computing 2D and 3D Optical Flow. , 2004 .

[44]  Bayya Yegnanarayana,et al.  Face Detection, Recognition in an Image Sequence Using Eigenedginess , 2002, ICVGIP.

[45]  Wen Yu-mei Gait Recognition Based on DWT and SVM , 2007 .

[46]  Changhong Chen,et al.  Gait recognition based on improved dynamic Bayesian networks , 2011, Pattern Recognit..

[47]  Rongchun Zhao,et al.  A New Automatic Gait Recognition method based on the Perceptual Curve , 2005, TENCON 2005 - 2005 IEEE Region 10 Conference.

[48]  Alan W. C. Tan,et al.  Gait recognition via optimally interpolated deformable contours , 2013, Pattern Recognit. Lett..

[49]  Marimuthu Palaniswami,et al.  Support vector machines for automated gait classification , 2005, IEEE Transactions on Biomedical Engineering.

[50]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Alexander C. Berg,et al.  Fast and Balanced: Efficient Label Tree Learning for Large Scale Object Recognition , 2011, NIPS.

[52]  Shaogang Gong,et al.  Feature Selection for Gait Recognition without Subject Cooperation , 2008, BMVC.

[53]  Aaron F. Bobick,et al.  A Multi-view Method for Gait Recognition Using Static Body Parameters , 2001, AVBPA.

[54]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[55]  Qiang Wu,et al.  Attribute-based learning for large scale object classification , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[56]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[57]  Ryan M. Rifkin,et al.  In Defense of One-Vs-All Classification , 2004, J. Mach. Learn. Res..

[58]  Peter Peer,et al.  Human Skeleton Model Based Dynamic Features for Walking Speed Invariant Gait Recognition , 2014 .

[59]  Euntai Kim,et al.  An efficient gait recognition based on a selective neural network ensemble , 2008, Int. J. Imaging Syst. Technol..

[60]  Han Su,et al.  Gait Recognition Using Principal Curves and Neural Networks , 2006, ISNN.

[61]  Joarder Kamruzzaman,et al.  A comparison of neural networks and support vector machines for recognizing young-old gait patterns , 2003, TENCON 2003. Conference on Convergent Technologies for Asia-Pacific Region.

[62]  Wei Xiong,et al.  Active energy image plus 2DLPP for gait recognition , 2010, Signal Process..

[63]  Ma Tian,et al.  Gait Recognition Based on Shape Context Descriptor , 2007 .

[64]  Shi Chen,et al.  An Invariant Appearance Model for Gait Recognition , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[65]  Reza Safabakhsh,et al.  Model-based human gait recognition using leg and arm movements , 2010, Eng. Appl. Artif. Intell..

[66]  V. Lenin,et al.  The United States of America , 2002, Government Statistical Agencies and the Politics of Credibility.

[67]  Chen Wang,et al.  Human Identification Using Temporal Information Preserving Gait Template , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Tieniu Tan,et al.  Recognizing Night Walkers Based on One Pseudoshape Representation of Gait , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[69]  Mark S. Nixon,et al.  Using Gait as a Biometric, via Phase-weighted Magnitude Spectra , 1997, AVBPA.

[70]  Tieniu Tan,et al.  Kinematics-based tracking of human walking in monocular video sequences , 2004, Image Vis. Comput..

[71]  M.S. Nixon,et al.  Front-view Gait Recognition , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[72]  Shamik Sural,et al.  Gait recognition using Pose Kinematics and Pose Energy Image , 2012, Signal Process..

[73]  Sridha Sridharan,et al.  3D ellipsoid fitting for multi-view gait recognition , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[74]  Tieniu Tan,et al.  Fusion of static and dynamic body biometrics for gait recognition , 2004, IEEE Trans. Circuits Syst. Video Technol..

[75]  Tao Xiang,et al.  Gait Recognition by Ranking , 2012, ECCV.

[76]  Qiang Wu,et al.  Recognizing Gaits Across Views Through Correlated Motion Co-Clustering , 2014, IEEE Transactions on Image Processing.

[77]  Yasushi Makihara,et al.  The OU-ISIR Gait Database Comprising the Treadmill Dataset , 2012, IPSJ Trans. Comput. Vis. Appl..

[78]  Liang Wang,et al.  Dynamic biometrics fusion at feature level for video-based human recognition , 2007 .

[79]  Larry S. Davis,et al.  Gait Recognition Using Image Self-Similarity , 2004, EURASIP J. Adv. Signal Process..

[80]  John Langford,et al.  Conditional Probability Tree Estimation Analysis and Algorithms , 2009, UAI.

[81]  Z. Liu,et al.  Simplest representation yet for gait recognition: averaged silhouette , 2004, ICPR 2004.

[82]  Sudeep Sarkar,et al.  Improved gait recognition by gait dynamics normalization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[84]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[85]  A. Beygelzimer Multiclass Classification with Filter Trees , 2007 .

[86]  Ivan Laptev,et al.  On Space-Time Interest Points , 2005, International Journal of Computer Vision.

[87]  Mark S. Nixon,et al.  Model-Based Feature Extraction for Gait Analysis and Recognition , 2007, MIRAGE.

[88]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[89]  Tieniu Tan,et al.  Walker Recognition Without Gait Cycle Estimation , 2007, ICB.

[90]  Hamid Soltanian-Zadeh,et al.  Gait Recognition Using Wavelet Packet Silhouette Representation and Transductive Support Vector Machines , 2009, 2009 2nd International Congress on Image and Signal Processing.