Cross-Speed Gait Recognition Using Speed-Invariant Gait Templates and Globality–Locality Preserving Projections

We present a novel manifold-based approach for cross-speed gait recognition. In our approach, the walking action is considered as residing on a manifold, in the feature space, that is homomorphic to a unit circle. We employ thin plate spline (TPS) kernel-based radial basis function (RBF) interpolation to fit such manifold. TPS kernel-based RBF interpolation separates the learned coefficients into an affine component and a nonaffine component, which, respectively, encodes the dynamic and static characteristics of the gait manifold. We introduce the use of the nonaffine component as a cross-speed gait representation, and denote it speed invariant gait template (SIGT). We also propose an enhanced locality preserving projections (LPP) algorithm named globality LPP (GLPP) for reducing the dimension of SIGT. In GLPP, the graph Laplacians of intrasubject part and intersubjects part are separately constructed, and then to combine as a new graph Laplacian. Finally, a manifold learning-based classifier named normalized hypergraph classifier is employed for classification. Experimental results on two gait databases demonstrate the effectiveness of our proposed approach in comparison with the state-of-the-art gait recognition methods.

[1]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[2]  Haifeng Hu,et al.  Enhanced Gabor Feature Based Classification Using a Regularized Locally Tensor Discriminant Model for Multiview Gait Recognition , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Sheng Huang,et al.  Discriminant Hyper-Laplacian projections with its application to face recognition , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[4]  Ahmed M. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  Ahmed M. Elgammal,et al.  Dynamic Shape Style Analysis: Bilinear and Multilinear Human Identification with Temporal Normalization , 2010, Int. J. Pattern Recognit. Artif. Intell..

[6]  Qiang Wu,et al.  Gait Recognition Across Various Walking Speeds Using Higher Order Shape Configuration Based on a Differential Composition Model , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[8]  Mark S. Nixon,et al.  On automated model-based extraction and analysis of gait , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[9]  Rama Chellappa,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Matching Shape Sequences in Video with Applications in Human Movement Analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 2 , 2022 .

[10]  Ahmed M. Elgammal,et al.  Globality-Locality Preserving Projections for Biometric Data Dimensionality Reduction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[11]  James Nga-Kwok Liu,et al.  Gait flow image: A silhouette-based gait representation for human identification , 2011, Pattern Recognit..

[12]  Bernhard Schölkopf,et al.  Learning with Hypergraphs: Clustering, Classification, and Embedding , 2006, NIPS.

[13]  Mark S. Nixon,et al.  Automatic Recognition by Gait , 2006, Proceedings of the IEEE.

[14]  Larry S. Davis,et al.  Gait Recognition Using Image Self-Similarity , 2004, EURASIP J. Adv. Signal Process..

[15]  Tardi Tjahjadi,et al.  Silhouette-based gait recognition using Procrustes shape analysis and elliptic Fourier descriptors , 2012, Pattern Recognit..

[16]  Yasushi Makihara,et al.  Silhouette transformation based on walking speed for gait identification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Joshua B. Tenenbaum,et al.  Mapping a Manifold of Perceptual Observations , 1997, NIPS.

[18]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[19]  Sudeep Sarkar,et al.  Improved gait recognition by gait dynamics normalization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ahmed M. Elgammal,et al.  Homeomorphic Manifold Analysis (HMA): Generalized separation of style and content on manifolds , 2013, Image Vis. Comput..

[21]  Meng Wang,et al.  Adaptive Hypergraph Learning and its Application in Image Classification , 2012, IEEE Transactions on Image Processing.

[22]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[24]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[25]  Gang Wang,et al.  Human Identity and Gender Recognition From Gait Sequences With Arbitrary Walking Directions , 2014, IEEE Transactions on Information Forensics and Security.

[26]  Jiwen Lu,et al.  Gait recognition for human identification based on ICA and fuzzy SVM through multiple views fusion , 2007, Pattern Recognit. Lett..

[27]  G. Wahba Spline models for observational data , 1990 .

[28]  H. Sebastian Seung,et al.  The Manifold Ways of Perception , 2000, Science.

[29]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[30]  Tardi Tjahjadi,et al.  Gait recognition based on shape and motion analysis of silhouette contours , 2013, Comput. Vis. Image Underst..

[31]  David Zhang,et al.  Human gait recognition by the fusion of motion and static spatio-temporal templates , 2007, Pattern Recognit..

[32]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Chen Wang,et al.  Human Identification Using Temporal Information Preserving Gait Template , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Ahmed M. Elgammal,et al.  On The Effect of Hyperedge Weights On Hypergraph Learning , 2014, Image Vis. Comput..

[35]  Aaron F. Bobick,et al.  Modelling the effects of walking speed on appearance-based gait recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[36]  Tal Hassner,et al.  Similarity Scores Based on Background Samples , 2009, ACCV.

[37]  Yanxi Liu,et al.  Shape Variation-Based Frieze Pattern for Robust Gait Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Wei Xiong,et al.  Active energy image plus 2DLPP for gait recognition , 2010, Signal Process..

[39]  Ahmed M. Elgammal,et al.  Gait style and gait content: bilinear models for gait recognition using gait re-sampling , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[40]  Mark S. Nixon,et al.  Model-Based Feature Extraction for Gait Analysis and Recognition , 2007, MIRAGE.

[41]  G. Wahba,et al.  A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines , 1970 .

[42]  David Zhang,et al.  Relaxed collaborative representation for pattern classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Er-Hu Zhang,et al.  Gait recognition using dynamic gait energy and PCA+LPP method , 2009, 2009 International Conference on Machine Learning and Cybernetics.

[44]  Debra J. Rose,et al.  Fallproof! A Comprehensive Balance and Mobility Training Program , 2010 .

[45]  Wrisley Dm,et al.  66 Rose DJ. Fallproof!: A Comprehensive Balance and Mobility Training Program. Champaign, IL: Human Kinetics; 2003. , 2010 .