Gait style and gait content: bilinear models for gait recognition using gait re-sampling

Human identification using gait is a challenging computer vision task due to the dynamic motion of gait and the existence of various sources of variations such as viewpoint, walking surface, clothing, etc. In this paper we propose a gait recognition algorithm based on bilinear decomposition of gait data into time-invariant gait-style and time-dependent gait-content factors. We developed a generative model by embedding gait sequences into a unit circle and learning nonlinear mapping, which facilitates synthesis of temporally, aligned gait sequences. Given such synthesized gait data, bilinear model is used to separate invariant gait style, which is used for recognition. We also show that the recognition can be generalized to new situations by adapting the gait-content factor to the new condition and therefore obtain corrected gait-styles for recognition.

[1]  Mark S. Nixon,et al.  Automatic Gait Recognition by Symmetry Analysis , 2001, AVBPA.

[2]  Larry S. Davis,et al.  EigenGait: Motion-Based Recognition of People Using Image Self-Similarity , 2001, AVBPA.

[3]  Hiroshi Murase,et al.  Moving object recognition in eigenspace representation: gait analysis and lip reading , 1996, Pattern Recognit. Lett..

[4]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[5]  Mark S. Nixon,et al.  Automatic gait recognition by symmetry analysis , 2003, Pattern Recognit. Lett..

[6]  Ambasamudram N. Rajagopalan,et al.  Human Identification Using Gait , 2002 .

[7]  B A Wandell,et al.  Linear models of surface and illuminant spectra. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[8]  A. Elgammal,et al.  Separating style and content on a nonlinear manifold , 2004, CVPR 2004.

[9]  Qiang He,et al.  Individual recognition from periodic activity using hidden Markov models , 2000, Proceedings Workshop on Human Motion.

[10]  Aaron F. Bobick,et al.  A Multi-view Method for Gait Recognition Using Static Body Parameters , 2001, AVBPA.

[11]  Chris J. Harris,et al.  Statistical gait recognition via temporal moments , 2000 .

[12]  Sudeep Sarkar,et al.  Baseline results for the challenge problem of HumanID using gait analysis , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[13]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[14]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[15]  A. N. Rajagopalan,et al.  Gait-based recognition of humans using continuous HMMs , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[16]  Joshua B. Tenenbaum,et al.  Mapping a Manifold of Perceptual Observations , 1997, NIPS.

[17]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[18]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[19]  Mark S. Nixon,et al.  Automatic extraction and description of human gait models for recognition purposes , 2003, Comput. Vis. Image Underst..

[20]  Mark S. Nixon,et al.  Statistical gait description via temporal moments , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[21]  Larry S. Davis,et al.  Motion-based recognition of people in EigenGait space , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[22]  Mark S. Nixon,et al.  Recognising humans by gait via parametric canonical space , 1999, Artif. Intell. Eng..

[23]  M. Nixon,et al.  Statistical gait recognition via velocity moments , 2000 .

[24]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.