Gait recognition using dynamic affine invariants

We present a method for recognizing classes of human gaits from video sequences. We propose a novel image based representation for human gaits. At any instance of time a gait is represented by a vector of affine invariant moments. The invariants are computed on the binary silhouettes corresponding to the moving body. We represent the time trajectories of the affine moment invariant vector as the output of a linear dynamical system driven by white noise. The problem of gait classification is then reduced to formulating distances and performing recognition in the space of linear dynamical systems. Results demonstrating the discriminate power of the proposed methods are discussed at the end.

[1]  A. Weinstein.  Almost invariant submanifolds for compact group actions , 1999, math/9908133.

[2]  B. Moor,et al.  Subspace angles and distances between ARMA models , 2000 .

[3]  Jan Flusser,et al.  Pattern recognition by affine moment invariants , 1993, Pattern Recognit..

[4]  James M. Rehg,et al.  Analyzing articulated motion using expectation-maximization , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Bart De Moor,et al.  N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems , 1994, Autom..

[6]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[7]  Vladimir Pavlovic,et al.  Impact of dynamic model learning on classification of human motion , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  Bart De Moor,et al.  Subspace algorithms for the stochastic identification problem, , 1993, Autom..

[9]  Stefano Soatto,et al.  Recognition of human gaits , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[14]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[15]  M. Irani,et al.  Event-Based Video Analysis, , 2001 .

[16]  Michael J. Black,et al.  A Probabilistic Framework for Matching Temporal Trajectories: CONDENSATION-Based Recognition of Gestures and Expressions , 1998, ECCV.

[17]  Randal C. Nelson,et al.  Detection and Recognition of Periodic, Nonrigid Motion , 1997, International Journal of Computer Vision.

[18]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[19]  Thomas Kailath,et al.  Linear Systems , 1980 .

[20]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[21]  Richard J. Martin.  A metric for ARMA processes , 2000, IEEE Trans. Signal Process..

[22]  Michael Isard,et al.  Learning and Classification of Complex Dynamics , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Aaron F. Bobick,et al.  Parametric Hidden Markov Models for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  P. Van Overschee,et al.  Two subspace algorithms for the identification of combined deterministic-stochastic systems , 1992 .

[26]  Michael J. Black,et al.  Implicit Probabilistic Models of Human Motion for Synthesis and Tracking , 2002, ECCV.

[27]  Yang Song,et al.  Towards detection of human motion , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[28]  Alex Pentland,et al.  Dynamic models of human motion , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[29]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[30]  Cristian Sminchisescu,et al.  Kinematic jump processes for monocular 3D human tracking , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[31]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[32]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[33]  K. Arun,et al.  Balanced approximation of stochastic systems , 1990 .