Sparse Granger causality graphs for human action classification

Basic understanding and recognition of human actions can be accomplished by modeling the spatiotemporal relationship among major skeletal joints. In this work we present an approach that models human actions using temporal causal relations of joint movements. The relations form a graph with joints as nodes and edges induced by the Granger causality measure between pairs of joint point processes. Each human action is then represented by a distinct sparse causality graph. Experiments on motion capture data illustrate the robustness of this approach and its advantages over state-of-the-art methods.

[1]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[2]  Mingzhou Ding,et al.  Analyzing multiple spike trains with nonparametric granger causality , 2009, Journal of Computational Neuroscience.

[3]  Junxia Gu,et al.  Action and Gait Recognition From Recovered 3-D Human Joints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Gérard G. Medioni,et al.  Dynamic Manifold Warping for view invariant action recognition , 2011, 2011 International Conference on Computer Vision.

[5]  G. Wilson The Factorization of Matricial Spectral Densities , 1972 .

[6]  Shuiwang Ji,et al.  SLEP: Sparse Learning with Efficient Projections , 2011 .

[7]  Fernando De la Torre,et al.  Canonical Time Warping for Alignment of Human Behavior , 2009, NIPS.

[8]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[9]  Rui Li,et al.  Divide, Conquer and Coordinate: Globally Coordinated Switching Linear Dynamical System , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Tido Röder,et al.  Documentation Mocap Database HDM05 , 2007 .

[11]  James M. Rehg,et al.  Temporal causality for the analysis of visual events , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  S. Bressler,et al.  Granger Causality: Basic Theory and Application to Neuroscience , 2006, q-bio/0608035.

[13]  Vladimir Pavlovic,et al.  Isotonic CCA for sequence alignment and activity recognition , 2011, 2011 International Conference on Computer Vision.