Attractor-Shape for Dynamical Analysis of Human Movement: Applications in Stroke Rehabilitation and Action Recognition

In this paper, we propose a novel shape-theoretic framework for dynamical analysis of human movement from 3D data. The key idea we propose is the use of global descriptors of the shape of the dynamical attractor as a feature for modeling actions. We apply this approach to the novel application scenario of estimation of movement quality from a single-marker for future usage in home-based stroke rehabilitation. Using a dataset collected from 15 stroke survivors performing repetitive task therapy, we demonstrate that the proposed method outperforms traditional methods, such as kinematic analysis and use of chaotic invariants, in estimation of movement quality. In addition, we demonstrate that the proposed framework is sufficiently general for the application of action and gesture recognition as well. Our experimental results reflect improved action recognition results on two publicly available 3D human activity databases.

[1]  L. A. Colby,et al.  Therapeutic Exercise: Foundations and Techniques , 1990 .

[2]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[3]  Joseph Hamill,et al.  LYAPUNOV EXPONENT ESTIMATION FOR HUMAN GAIT ACCELERATION SIGNALS , 2007 .

[4]  M. Rosenstein,et al.  A practical method for calculating largest Lyapunov exponents from small data sets , 1993 .

[5]  J. Dingwell,et al.  Nonlinear time series analysis of normal and pathological human walking. , 2000, Chaos.

[6]  Rama Chellappa,et al.  Moving vistas: Exploiting motion for describing scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  S. Wolf,et al.  Assessing Wolf Motor Function Test as Outcome Measure for Research in Patients After Stroke , 2001, Stroke.

[8]  Patrick Pérez,et al.  View-Independent Action Recognition from Temporal Self-Similarities , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[10]  E. Taub,et al.  The reliability of the wolf motor function test for assessing upper extremity function after stroke. , 2001, Archives of physical medicine and rehabilitation.

[11]  Todd Ingalls,et al.  Design of a home-based adaptive mixed reality rehabilitation system for stroke survivors , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[13]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  George A. Mensah,et al.  The atlas of heart disease and stroke , 2005 .

[15]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[16]  Jiping He,et al.  A Computational Framework for Quantitative Evaluation of Movement during Rehabilitation , 2011 .

[17]  Anuj Srivastava,et al.  Riemannian Analysis of Probability Density Functions with Applications in Vision , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  D. Beevers,et al.  The atlas of heart disease and stroke , 2005, Journal of Human Hypertension.

[19]  A. Wolf,et al.  Determining Lyapunov exponents from a time series , 1985 .

[20]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[21]  Stefano Soatto,et al.  Recognition of human gaits , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[23]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[24]  M. Small.  Applied Nonlinear Time Series Analysis: Applications in Physics, Physiology and Finance , 2005 .

[25]  M. Perc.  The dynamics of human gait , 2005 .

[26]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[27]  Wanqing Li,et al.  Action recognition based on a bag of 3D points , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[28]  S. Gong,et al.  Recognising action as clouds of space-time interest points , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Mubarak Shah,et al.  Chaotic Invariants for Human Action Recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  N. Stergiou,et al.  Human movement variability, nonlinear dynamics, and pathology: is there a connection? , 2011, Human movement science.