Robust Tracking of the Upper Limb for Functional Stroke Assessment

We present a robust 3-D parts-based (PB) tracking system designed to follow the upper limb of stroke survivors during desktop activities. This system fits a probabilistic model of the arm to sequences of images taken from multiple angles. The arm model defines shapes and colors of limbs and limb configurations that are more or less likely. We demonstrate that the system is 1) robust to cluttered scenes and temporary occlusions, 2) accurate relative to a commercial motion capture device, and 3) capable of capturing kinematics that correlate with concurrent measures of post-stroke limb function. To evaluate the PB system, the functional motion of seven stroke survivors was measured concurrently with the PB system and a commercial motion capture system. In addition, functional motion was assessed by an expert using the Fugl-Meyer Assessment (FMA) and related to recorded kinematics. Standard deviation of differences in measured elbow angles between systems was 5.7^; deviation in hand velocity estimates was 2.6 cm/s. Several statistics, moreover, correlated strongly with FMA scores. Standard deviation in shoulder velocity had a significant correlation coefficient with FMA score below -0.75 when measured with all systems.

[1]  K. Pearson,et al.  Control of Posture and Locomotion , 1973, Advances in Behavioral Biology.

[2]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[3]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michael J. Black,et al.  Cardboard people: a parameterized model of articulated image motion , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[5]  H. Flor,et al.  The Arm Motor Ability Test: reliability, validity, and sensitivity to change of an instrument for assessing disabilities in activities of daily living. , 1997, Archives of physical medicine and rehabilitation.

[6]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[7]  D.J. Reinkensmeyer,et al.  Web-based telerehabilitation for the upper extremity after stroke , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  A. Senior Tracking people with probabilistic appearance models , 2002 .

[9]  N. Hogan,et al.  Robotics in the rehabilitation treatment of patients with stroke , 2002, Current atherosclerosis reports.

[10]  N. Hogan,et al.  Movement Smoothness Changes during Stroke Recovery , 2002, The Journal of Neuroscience.

[11]  Jitendra Malik,et al.  Estimating Human Body Configurations Using Shape Context Matching , 2002, ECCV.

[12]  A. G. Feldman,et al.  Interjoint coordination dynamics during reaching in stroke , 2003, Experimental Brain Research.

[13]  M. Levin,et al.  Compensation for distal impairments of grasping in adults with hemiparesis , 2004, Experimental Brain Research.

[14]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[15]  Michael J. Black,et al.  Learning the Statistics of People in Images and Video , 2003, International Journal of Computer Vision.

[16]  W. Rymer,et al.  Robot-assisted reaching exercise promotes arm movement recovery in chronic hemiparetic stroke: a randomized controlled pilot study , 2006, Journal of NeuroEngineering and Rehabilitation.

[17]  David A. Forsyth,et al.  Computational Studies of Human Motion: Part 1, Tracking and Motion Synthesis , 2005, Found. Trends Comput. Graph. Vis..

[18]  C. Winstein,et al.  Validity of accelerometry for monitoring real-world arm activity in patients with subacute stroke: evidence from the extremity constraint-induced therapy evaluation trial. , 2006, Archives of physical medicine and rehabilitation.

[19]  David A. Forsyth,et al.  Tracking People by Learning Their Appearance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, SIGGRAPH 2007.

[21]  David J. Fleet,et al.  The Kneed Walker for human pose tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  David J. Reinkensmeyer,et al.  Gesture Therapy - A Low-Cost Vision-Based System for Rehabilitation after Stroke , 2008, HEALTHINF.

[23]  M. Goffredo,et al.  A neural tracking and motor control approach to improve rehabilitation of upper limb movements , 2008, Journal of NeuroEngineering and Rehabilitation.

[24]  Sandra B. Davis,et al.  Effects of Trunk Restraint Combined With Intensive Task Practice on Poststroke Upper Extremity Reach and Function: A Pilot Study , 2009, Neurorehabilitation and neural repair.

[25]  Michael J. Black,et al.  HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human Motion , 2010, International Journal of Computer Vision.

[26]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[27]  Emiliano Gambaretto,et al.  Automatic Generation of a Subject-Specific Model for Accurate Markerless Motion Capture and Biomechanical Applications , 2010, IEEE Transactions on Biomedical Engineering.