Analysis of Irregularities in Human Actions with Volumetric Motion History Images

This paper describes a new 3D motion representation, the Volumetric Motion History Image (VMHI), to be used for the analysis of irregularities in human actions. Such irregularities may occur either in speed or orientation and are strong indicators of the balance abilities and of the confidence level of the subject performing the activity. The proposed VMHI representation overcomes limits of the standard MHI related to motion self-occlusion and speed and is therefore suitable for the visualization and quantification of abnormal motion. This work focuses on the analysis of sway, which is the most common motion irregularity in the studied set of human actions. The sway is visualized and quantified via a user interface using a measure of spatiotemporal surface smoothness, namely the deviation vector. Experimental results show that the deviation vector is a reliable measure for quantifying the deviation of abnormal motion from its corresponding normal motion.

[1]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[2]  Randal C. Nelson,et al.  Detection and Recognition of Periodic, Nonrigid Motion , 1997, International Journal of Computer Vision.

[4]  Randal C. Nelson,et al.  Qualitative recognition of motion using temporal texture , 1992, CVGIP Image Underst..

[5]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[7]  J. Cutting,et al.  Recognizing friends by their walk: Gait perception without familiarity cues , 1977 .

[8]  Maja Pantic,et al.  Motion history for facial action detection in video , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[9]  James W. Davis Hierarchical motion history images for recognizing human motion , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[10]  James W. Davis,et al.  The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment , 1999, Presence.

[11]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[12]  S. Wood-Dauphinée,et al.  The Balance Scale: reliability assessment with elderly residents and patients with an acute stroke. , 1995, Scandinavian journal of rehabilitation medicine.

[13]  Rémi Ronfard,et al.  Motion History Volumes for Free Viewpoint Action Recognition , 2005 .