Hand motion expertise analysis using dynamic hierarchical activity modeling and isomap

Several domains such as sports, surgery, dance etc. are characterized by a significant influence of expertise of the performer on the motion pattern and style. The retrieval of expertise level of the performer through automated motion analysis is the subject of this paper. We employ a novel neuropsychologically inspired algorithm that employs a dynamic hierarchical layered structure to represent the human anatomy, and low-level parameters to characterize motion in the layers of this hierarchy which correspond to different segments of the human body. This characterization is representative of the expertise of the performer of the motion. These motion profiles are then compared using dynamic time warping to generate a similarity matrix. We employ isomap to reduce dimensionality and the cluster the data into different expertise classes. This algorithm was tested on a library of surgical movements that contained 3D hand motion data of common surgical laparoscopic procedures. Linearly separable clusters were obtained between novice, intermediate and expert performances. Test sequences were projected into manifold spaces. A recognition percentage of 98.56% was obtained for classifying the test sequences into correct expertise clusters.

[1]  A. Landi.  Human Hand Function , 2007 .

[2]  Eraldo Ribeiro,et al.  Human Motion Recognition Using Isomap and Dynamic Time Warping , 2007, Workshop on Human Motion.

[3]  A. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, CVPR 2004.

[4]  Sethuraman Panchanathan,et al.  Gesture segmentation in complex motion sequences , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[5]  Ahmed M. Elgammal,et al.  Inferring 3D body pose from silhouettes using activity manifold learning , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Peter W. Halligan,et al.  RIVCAM: a simple video-based kinematic analysis for clinical disorders of gait , 2002, Comput. Methods Programs Biomed..

[7]  Hong-Gui Li,et al.  Gait analysis using ISOMAP , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[8]  Elbieta Rostkowska,et al.  AVIImage – video motion analysis software for tests of biomechanical movement characteristics , 2006 .

[9]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[10]  S. Berkovic,et al.  Video analysis of acute motor and convulsive manifestations in sport-related concussion , 2000, Neurology.