Indexing and retrieval of human motion data based on a growing self-organizing map

As low-cost depth cameras are released recently, motion data containing 3D coordinates of skeleton joints during a time period can be directly captured. Nevertheless, analyzing the motion data is usually a challenging problem and requires huge computation costs because of the high-dimensionality. Among several alternatives, the self-organizing map (SOM) is verified to be an effective technique to handle such motion data. Specifically, a captured motion sequence can be easily and precisely mapped to form an indexed motion string through the use of a trained SOM. However, the training process of the SOM is high computation complexity and is thus typically tedious. In view of this, we propose in this work to incorporate a hierarchical structure into the SOM technique. Generally speaking, our approach named as GQSOM (growing quadtree self-organizing map) helps to significantly reduce the required computation complexity while preserving the effectiveness of the SOM technique. Empirical studies using the WorkSU-10 exercise dataset show that our approach is both efficient and effective to perform indexing and retrieval tasks of motion data.

[1]  Haiying Liu,et al.  Motion retrieval based on kinetic features in large motion database , 2012, ICMI '12.

[2]  Yasuhiko Sakamoto,et al.  Motion map: image-based retrieval and segmentation of motion data , 2004, SCA '04.

[3]  Ahmed M. Elgammal,et al.  Human Motion Synthesis by Motion Manifold Learning and Motion Primitive Segmentation , 2006, AMDO.

[4]  Vijay John,et al.  Markerless human articulated tracking using hierarchical particle swarm optimisation , 2010, Image Vis. Comput..

[5]  Q. Zhang,et al.  3D HUMAN MOTION RETRIEVAL BASED ON HUMAN HIERARCHICAL INDEX STRUCTURE , 2013, Biology of sport.

[6]  Xiaoyong Lei,et al.  Motion Data Retrieval from Very Large Motion Databases , 2011, 2011 International Conference on Virtual Reality and Visualization.

[7]  Woong Choi,et al.  Similarity Retrieval of Motion Capture Data Based on Derivative Features , 2012, Journal of Advanced Computational Intelligence and Intelligent Informatics.

[8]  Tarik Arici,et al.  Gesture Recognition using Skeleton Data with Weighted Dynamic Time Warping , 2013, VISAPP.

[9]  Zhaoqi Wang,et al.  Efficient motion data indexing and retrieval with local similarity measure of motion strings , 2009, The Visual Computer.

[10]  Wei Chen,et al.  Motion track: Visualizing variations of human motion data , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[11]  Christian Ritz,et al.  Enhancing Multimedia Search Using Human Motion , 2012 .

[12]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[13]  Ben Shneiderman,et al.  Finding comparable temporal categorical records: A similarity measure with an interactive visualization , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[14]  Wei-Guang Teng,et al.  Adaptive and efficient colour quantisation based on a growing self-organising map , 2012 .

[15]  Rui Liu,et al.  3D Human Motion Retrieval Based on ISOMAP Dimension Reduction , 2011, AICI.

[16]  Zhaoqi Wang,et al.  Indexing and retrieval of human motion data by a hierarchical tree , 2009, VRST '09.

[17]  Aytül Erçil,et al.  A Decision Forest Based Feature Selection Framework for Action Recognition from RGB-Depth Cameras , 2013, ICIAR.