Motion map: image-based retrieval and segmentation of motion data

Recent proliferation of motion capture systems enables motion data to be saved as an archive system, and the data are usually extracted by selecting an appropriate file by its name or annotation explaining the content of motions. Such semantic-based retrieval, however, is not suited to unstructured files that include many types of elemental motions, due to the difficulty in giving comprehensible annotations. Moreover, expected motion clips are often included as a part of entire sequences, and the data therefore should be manually clipped using some authoring tools. This paper proposes an image-based user interface for retrieving motion data using a self-organizing map for supplying recognizable icons of postures. The postures are used as keys for retrieval, and the desirable segments of the motion data can be accurately extracted by specifying and ending postures. The number of possible motion segments is flexibly controlled by changing the scope of postures used as the keys.

[1]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[2]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[3]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[4]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[5]  David Salesin,et al.  A sketching interface for articulated figure animation , 2006, SIGGRAPH 2006.

[6]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[7]  Pourang Irani,et al.  Using Perceptual Syntax to Enhance Semantic Content in Diagrams , 2001, IEEE Computer Graphics and Applications.

[8]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[9]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[10]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[11]  John Hart,et al.  ACM Transactions on Graphics: Editorial , 2003, SIGGRAPH 2003.

[12]  Dave Elliman,et al.  Visualizing ontology components through self-organizing maps , 2002, Proceedings Sixth International Conference on Information Visualisation.

[13]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[14]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH '08.

[15]  Marc R. Ilgen,et al.  DEPICT: Documents Evaluated as Pictures. Visualizing information using context vectors and self-organizing maps , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[16]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[17]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[18]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[19]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[20]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[21]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[22]  Haim Levkowitz,et al.  From Visual Data Exploration to Visual Data Mining: A Survey , 2003, IEEE Trans. Vis. Comput. Graph..

[23]  T. Kohonen.  Self-Organized Formation of Correct Feature Maps , 1982 .

[24]  Michael Gleicher,et al.  Automated extraction and parameterization of motions in large data sets , 2004, SIGGRAPH 2004.

[25]  Ganesh S. Oak.  Information Visualization Introduction , 2022 .

[26]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[27]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.