Efficient content-based retrieval of motion capture data

The reuse of human motion capture data to create new, realistic motions by applying morphing and blending techniques has become an important issue in computer animation. This requires the identification and extraction of logically related motions scattered within some data set. Such content-based retrieval of motion capture data, which is the topic of this paper, constitutes a difficult and time-consuming problem due to significant spatio-temporal variations between logically related motions. In our approach, we introduce various kinds of qualitative features describing geometric relations between specified body points of a pose and show how these features induce a time segmentation of motion capture data streams. By incorporating spatio-temporal invariance into the geometric features and adaptive segments, we are able to adopt efficient indexing methods allowing for flexible and efficient content-based retrieval and browsing in huge motion capture databases. Furthermore, we obtain an efficient preprocessing method substantially accelerating the cost-intensive classical dynamic time warping techniques for the time alignment of logically similar motion data streams. We present experimental results on a test data set of more than one million frames, corresponding to 180 minutes of motion. The linearity of our indexing algorithms guarantees the scalability of our results to much larger data sets.

[1]  Ian H. Witten,et al.  Managing gigabytes , 1994 .

[2]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[3]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[4]  Stefan Carlsson,et al.  Combinatorial Geometry for Shape Representation and Indexing , 1996, Object Representation in Computer Vision.

[5]  Stefan Carlsson,et al.  Order Structure, Correspondence, and Shape Based Categories , 1999, Shape, Contour and Grouping in Computer Vision.

[6]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[7]  Eamonn Keogh Exact Indexing of Dynamic Time Warping , 2002, VLDB.

[8]  BreglerChristoph,et al.  Motion capture assisted animation , 2002 .

[9]  Stefan Carlsson,et al.  Recognizing and Tracking Human Action , 2002, ECCV.

[10]  Dimitrios Gunopulos,et al.  Fast Motion Capture Matching with Replicated Motion Editing , 2003 .

[11]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[12]  Ling Guan,et al.  Quantifying and recognizing human movement patterns from monocular video Images-part I: a new framework for modeling human motion , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Frank Kurth,et al.  A unified approach to content-based and fault-tolerant music recognition , 2004, IEEE Transactions on Multimedia.

[14]  Chih-Yi Chiu,et al.  Content-based retrieval for human motion data , 2004, J. Vis. Commun. Image Represent..

[15]  Abraham Kandel,et al.  Data Mining in Time Series Database , 2004 .

[16]  Dimitrios Gunopulos,et al.  Indexing Large Human-Motion Databases , 2004, VLDB.

[17]  Martin A. Giese,et al.  Morphable Models for the Analysis and Synthesis of Complex Motion Patterns , 2000, International Journal of Computer Vision.

[18]  Michael Gleicher,et al.  Automated extraction and parameterization of motions in large data sets , 2004, SIGGRAPH 2004.