Entropy‐based motion extraction for motion capture animation

In this paper, we present a new segmentation solution for extracting motion patterns from motion capture data by searching for critical keyposes in the motion sequence. A rank is established for critical keyposes that identifies the significance of the directional change in motion data. The method is based on entropy metrics, specifically the mutual information measure. Displacement histograms between frames are evaluated and the mutual information metric is employed in order to calculate the inter‐frame dependency. The most significant keypose identifies the largest directional change in the motion data. This will have the lowest mutual information level from all the candidate keyposes. Less significant keyposes are then listed with higher mutual information levels. The results show that the method has higher sensitivity in the directional change than methods based on the magnitude of the velocity alone. This method is intended to provide a summary of a motion clip by ranked keyposes, which is highly useful in motion browsing and motion retrieve database system. Copyright © 2005 John Wiley & Sons, Ltd.

[1]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[2]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognit..

[3]  Thomas D. C. Little,et al.  A Survey of Technologies for Parsing and Indexing Digital Video1 , 1996, J. Vis. Commun. Image Represent..

[4]  Sung Yong Shin,et al.  Rhythmic-motion synthesis based on motion-beat analysis , 2003, ACM Trans. Graph..

[5]  Feng Liu,et al.  3D motion retrieval with motion index tree , 2003, Comput. Vis. Image Underst..

[6]  Zhu Liu,et al.  Multimedia content analysis-using both audio and visual clues , 2000, IEEE Signal Process. Mag..

[7]  Ze-Nian Li,et al.  Video dissolve and wipe detection via spatio-temporal images of chromatic histogram differences , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[8]  Paul England,et al.  Comparison of automatic video segmentation algorithms , 1996, Other Conferences.

[9]  Hyun Joon Shin,et al.  Snap-together motion: assembling run-time animations , 2003, ACM Trans. Graph..

[10]  Michael Gleicher,et al.  Comparing Constraint-Based Motion Editing Methods , 2001, Graph. Model..

[11]  David A. Forsyth,et al.  Motion synthesis from annotations , 2003, ACM Trans. Graph..

[12]  Ioannis Pitas,et al.  Entropy metrics used for video summarization , 2002, SCCG '02.

[13]  Rainer Lienhart,et al.  Reliable dissolve detection , 2001, IS&T/SPIE Electronic Imaging.

[14]  Ioannis Pitas,et al.  Content-based video parsing and indexing based on audio-visual interaction , 2001, IEEE Trans. Circuits Syst. Video Technol..

[15]  Lucas Kovar,et al.  Motion Graphs , 2002, ACM Trans. Graph..

[16]  Harry Shum,et al.  Motion texture: a two-level statistical model for character motion synthesis , 2002, ACM Trans. Graph..

[17]  Frédéric Bevilacqua,et al.  3D motion capture data: motion analysis and mapping to music , 2002 .

[18]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[19]  Frédéric Bevilacqua,et al.  Virtual dance and music environment using motion capture , 2001 .

[20]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[21]  André Zaccarin,et al.  A system for reliable dissolve detection in videos , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[22]  Katsu Yamane,et al.  Optical motion capture system with pan-tilt camera tracking and real time data processing , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[23]  Adrian Hilton,et al.  Realistic synthesis of novel human movements from a database of motion capture examples , 2000, Proceedings Workshop on Human Motion.

[24]  Thomas W. Calvert,et al.  Knowledge-Driven, Interactive Animation of Human Running , 1996, Graphics Interface.

[25]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[26]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.