Multiscale motion saliency for keyframe extraction from motion capture sequences

Motion capture is an increasingly popular animation technique; however data acquired by motion capture can become substantial. This makes it difficult to use motion capture data in a number of applications, such as motion editing, motion understanding, automatic motion summarization, motion thumbnail generation, or motion database search and retrieval. To overcome this limitation, we propose an automatic approach to extract keyframes from a motion capture sequence. We treat the input sequence as motion curves, and obtain the most salient parts of these curves using a new proposed metric, called 'motion saliency'. We select the curves to be analysed by a dimension reduction technique, Principal Component Analysis (PCA). We then apply frame reduction techniques to extract the most important frames as keyframes of the motion. With this approach, around 8% of the frames are selected to be keyframes for motion capture sequences. Copyright © 2010 John Wiley & Sons, Ltd.

[1]  Okan Arikan.  Compression of motion capture databases , 2006, ACM Trans. Graph..

[2]  Richard E. Parent,et al.  Computer animation - algorithms and techniques , 2012 .

[3]  Masahiro Okuda,et al.  Embedded Key-Frame Extraction for CG Animation by Frame Decimation , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[4]  Xin Liu,et al.  Video summarization using singular value decomposition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Zhigang Deng,et al.  Compression of Human Motion Capture Data Using Motion Pattern Indexing , 2009, Comput. Graph. Forum.

[6]  Michael Gleicher,et al.  Staggered poses: a character motion representation for detail-preserving editing of pose and coordinated timing , 2008, SCA '08.

[7]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[8]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[9]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[10]  In-Kwon Lee,et al.  Rubber-like Exaggeration for Character Animation , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[11]  Kunio Kondo,et al.  Keyframes Extraction Method for Motion Capture Data , 2004 .

[12]  Feng Liu,et al.  3D motion retrieval with motion index tree , 2003, Comput. Vis. Image Underst..

[13]  Sung Yong Shin,et al.  Example-based motion cloning: Research Articles , 2004 .

[14]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[15]  Daniel Thalmann,et al.  Construction of animation models out of captured data , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[16]  Sung Yong Shin,et al.  Example‐based motion cloning , 2004, Comput. Animat. Virtual Worlds.

[17]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[18]  Daniel Thalmann,et al.  PCA-based walking engine using motion capture data , 2004, Proceedings Computer Graphics International, 2004..

[19]  N. Badler,et al.  Real Time Inverse Kinematics with Joint Limits and Spatial Constraints , 1989 .

[20]  Chun-Fa Chang,et al.  Key Probe: a technique for animation keyframe extraction , 2005, The Visual Computer.

[21]  Masahiro Okuda,et al.  Position-Based Keyframe Selection for Human Motion Animation , 2005, 11th International Conference on Parallel and Distributed Systems (ICPADS'05).

[22]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[23]  Jonathan Foote,et al.  Summarizing video using non-negative similarity matrix factorization , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[24]  Daniel Thalmann,et al.  Key-posture extraction out of human motion data , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  In-Kwon Lee,et al.  Rubber-like Exaggeration for Character Animation , 2007 .

[26]  Eyuphan Bulut,et al.  Key Frame Extraction from Motion Capture Data by Curve Saliency , 2007 .

[27]  Christoph Bregler,et al.  Motion capture assisted animation: texturing and synthesis , 2002, ACM Trans. Graph..

[28]  Ronan Boulic,et al.  Motion Editing Using Multiresolution Filtering , 1999 .

[29]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[30]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.