Segmenting motion capture data using a qualitative analysis

Many interactive 3D games utilize motion capture for both character animation and user input. These applications require short, meaningful sequences of data. Manually producing these segments of motion capture data is a laborious, time-consuming process that is impractical for real-time applications. We present a method to automatically produce semantic segmentations of general motion capture data by examining the qualitative properties that are intrinsic to all motions, using Laban Movement Analysis (LMA). LMA provides a good compromise between high-level semantic features, which are difficult to extract for general motions, and low-level kinematic features, which often yield unsophisticated segmentations. Our method finds motion sequences which exhibit high output similarity from a collection of neural networks trained with temporal variance. We show that segmentations produced using LMA features are more similar to manual segmentations, both at the frame and the segment level, than several other automatic segmentation methods.

[1]  Jake K. Aggarwal,et al.  View invariant human action recognition using histograms of 3D joints , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Thomas B. Moeslund,et al.  Finding Motion Primitives in Human Body Gestures , 2005, Gesture Workshop.

[3]  Norman I. Badler,et al.  Acquiring and validating motion qualities from live limb gestures , 2005, Graph. Model..

[4]  Philippe Beaudoin,et al.  Motion-motif graphs , 2008, SCA '08.

[5]  Lorenzo Torresani,et al.  Learning Motion Style Synthesis from Perceptual Observations , 2006, NIPS.

[6]  Nadia Magnenat-Thalmann,et al.  Modelling and Motion Capture Techniques for Virtual Environments , 1998, Lecture Notes in Computer Science.

[7]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.

[8]  Jessica K. Hodgins,et al.  Hierarchical Aligned Cluster Analysis for Temporal Clustering of Human Motion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Atsushi Nakazawa,et al.  Rhythmic motion analysis using motion capture and musical information , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..

[10]  Shuangjiu Xiao,et al.  Real-Time 3D Motion Recognition of Skeleton Animation Data Stream , 2013 .

[11]  Taesoo Kwon,et al.  Motion modeling for on-line locomotion synthesis , 2005, SCA '05.

[12]  Mohamad Ivan Fanany,et al.  A method for dance motion recognition and scoring using two-layer classifier based on conditional random field and stochastic error-correcting context-free grammar , 2014, 2014 IEEE 3rd Global Conference on Consumer Electronics (GCCE).

[13]  Toru Nakata Temporal segmentation and recognition of body motion data based on inter-limb correlation analysis , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Luc Van Gool,et al.  Metric Learning from Poses for Temporal Clustering of Human Motion , 2012, BMVC.

[15]  Wright-Patterson Afb,et al.  Feature Selection Using a Multilayer Perceptron , 1990 .

[16]  Reinhard Klein,et al.  Efficient unsupervised temporal segmentation of human motion , 2014, SCA '14.

[17]  Maja J. Mataric,et al.  Automated derivation of behavior vocabularies for autonomous humanoid motion , 2003, AAMAS '03.

[18]  Lars Omlor,et al.  Segmentation of Action Streams Human Observers vs. Bayesian Binning , 2011, KI.

[19]  Martin A. Giese,et al.  Trajectory synthesis by hierarchical spatio-temporal correspondence: comparison of different methods , 2005, APGV '05.

[20]  R. R. Rhinehart,et al.  A method to determine the required number of neural-network training repetitions , 1999, IEEE Trans. Neural Networks.

[21]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[22]  Maja J. Mataric,et al.  A spatio-temporal extension to Isomap nonlinear dimension reduction , 2004, ICML.

[23]  Nanning Zheng,et al.  Unsupervised Analysis of Human Gestures , 2001, IEEE Pacific Rim Conference on Multimedia.

[24]  Shu-Juan Peng Motion Segmentation Using Central Distance Features and Low-Pass Filter , 2010, 2010 International Conference on Computational Intelligence and Security.

[25]  Meinard Müller,et al.  Motion templates for automatic classification and retrieval of motion capture data , 2006, SCA '06.

[26]  Gérard G. Medioni,et al.  Kernelized Temporal Cut for Online Temporal Segmentation and Recognition , 2012, ECCV.

[27]  K. Uehara,et al.  Extraction of primitive motion and discovery of association rules from motion data , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[28]  Yiannis Aloimonos,et al.  Understanding visuo‐motor primitives for motion synthesis and analysis , 2006, Comput. Animat. Virtual Worlds.

[29]  Keechul Jung,et al.  Graph-based High Level Motion Segmentation using Normalized Cuts , 2008 .

[30]  Norman I. Badler,et al.  Semantic Segmentation of Motion Capture Using Laban Movement Analysis , 2007, IVA.

[31]  Martin A. Giese,et al.  On the Representation, Learning and Transfer of Spatio-Temporal Movement Characteristics , 2003, Int. J. Humanoid Robotics.

[32]  Tom Murray,et al.  Predicting sun spots using a layered perceptron neural network , 1996, IEEE Trans. Neural Networks.

[33]  Mathieu Barnachon,et al.  A real-time system for motion retrieval and interpretation , 2013, Pattern Recognit. Lett..

[34]  Yiannis Aloimonos,et al.  Understanding visuo-motor primitives for motion synthesis and analysis: Research Articles , 2006 .

[35]  Norman I. Badler,et al.  Efficient motion retrieval in large motion databases , 2013, I3D '13.

[36]  Kuniaki Uehara,et al.  A Motion Recognition Method by Using Primitive Motions , 2000, VDB.

[37]  Norman I. Badler,et al.  Motion Abstraction and Mapping with Spatial Constraints , 1998, CAPTECH.

[38]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[39]  Ahmed M. Elgammal,et al.  Human Motion Synthesis by Motion Manifold Learning and Motion Primitive Segmentation , 2006, AMDO.

[40]  Peter Robinson,et al.  Detecting Affect from Non-stylised Body Motions , 2007, ACII.

[41]  Ruzena Bajcsy,et al.  Sequence of the Most Informative Joints (SMIJ): A new representation for human skeletal action recognition , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[42]  Meinard Müller,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH '05.