Learning Motion Features for Example-Based Finger Motion Estimation for Virtual Characters

This paper presents a methodology for estimating the motion of a character’s fingers based on the use of motion features provided by a virtual character’s hand. In the presented methodology, firstly, the motion data is segmented into discrete phases. Then, a number of motion features are computed for each motion segment of a character’s hand. The motion features are pre-processed using restricted Boltzmann machines, and by using the different variations of semantically similar finger gestures in a support vector machine learning mechanism, the optimal weights for each feature assigned to a metric are computed. The advantages of the presented methodology in comparison to previous solutions are the following: First, we automate the computation of optimal weights that are assigned to each motion feature counted in our metric. Second, the presented methodology achieves an increase (about 17%) in correctly estimated finger gestures in comparison to a previous method.

[1]  Yeongho Seol,et al.  Creature features: online motion puppetry for non-human characters , 2013, SCA '13.

[2]  Christos Mousas,et al.  Real-Time Motion Synthesis for Multiple Goal-Directed Tasks Using Motion Layers , 2012, VRIPHYS.

[3]  Jinxiang Chai,et al.  Robust realtime physics-based motion control for human grasping , 2013, ACM Trans. Graph..

[4]  C. Karen Liu,et al.  Synthesis of detailed hand manipulations using contact sampling , 2012, ACM Trans. Graph..

[5]  Thorsten Joachims,et al.  Learning a Distance Metric from Relative Comparisons , 2003, NIPS.

[6]  Christos Mousas,et al.  Data-Driven Motion Reconstruction Using Local Regression Models , 2014, AIAI.

[7]  Jessica K. Hodgins,et al.  The perception of finger motions , 2010, APGV '10.

[8]  Luc Van Gool,et al.  Data-driven animation of hand-object interactions , 2011, Face and Gesture 2011.

[9]  Jean-Claude Martin,et al.  Combining Facial and Postural Expressions of Emotions in a Virtual Character , 2009, IVA.

[10]  C. Karen Liu,et al.  Dexterous manipulation using both palm and fingers , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Ge Jin,et al.  Adding Hand Motion to the Motion Capture Based Character Animation , 2005, ISVC.

[12]  Sarit Kraus,et al.  Data-driven finger motion synthesis with interactions , 2016, Symposium on Computer Animation.

[13]  Michael Neff,et al.  Automatic Hand-Over Animation for Free-Hand Motions from Low Resolution Input , 2012, MIG.

[14]  C. Karen Liu.  Dextrous manipulation from a grasping pose , 2009, SIGGRAPH 2009.

[15]  Dinesh K. Pai,et al.  Interaction capture and synthesis , 2005, SIGGRAPH 2005.

[16]  Sophie Jörg,et al.  Data-Driven Hand Animation Synthesis , 2016 .

[17]  Sheldon Andrews,et al.  Goal directed multi-finger manipulation: Control policies and analysis , 2013, Comput. Graph..

[18]  Karan Singh,et al.  Eurographics/siggraph Symposium on Computer Animation (2003) Handrix: Animating the Human Hand , 2003 .

[19]  Jinxiang Chai,et al.  Accurate realtime full-body motion capture using a single depth camera , 2012, ACM Trans. Graph..

[20]  D. McNeill.  Hand and Mind: What Gestures Reveal about Thought , 1992 .

[21]  Victor B. Zordan,et al.  Automatic splicing for hand and body animations , 2006, SCA '06.

[22]  Jean-Claude Martin,et al.  Impact of Expressive Wrinkles on Perception of a Virtual Character's Facial Expressions of Emotions , 2009, IVA.

[23]  Andreas Aristidou,et al.  Emotion Analysis and Classification: Understanding the Performers' Emotions Using the LMA Entities , 2015, Comput. Graph. Forum.

[24]  Michael Neff,et al.  State of the Art in Hand and Finger Modeling and Animation , 2015, Comput. Graph. Forum.

[25]  Ludovic Hoyet,et al.  Sleight of hand: perception of finger motion from reduced marker sets , 2012, I3D '12.

[26]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[27]  Andreas Nürnberger,et al.  An Experimental Comparison of Similarity Adaptation Approaches , 2011, Adaptive Multimedia Retrieval.

[28]  Christos Mousas,et al.  Real-time performance-driven finger motion synthesis , 2017, Comput. Graph..

[29]  Kostas Karpouzis,et al.  SOMM: Self organizing Markov map for gesture recognition , 2010, Pattern Recognit. Lett..

[30]  Fumihito Kyota,et al.  Fast Grasp Synthesis for Various Shaped Objects , 2012, Comput. Graph. Forum.

[31]  B. Prabhakaran,et al.  Semantic Quantization of 3D Human Motion Capture Data Through Spatial-Temporal Feature Extraction , 2008, MMM.

[32]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[33]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[34]  Gerhard Winkler,et al.  Image Analysis, Random Fields and Markov Chain Monte Carlo Methods: A Mathematical Introduction , 2002 .

[35]  Hans-Peter Seidel,et al.  Modeling Relaxed Hand Shape for Character Animation , 2006, AMDO.

[36]  Victor B. Zordan,et al.  Automatic Hand-Over Animation using Principle Component Analysis , 2013, MIG.

[37]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[38]  Jessica K. Hodgins,et al.  Data-driven finger motion synthesis for gesturing characters , 2012, ACM Trans. Graph..

[39]  Christos Mousas,et al.  Splicing of Concurrent Upper-body Motion Spaces with Locomotion , 2013, VARE.

[40]  Darko Kirovski,et al.  Real-time classification of dance gestures from skeleton animation , 2011, SCA '11.

[41]  Christos Mousas,et al.  Analyzing and Segmenting Finger Gestures in Meaningful Phases , 2014, 2014 11th International Conference on Computer Graphics, Imaging and Visualization.

[42]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-based continuous gesture recognition system for hand motion trajectory , 2008, 2008 19th International Conference on Pattern Recognition.

[43]  Arjan Egges,et al.  Motion Transplantation Techniques: A Survey , 2012, IEEE Computer Graphics and Applications.

[44]  Christos Mousas,et al.  Evaluating the covariance matrix constraints for data-driven statistical human motion reconstruction , 2014, SCCG.

[45]  Christos Mousas,et al.  Finger motion estimation and synthesis for gesturing characters , 2015, SCCG.

[46]  Eugene Fiume,et al.  Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion , 2005, SCA '05.

[47]  Victor B. Zordan,et al.  Physically based grasping control from example , 2005, SCA '05.

[48]  Bernd Hamann,et al.  A system for automatic animation of piano performances , 2013, Comput. Animat. Virtual Worlds.