Informed Use of Motion Synthesis Methods

In virtual human (VH) applications, and in particular, games, motions with different functions are to be synthesized, such as communicative and manipulative hand gestures, locomotion, expression of emotions or identity of the character. In the bodily behavior, the primary motions define the function, while the more subtle secondary motions contribute to the realism and variability. From a technological point of view, there are different methods at our disposal for motion synthesis: motion capture and retargeting, procedural kinematic animation, force-driven dynamical simulation, or the application of Perlin noise. Which method to use for generating primary and secondary motions, and how to gather the information needed to define them? In this paper we elaborate on informed usage, in its two meanings. First we discuss, based on our own ongoing work, how motion capture data can be used to identify joints involved in primary and secondary motions, and to provide basis for the specification of essential parameters for motion synthesis methods used to synthesize primary and secondary motion. Then we explore the possibility of using different methods for primary and secondary motion in parallel in such a way, that one methods informs the other. We introduce our mixed usage of kinematic an dynamic control of different body parts to animate a character in real-time. Finally we discuss motion Turing test as a methodology for evaluation of mixed motion paradigms.

[1]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[2]  Herwin van Welbergen,et al.  Let's shake hands! On the coordination of gestures of humanoids , 2007 .

[3]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[4]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[5]  Hyeong-Seok Ko,et al.  Motion Balance Filtering , 2000, Comput. Graph. Forum.

[6]  Herwin van Welbergen,et al.  Elbows Higher! Performing, Observing and Correcting Exercises by a Virtual Trainer , 2008, IVA.

[7]  Michael F. Cohen,et al.  Controlling dynamic simulation with kinematic constraints , 1987, SIGGRAPH.

[8]  Maurizio Mancini,et al.  Implementing Expressive Gesture Synthesis for Embodied Conversational Agents , 2005, Gesture Workshop.

[9]  Jessica K. Hodgins,et al.  The Effects of Noise on the Perception of Animated Human Running , 1999, Computer Animation and Simulation.

[10]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Anton Nijholt,et al.  Temporal interaction between an artificial orchestra conductor and human musicians , 2008, CIE.

[12]  Hans-Peter Seidel,et al.  Annotated New Text Engine Animation Animation Lexicon Animation Gesture Profiles MR : . . . JL : . . . Gesture Generation Video Annotated Gesture Script , 2007 .

[13]  Nadia Magnenat-Thalmann,et al.  Personalised real-time idle motion synthesis , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[14]  Herwin van Welbergen,et al.  On the Parametrization of Clapping , 2009, Gesture Workshop.

[15]  Victor B. Zordan,et al.  Interactive dynamic response for games , 2007, Sandbox '07.

[16]  D. McNeill Hand and Mind , 1995 .

[17]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[18]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[19]  Rudolf Arnheim,et al.  Hand and Mind: What Gestures Reveal About Thought by David McNeill (review) , 2017 .

[20]  David A. Forsyth,et al.  Knowing when to put your foot down , 2006, I3D '06.

[21]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[22]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[23]  Herwin van Welbergen,et al.  Real-Time Animation Using a Mix of Physical Simulation and Kinematics , 2009, J. Graphics, GPU, & Game Tools.

[24]  Petros Faloutsos,et al.  The virtual stuntman: dynamic characters with a repertoire of autonomous motor skills , 2001, Comput. Graph..

[25]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[26]  E Otten,et al.  Inverse and forward dynamics: models of multi-body systems. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  C. Creider Hand and Mind: What Gestures Reveal about Thought , 1994 .