Virtual human animation based on movement observation and cognitive behavior models

Automatically animating virtual humans with actions that reflect real human motions is still a challenge. We present a framework for animation that is based on utilizing empirical and validated data from movement observation and cognitive psychology. To illustrate these, we demonstrate a mapping from effort motion factors onto expressive arm movements, and from cognitive data to autonomous attention behaviors. We conclude with a discussion on the implications of this approach for the future of real time virtual human animation.

[1]  C. L. M..  The Psychology of Attention , 1890, Nature.

[2]  C. Dell.  A Primer for Movement Description Using Effort Shape and Supplementary Concepts , 1970 .

[3]  D. Kahneman.  Attention and Effort , 1973 .

[4]  Rudolf von Laban,et al.  Effort: economy in body movement , 1974 .

[5]  I. Bartenieff,et al.  Body Movement: Coping with the Environment , 1980 .

[6]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[7]  J. Jonides.  Voluntary versus automatic control over the mind's eye's movement , 1981 .

[8]  Norman I. Badler,et al.  Parametric keyframe interpolation incorporating kinetic adjustment and phrasing control , 1985, SIGGRAPH.

[9]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[10]  M. Posner,et al.  Inhibition of return : Neural basis and function , 1985 .

[11]  V. Maletic.  Body - Space - Expression: The Development of Rudolf Laban's Movement and Dance Concepts , 1987 .

[12]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[13]  C. Moore,et al.  Beyond Words: Movement Observation and Analysis , 1988 .

[14]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[15]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[16]  N. Moray.  Designing for attention. , 1993 .

[17]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[18]  Joe Marks,et al.  Spacetime constraints revisited , 1993, SIGGRAPH.

[19]  S. Yantis.  Stimulus-driven attentional capture and attentional control settings. , 1993, Journal of experimental psychology. Human perception and performance.

[20]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[21]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[22]  Demetri Terzopoulos,et al.  Artificial fishes: physics, locomotion, perception, behavior , 1994, SIGGRAPH.

[23]  S. Yantis,et al.  Visual motion and attentional capture , 1994, Perception & psychophysics.

[24]  Daniel Thalmann,et al.  Navigation for digital actors based on synthetic vision, memory, and learning , 1995, Comput. Graph..

[25]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[26]  Norman I. Badler,et al.  Instructions, Intentions and Expectations , 1995, Artif. Intell..

[27]  Norman I. Badler,et al.  Decision networks for integrating the behaviors of virtual agents and avatars , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[28]  Mark Steedman,et al.  Generating Facial Expressions for Speech , 1996, Cogn. Sci..

[29]  J. Hahn,et al.  Interpolation Synthesis of Articulated Figure Motion , 1997, IEEE Computer Graphics and Applications.

[30]  W. Lewis Johnson,et al.  Steve: an animated pedagogical agent for procedural training in virtual environments , 1997, SGAR.

[31]  E. Ldavas,et al.  Eye Movements and Orienting of Attention in Patients with Visual Neglect , 1997, Journal of Cognitive Neuroscience.

[32]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1998 .

[33]  Norman I. Badler,et al.  Motion Abstraction and Mapping with Spatial Constraints , 1998, CAPTECH.

[34]  Sonu Chopra,et al.  Where To Look? Automating Some Visual Attending Behaviors of Human Characters , 1998 .

[35]  Kristinn R. Thórisson,et al.  Real-time decision making in multimodal face-to-face communication , 1998, AGENTS '98.

[36]  D. Thalmann,et al.  A behavioral animation system for autonomous actors personified by emotions , 1998 .

[37]  Justine Cassell,et al.  BodyChat: autonomous communicative behaviors in avatars , 1998, AGENTS '98.

[38]  Norman I. Badler,et al.  A Parameterized Action Representation for Virtual Human Agents , 1998 .

[39]  Norman I. Badler,et al.  A motion control scheme for animating expressive arm movements , 1999 .

[40]  Norman I. Badler,et al.  Where to look? automating certain visual attending behaviors of human characters , 1999 .