1 Innovations in Virtual Humans

This Chapter presents the main concepts of Virtual Humans. After a brief introduction, it gives a survey of the history of Virtual Humans starting from the earlier models of the sixties. Then, the modeling of human bodies is explained as well as the way body deformations can be handled. A large Section is dedicated to the animation of the skeleton with a description of main motion control methods like motion capture, parametric key-frame animation, or inverse kinematics. Motion retargeting, locomotion, and grasping techniques are also explained in details. Facial animation is presented in a specific Section as the methods are well different from the methods used for the body. A Section on autonomous characters describes properties like emotions, memory, or motivations. Finally, the last Section presents the main challenges when animating crowds.

[1]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[2]  Daniel Thalmann,et al.  A motivational model of action selection for virtual humans , 2005, International 2005 Computer Graphics.

[3]  Roy Featherstone,et al.  Robot Dynamics Algorithms , 1987 .

[4]  Mantyla,et al.  GWB: A Solid Modeler with Euler Operators , 1982, IEEE Computer Graphics and Applications.

[5]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[6]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[7]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[8]  Daniel Thalmann,et al.  Integration of motion control techniques for virtual human and avatar real-time animation , 1997, VRST '97.

[9]  Nadia Magnenat-Thalmann,et al.  An example-based approach to human body manipulation , 2004, Graph. Model..

[10]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[11]  David C. Brogan,et al.  Robot Herds: Group Behaviors for Systems with Significant Dynamics , 1994 .

[12]  Jarek Rossignac,et al.  Blowing Bubbles for Multi-Scale Analysis and Decomposition of Triangle Meshes , 2003, Algorithmica.

[13]  C. S. G. Lee,et al.  Robotics: Control, Sensing, Vision, and Intelligence , 1987 .

[14]  Norman I. Badler,et al.  Motion Abstraction and Mapping with Spatial Constraints , 1998, CAPTECH.

[15]  Lucas Kovar,et al.  Flexible automatic motion blending with registration curves , 2003, SCA '03.

[16]  Jane Wilhelms.  MODELING ANIMALS WITH BONES, MUSCLES, AND SKIN , 1995 .

[17]  Daniel Thalmann,et al.  Human skin deformation from cross-sections , 1994 .

[18]  Chapman,et al.  Aspects of the Kinematic Simulation of Human Movement , 1982, IEEE Computer Graphics and Applications.

[19]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[20]  David Zeltzer,et al.  Dynamic Simulation of a Complex Human Figure Model with Low Level Behavior Control , 1996, Presence: Teleoperators & Virtual Environments.

[21]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[22]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[23]  Daniel Thalmann,et al.  Interactive Shape Design Using Metaballs and Splines , 1995 .

[24]  Daniel Thalmann,et al.  Crowd simulation for interactive virtual environments and VRtraining systems , 2001 .

[25]  Richard H. Bartels,et al.  Interpolating splines with local tension, continuity, and bias control , 1984, SIGGRAPH.

[26]  Kenneth D. Willmert,et al.  Three-dimensional human display model , 1975, SIGGRAPH '75.

[27]  Thomas W. Calvert,et al.  Knowledge-Driven, Interactive Animation of Human Running , 1996, Graphics Interface.

[28]  S. LaValle.  Rapidly-exploring random trees : a new tool for path planning , 1998 .

[29]  J. Luck.  Kinesiology of the Human Body under Normal and Pathological Conditions. Arthur Steindler, M.D., (Hon.) F.R.C.S. Eng., F.A.C.S., F.I.C.S. Springfield, Illinois, Charles C. Thomas, 1955. $19.75 , 1955 .

[30]  Wayne E. Carlson,et al.  Anatomy-based modeling of the human musculature , 1997, SIGGRAPH.

[31]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[32]  Daniel Thalmann,et al.  A vision-based approach to behavioural animation , 1990, Comput. Animat. Virtual Worlds.

[33]  Daniel Thalmann,et al.  Planning Collision‐Free Reaching Motions for Interactive Object Manipulation and Grasping , 2003, Comput. Graph. Forum.

[34]  Toby Tyrell,et al.  The use of hierarchies for action selection , 1993 .

[35]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[36]  Jean-Arcady Meyer,et al.  Learning reactive and planning rules in a motivationally autonomous animat , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[37]  Michiel van de Panne,et al.  From Footprints to Animation , 1997, Comput. Graph. Forum.

[38]  Daniel Thalmann,et al.  Extended grasping behavior for autonomous human agents , 1997, AGENTS '97.

[39]  Eric Bouvier,et al.  From crowd simulation to airbag deployment: particle systems, a new paradigm of simulation , 1997, J. Electronic Imaging.

[40]  Sung Yong Shin,et al.  Planning biped locomotion using motion capture data and probabilistic roadmaps , 2003, TOGS.

[41]  Franck Multon,et al.  Computer Animation of Human Walking: a Survey , 1999 .

[42]  Fetter,et al.  A Progression of Human Figures Simulated by Computer Graphics , 1982, IEEE Computer Graphics and Applications.

[43]  Jane Wilhelms,et al.  Anatomically based modeling , 1997, SIGGRAPH.

[44]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[45]  Dimitris N. Metaxas,et al.  Automating gait generation , 2001, SIGGRAPH.

[46]  Daniel Thalmann,et al.  Using an Intermediate Skeleton and Inverse Kinematics for Motion Retargeting , 2000, Comput. Graph. Forum.

[47]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[48]  Daniel Thalmann,et al.  Real-Time Scalable Motion Planning for Crowds , 2007, 2007 International Conference on Cyberworlds (CW'07).

[49]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[50]  Marianne Dooley,et al.  Anthropometric Modeling Programs-A Survey , 1982, IEEE Computer Graphics and Applications.

[51]  I. Jolliffe.  Principal Component Analysis , 2002 .

[52]  Sung Yong Shin,et al.  On-line locomotion generation based on motion blending , 2002, SCA '02.

[53]  James K. Hahn,et al.  Animation of human walking in virtual environments , 1999, Proceedings Computer Animation 1999.

[54]  Norman I. Badler,et al.  Digital Representations of Human Movement , 1979, CSUR.

[55]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[56]  Daniel Thalmann,et al.  Hierarchical Model for Real Time Simulation of Virtual Human Crowds , 2001, IEEE Trans. Vis. Comput. Graph..

[57]  Eadweard Muybridge,et al.  The Human Figure in Motion , 1955 .

[58]  Ioannis A. Kakadiaris,et al.  Building Anthropometry-Based Virtual Human Models , 1994 .

[59]  Daniel Thalmann,et al.  Complex models for animating synthetic actors , 1991, IEEE Computer Graphics and Applications.

[60]  Daniel Thalmann,et al.  A global human walking model with real-time kinematic personification , 1990, The Visual Computer.

[61]  Nadia Magnenat-Thalmann,et al.  Feature Point Based Mesh Deformation Applied to MPEG-4 Facial Animation , 2000, DEFORM/AVATARS.

[62]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[63]  Maja J. Mataric,et al.  Motion planning using dynamic roadmaps , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[64]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[65]  Daniel Thalmann,et al.  Anyone for Tennis? , 1999, Presence: Teleoperators & Virtual Environments.

[66]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[67]  John Hart,et al.  ACM Transactions on Graphics: Editorial , 2003, SIGGRAPH 2003.

[68]  Daniel Thalmann,et al.  Navigation for digital actors based on synthetic vision, memory, and learning , 1995, Comput. Graph..

[69]  J. Rossignac,et al.  Plumber: a method for a multi-scale decomposition of 3D shapes into tubular primitives and bodies , 2004, SM '04.

[70]  Daniel Thalmann,et al.  Planning with Smart Objects , 2005, WSCG.

[71]  Daniel Thalmann,et al.  A Hand Control and Automatic Grasping System for Synthetic Actors , 1994, Comput. Graph. Forum.

[72]  Yiannis E. Papelis,et al.  HCSM: a framework for behavior and scenario control in virtual environments , 1995, TOMC.

[73]  Lydia E. Kavraki,et al.  Probabilistic roadmaps for path planning in high-dimensional configuration spaces , 1996, IEEE Trans. Robotics Autom..

[74]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[75]  Daniel Thalmann,et al.  Versatile Tuning of Humanoid Agent Activity , 2000, Comput. Graph. Forum.

[76]  Katsu Yamane,et al.  Synthesizing animations of human manipulation tasks , 2004, SIGGRAPH 2004.

[77]  Thierry Siméon,et al.  Visibility-based probabilistic roadmaps for motion planning , 2000, Adv. Robotics.

[78]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[79]  Adrien Treuille,et al.  Continuum crowds , 2006, SIGGRAPH 2006.

[80]  Norman I. Badler,et al.  JACK: a toolkit for manipulating articulated figures , 1988, UIST '88.

[81]  Ronan Boulic,et al.  Versatile walk engine , 2004, J. Game Dev..

[82]  Norman I. Badler,et al.  Task-Level Object Grasping for Simulated Agents , 1996, Presence: Teleoperators & Virtual Environments.

[83]  Norman I. Badler,et al.  Decision networks for integrating the behaviors of virtual agents and avatars , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[84]  Soraia Raupp Musse,et al.  A Behavioral Model for Real Time Simulation of Virtual Human Crowds , 2001 .

[85]  Daniel Thalmann,et al.  Construction of animation models out of captured data , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[86]  Daniel Thalmann,et al.  Solve customers' problems: interactive evolution for tinkering with computer animation , 2000, SAC '00.

[87]  Marc Alexa,et al.  Linear combination of transformations , 2002, ACM Trans. Graph..

[88]  Jessica K. Hodgins,et al.  Simulating leaping, tumbling, landing and balancing humans , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[89]  Daniel Thalmann,et al.  Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/cav.147 , 2022 .

[90]  Eric Bouvier,et al.  Crowd simulation in immersive space management , 1996 .