Computer animation: from avatars to unrestricted autonomous actors (A survey on replication and modelling mechanisms)

Abstract Dealing with synthetic actors who move and behave realistically in virtual environments is a task which involves different disciplines like Mechanics, Physics, Robotics, Artificial Intelligence, Artificial Life, Biology, Cognitive Sciences and so on. In this paper we use the nature of the information required for controlling actors’ motion and behaviour to propose a new classification of synthetic actors. A description of the different motion and behaviour techniques is presented. A set of Internet adresses of the most relevant research groups, commercial companies and other related sites in this area is also given.

[1]  J. V. van Wijk.  Flow visualization with surface particles , 1993, IEEE Computer Graphics and Applications.

[2]  Michiel van de Panne,et al.  Sensor-actuator networks , 1993, SIGGRAPH.

[3]  Randall D. Beer,et al.  A Dynamical Systems Perspective on Agent-Environment Interaction , 1995, Artif. Intell..

[4]  David Zeltzer,et al.  Dynamic simulation of autonomous legged locomotion , 1990, SIGGRAPH.

[5]  V. Braitenberg.  Vehicles, Experiments in Synthetic Psychology , 1984 .

[6]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[7]  Daniel Thalmann,et al.  A Hand Control and Automatic Grasping System for Synthetic Actors , 1994, Comput. Graph. Forum.

[8]  Barbara Hayes-Roth,et al.  Acting in Character , 2019, Creating Personalities for Synthetic Actors.

[9]  Pattie Maes,et al.  Artificial life meets entertainment: lifelike autonomous agents , 1995, CACM.

[10]  Frank Biocca,et al.  A Survey of Position Trackers , 1992, Presence: Teleoperators & Virtual Environments.

[11]  Thecla Schiphorst,et al.  Desktop animation of multiple human figures , 1993, IEEE Computer Graphics and Applications.

[12]  Bert Jüttler,et al.  Visualization of moving objects using dual quaternion curves , 1994, Comput. Graph..

[13]  Daniel Thalmann,et al.  The HUMANOID Environment for Interactive Animation of Multiple Deformable Human Characters , 1995, Comput. Graph. Forum.

[14]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[15]  Daniel Thalmann,et al.  State-of-the-art in Computer Animation , 1989, Springer Japan.

[16]  Daniel Thalmann,et al.  Autonomous Virtual Actors Based on Virtual Sensors , 1997, Creating Personalities for Synthetic Actors.

[17]  Chor Guan Teo,et al.  Procedural movement for articulated figure animation , 1994, Comput. Graph..

[18]  Norishige Chiba,et al.  Two-dimensional visual simulation of flames, smoke and the spread of fire , 1994, Comput. Animat. Virtual Worlds.

[19]  Randall Beer,et al.  Intelligence as Adaptive Behavior , 1990 .

[20]  David Zeltzer,et al.  Towards an integrated view of 3-D computer animation , 1986 .

[21]  Yuhua Luo,et al.  An automatic rotoscopy system for human motion based on a biomechanic graphical model , 1992, Comput. Graph..

[22]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[23]  P. Volino,et al.  Collision and Self-Collision Detection :Efficient and Robust Solutions for Highly Deformable Surfaces , 1995 .

[24]  Bruce Blumberg,et al.  Multi-level direction of autonomous creatures for real-time virtual environments , 1995, SIGGRAPH.

[25]  Zeltzer,et al.  Motor Control Techniques for Figure Animation , 1982, IEEE Computer Graphics and Applications.

[26]  Colin Beardon,et al.  Using Behavioural Rules in Animation , 1995, Computer Graphics.

[27]  Thomas W. Calvert,et al.  Goal-directed, dynamic animation of human walking , 1989, SIGGRAPH.

[28]  BodenheimerBobby,et al.  Verbs and Adverbs , 1998 .

[29]  Gavin S. P. Miller,et al.  Rapid, stable fluid dynamics for computer graphics , 1990, SIGGRAPH.

[30]  Daniel Thalmann,et al.  Computer animation - theory and practice , 1985, Computer science workbench.

[31]  Timothy Lethbridge,et al.  A simple heuristically-based method for expressive Stimulus-Response animation , 1989, Comput. Graph..

[32]  William T. Reeves.  Particle systems—a technique for modeling a class of fuzzy objects , 1993 .

[33]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[34]  A. Bryan Loyall.  Some Requirements and Approaches for Natural Language in a Believable Agent , 1997, Creating Personalities for Synthetic Actors.

[35]  Daniel Thalmann,et al.  Computer Animation for Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[36]  Ming-Tat Ko,et al.  An interactive approach to planning snake motion , 1994, Comput. Graph..

[37]  Robert Trappl,et al.  Creating Personalities for Synthetic Actors , 1997, Lecture Notes in Computer Science.

[38]  Barbara Hayes-Roth,et al.  An Architecture for Adaptive Intelligent Systems , 1995, Artif. Intell..

[39]  Jane Wilhelms,et al.  Using Dynamic Analysis for Realistic Animation of Articulated Bodies , 1987, IEEE Computer Graphics and Applications.

[40]  Anthony A. Maciejewski,et al.  Computational modeling for the computer animation of legged figures , 1985, SIGGRAPH.

[41]  B. Barsky,et al.  An Introduction to Splines for Use in Computer Graphics and Geometric Modeling , 1987 .

[42]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[43]  Jarke J. van Wijk.  Flow visualization with surface particles , 1993, IEEE Computer Graphics and Applications.

[44]  Richard L. Grimsdale,et al.  A system for modelling and visualization of cloth material , 1995, Comput. Graph..

[45]  Daniel Thalmann,et al.  Real-Time Animation of Realistic Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[46]  James F. Cremer,et al.  Simulation and scenario support for virtual environments , 1996, Comput. Graph..

[47]  Jean Louchet,et al.  Evolutionary identification of cloth animation models , 1995 .

[48]  William S. Havens,et al.  A Constraint‐Based Reasoning Framework for Behavioural Animation , 1994, Comput. Graph. Forum.

[49]  Geoff Wyvill,et al.  Four Dimensional Splines for Motion Control in Computer Animation , 1989 .

[50]  Robert B. McGhee,et al.  A Finite State Approach to the Synthesis of Bioengineering Control Systems , 1966 .

[51]  Hua Li,et al.  Physically based simulation of water currents and waves , 1997, Comput. Graph..

[52]  Patrik Larsson,et al.  A Distributed Neural Network Architecture for Hexapod Robot Locomotion , 1992, Neural Computation.

[53]  Martin Preston,et al.  Parallel Spacetime Animation , 1995 .

[54]  D Thalmann,et al.  Artificial Life and VirtualReality , 1994 .

[55]  Norman I. Badler,et al.  Making Them Move: Mechanics, Control & Animation of Articulated Figures , 1990 .

[56]  Daniel Thalmann,et al.  Combined Direct and Inverse Kinematic Control for Articulated Figure Motion Editing , 1992, Comput. Graph. Forum.

[57]  Marie-Paule Cani,et al.  Scripting Interactive Physically‐Based Motions with Relative Paths and Synchronization , 1996, Comput. Graph. Forum.

[58]  John F. Hughes,et al.  Smooth interpolation of orientations with angular velocity constraints using quaternions , 1992, SIGGRAPH.

[59]  Bülent Özgüç,et al.  An animation system for rigid and deformable models , 1993, Comput. Graph..

[60]  Jessica K. Hodgins,et al.  Animation of dynamic legged locomotion , 1991, SIGGRAPH.

[61]  Scott S. Snibbe.  A Direct Manipulation Interface for 3D Computer Animation , 1995, Comput. Graph. Forum.

[62]  David C. Brogan,et al.  Dynamically simulated characters in virtual environments , 1997, SIGGRAPH '97.

[63]  Lindsay William Macdonald,et al.  Interacting with Virtual Environments , 1993 .

[64]  Alain Fournier,et al.  A simple model of ocean waves , 1986, SIGGRAPH.

[65]  Robert K. L. Gay,et al.  A model for animating the motion of cloth , 1996, Comput. Graph..

[66]  C. W. A. M. van Overveld,et al.  Small steps for mankind: Towards a kinematically driven dynamic simulation of curved path walking , 1994, Comput. Animat. Virtual Worlds.

[67]  Randall D. Beer,et al.  Biologically inspired approaches to robotics: what can we learn from insects? , 1997, CACM.

[68]  MaesPattie.  Artificial life meets entertainment , 1995 .

[69]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[70]  Michael F. Cohen,et al.  Interactive spacetime control for animation , 1992, SIGGRAPH.

[71]  D. Thalmann,et al.  A new generation of synthetic actors: The real-time and interactive perceptive actors , 1996 .

[72]  Athomas Goldberg.  IMPROV: A System for Real-Time Animation of Behavior-Based Interactive Synthetic Actors , 1997, Creating Personalities for Synthetic Actors.

[73]  Daniel Thalmann,et al.  A vision-based approach to behavioural animation , 1990, Comput. Animat. Virtual Worlds.

[74]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[75]  Zicheng Liu,et al.  Hierarchical spacetime control , 1994, SIGGRAPH.

[76]  Michael E. Goss.  A real time particle system for display of ship wakes , 1990, IEEE Computer Graphics and Applications.

[77]  Daniel Thalmann,et al.  Inverse Kinetics for Center of Mass Position Control and Posture Optimization , 1994 .

[78]  Lance Williams,et al.  Motion signal processing , 1995, SIGGRAPH.

[79]  Zoran Popovic,et al.  Motion warping , 1995, SIGGRAPH.

[80]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[81]  Eugene Fiume,et al.  Depicting fire and other gaseous phenomena using diffusion processes , 1995, SIGGRAPH.

[82]  Nadia Magnenat-Thalmann,et al.  Key Frame and Painting Systems , 1985 .

[83]  Andrew P. Witkin,et al.  Dynamic simulation of non-penetrating flexible bodies , 1992, SIGGRAPH.

[84]  Peter Eisert,et al.  Analyzing Facial Expressions for Virtual Conferencing , 1998, IEEE Computer Graphics and Applications.

[85]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[86]  Darwyn R. Peachey,et al.  Modeling waves and surf , 1986, SIGGRAPH.

[87]  Daniel Thalmann,et al.  State-Of-The-Art in Computer Animation: Proceedings of Computer Animation '89 , 1989 .

[88]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[89]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[90]  P. Maes.  Modeling adaptive autonomous agents , 1993 .

[91]  Keith Waters,et al.  The computer synthesis of expressive three-dimensional facial character animation , 1988 .

[92]  Jessica K. Hodgins,et al.  Animation of Human Diving , 1996, Comput. Graph. Forum.

[93]  Seah Hock Soon,et al.  Rendering fireworks displays , 1992, IEEE Computer Graphics and Applications.

[94]  Michiel van de Panne,et al.  Guided Optimization for Balanced Locomotion , 1995 .

[95]  Daniel Thalmann,et al.  An evolving system for simulating clothes on virtual actors , 1996, IEEE Computer Graphics and Applications.

[96]  Demetri Terzopoulos,et al.  Artificial fishes: physics, locomotion, perception, behavior , 1994, SIGGRAPH.

[97]  Leon Sterling,et al.  An artificial insect , 1991 .

[98]  Jane Wilhelms,et al.  Toward Automatic Motion Control , 1987, IEEE Computer Graphics and Applications.

[99]  Michael F. Cohen,et al.  Controlling dynamic simulation with kinematic constraints , 1987, SIGGRAPH.

[100]  James K. Hahn,et al.  Genetic programming for articulated figure motion , 1995, Comput. Animat. Virtual Worlds.

[101]  Rodney A. Brooks,et al.  A robot that walks; emergent behaviors from a carefully evolved network , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[102]  Dimitris N. Metaxas,et al.  Dynamic deformation of solid primitives with constraints , 1992, SIGGRAPH.

[103]  Daniel Thalmann,et al.  Motion Control in Animation, Simulation and Visualization * , 1989 .

[104]  Daniel Thalmann,et al.  Complex models for animating synthetic actors , 1991, IEEE Computer Graphics and Applications.

[105]  N. Magnenat-Thalmann,et al.  Motion Control of Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[106]  Yuval Davidor,et al.  Genetic Algorithms and Robotics - A Heuristic Strategy for Optimization , 1991, World Scientific Series in Robotics and Intelligent Systems.

[107]  Leif Kobbelt,et al.  Using Simulated Annealing to Obtain Good Nodal Approximations of Deformable Bodies , 1995 .

[108]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[109]  Daniel Thalmann,et al.  Dressing animated synthetic actors with complex deformable clothes , 1992, SIGGRAPH.

[110]  Craig W. Reynolds.  Computer animation with scripts and actors , 1982, SIGGRAPH.

[111]  Joe Marks,et al.  Spacetime constraints revisited , 1993, SIGGRAPH.

[112]  Eugene Fiume,et al.  Limit cycle control and its application to the animation of balancing and walking , 1996, SIGGRAPH.

[113]  Bobby Bodenheimer,et al.  The Process of Motion Capture: Dealing with the Data , 1997, Computer Animation and Simulation.

[114]  Michael Cohen,et al.  Keyframe Motion Optimization By Relaxing Speed and Timing , 1995 .

[115]  Michael F. Cohen,et al.  Efficient generation of motion transitions using spacetime constraints , 1996, SIGGRAPH.

[116]  R. Paul.  Robot manipulators : mathematics, programming, and control : the computer control of robot manipulators , 1981 .

[117]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[118]  Richard H. Bartels,et al.  Interpolating splines with local tension, continuity, and bias control , 1984, SIGGRAPH.

[119]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[120]  Norman I. Badler,et al.  Inverse kinematics positioning using nonlinear programming for highly articulated figures , 1994, TOGS.

[121]  Joe Marks,et al.  Automatic motion synthesis for 3D mass-spring models , 1997, The Visual Computer.

[122]  Gordon Clapworthy,et al.  Inverse lagrangian dynamics for animating articulated models , 1991, Comput. Animat. Virtual Worlds.

[123]  Bruce Blumberg,et al.  Multi-level Control for Animated Autonomous Agents: Do the Right Thing...Oh, Not That , 1997, Creating Personalities for Synthetic Actors.

[124]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[125]  Daniel Thalmann,et al.  Goal-oriented design and correction of articulated figure motion with the TRACK system , 1994, Comput. Graph..

[126]  Daniel Thalmann,et al.  The Direction of Synthetic Actors in the Film Rendez-Vous a Montreal , 1987, IEEE Computer Graphics and Applications.

[127]  Ronen Barzel,et al.  Physically-based modeling for computer graphics: a structured approach , 1992 .

[128]  Ronen Barzel,et al.  A modeling system based on dynamic constraints , 1988, SIGGRAPH.

[129]  Daniel Thalmann,et al.  Computer Animation and Simulation ’95 , 1995, Eurographics.

[130]  Alex S. Fukunaga,et al.  Further experience with controller-based automatic motion synthesis for articulated figures , 1995, TOGS.

[131]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[132]  Jane Wilhelms,et al.  A 'Notion' for interactive behavioral animation control , 1990, IEEE Computer Graphics and Applications.

[133]  Norman I. Badler,et al.  Towards Personalities for Animated Agents with Reactive and Planning Behaviors , 1997, Creating Personalities for Synthetic Actors.

[134]  Steven D. Pieper,et al.  Control of a virtual actor: the roach , 1990, I3D '90.

[135]  William T. Reeves,et al.  Particle systems—a technique for modeling a class of fuzzy objects , 1983, International Conference on Computer Graphics and Interactive Techniques.

[136]  Richard Horn,et al.  Electronic performance support systems , 1997, CACM.

[137]  Rodney A. Brooks,et al.  A Robot that Walks; Emergent Behaviors from a Carefully Evolved Network , 1989, Neural Computation.

[138]  H. Gotoda,et al.  Modeling and animation of garment wrinkle formation processes , 1990 .