What's Next? The New Era of Autonomous Virtual Humans

This paper identifies several key limitations in the representation, control, locomotion, and authoring of autonomous virtual humans that must be addressed to enter the new age of interactive virtual world applications. These limitations include simplified particle representations of agents which decouples control and locomotion, the lack of multi-modal perception in virtual environments, the need for multiple levels of control granularity, homogeneity in character animation, and monolithic agent architectures which cannot scale to complex multi-agent interactions and global narrative constraints. We present this broad perspective with the objective of providing the stimulus for an exciting new era of virtual human research.

[1]  R. Laban.  The mastery of movement on the stage , 1950 .

[2]  J. S. Wiggins,et al.  The five-factor model of personality : theoretical perspectives , 1996 .

[3]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[4]  Aaron Bryan Loyall,et al.  Believable agents: building interactive personalities , 1997 .

[5]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1998 .

[6]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[7]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[8]  Jessica K. Hodgins,et al.  Reactive pedestrian path following from examples , 2004, The Visual Computer.

[9]  Stéphane Donikian,et al.  Crowd of Virtual Humans: a New Approach for Real Time Navigation in Complex and Structured Environments , 2004, Comput. Graph. Forum.

[10]  Lucas Kovar,et al.  Fast and accurate goal-directed motion synthesis for crowds , 2005, SCA '05.

[11]  Sebastian Thrun,et al.  Anytime Dynamic A*: An Anytime, Replanning Algorithm , 2005, ICAPS.

[12]  Mel Slater,et al.  Building Expression into Virtual Characters , 2006, Eurographics.

[13]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.

[14]  Demetri Terzopoulos,et al.  A decision network framework for the behavioral animation of virtual humans , 2007, SCA '07.

[15]  Brian Gygi,et al.  Similarity and categorization of environmental sounds , 2007, Perception & psychophysics.

[16]  Sébastien Paris,et al.  Pedestrian Reactive Navigation for Crowd Simulation: a Predictive Approach , 2007, Comput. Graph. Forum.

[17]  Dinesh Manocha,et al.  Real-time navigation of independent agents using adaptive roadmaps , 2007, VRST '07.

[18]  Dinesh Manocha,et al.  AD-Frustum: Adaptive Frustum Tracing for Interactive Sound Propagation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[19]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[20]  Daniel Thalmann,et al.  Crowd Simulation , 2007, Wiley Encyclopedia of Computer Science and Engineering.

[21]  M. A. Bee,et al.  The cocktail party problem: what is it? How can it be solved? And why should animal behaviorists study it? , 2008, Journal of comparative psychology.

[22]  Norman I. Badler,et al.  Virtual Crowds: Methods, Simulation, and Control , 2008, Virtual Crowds: Methods, Simulation, and Control.

[23]  Benjamin W. Wah,et al.  Wiley Encyclopedia of Computer Science and Engineering , 2009, Wiley Encyclopedia of Computer Science and Engineering.

[24]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[25]  Carol O'Sullivan,et al.  Clone attack! Perception of crowd variety , 2008, SIGGRAPH 2008.

[26]  Petros Faloutsos,et al.  Egocentric affordance fields in pedestrian steering , 2009, I3D '09.

[27]  Glenn Reinman,et al.  An Open Framework for Developing, Evaluating, and Sharing Steering Algorithms , 2009, MIG.

[28]  Darryl Charles,et al.  MIST: An Interactive Storytelling System with Variable Character Behavior , 2010, ICIDS.

[29]  Marcelo Kallmann.  Shortest paths with arbitrary clearance from navigation meshes , 2010, SCA '10.

[30]  Dinesh Manocha,et al.  Simulating heterogeneous crowd behaviors using personality trait theory , 2011, SCA '11.

[31]  Norman I. Badler,et al.  How the Ocean Personality Model Affects the Perception of Crowds , 2011, IEEE Computer Graphics and Applications.

[32]  Ari Shapiro,et al.  Building a Character Animation System , 2011, MIG.

[33]  Glenn Reinman,et al.  Scenario space: characterizing coverage, quality, and failure of steering algorithms , 2011, SCA '11.

[34]  Glenn Reinman,et al.  A Behavior-Authoring Framework for Multiactor Simulations , 2011, IEEE Computer Graphics and Applications.

[35]  P. Torrens,et al.  Building Agent‐Based Walking Models by Machine‐Learning on Diverse Databases of Space‐Time Trajectory Samples , 2011 .

[36]  Glenn Reinman,et al.  A modular framework for adaptive agent-based steering , 2011, SI3D.

[37]  Glenn Reinman,et al.  Footstep navigation for dynamic crowds , 2011, SI3D.

[38]  Norman I. Badler,et al.  Event-Centric Control for Background Agents , 2011, ICIDS.

[39]  Taku Komura,et al.  Environment-aware real-time crowd control , 2012, SCA '12.