Authoring Multi-actor Behaviors in Crowds with Diverse Personalities

Multi-actor simulation is critical to cinematic content creation, disaster and security simulation, and interactive entertainment. A key challenge is providing an appropriate interface for authoring high-fidelity virtual actors with feature-rich control mechanisms capable of complex interactions with the environment and other actors. In this chapter, we present work that addresses the problem of behavior authoring at three levels: Individual and group interactions are conducted in an event-centric manner using parameterized behavior trees, social crowd dynamics are captured using the OCEAN personality model, and a centralized automated planner is used to enforce global narrative constraints on the scale of the entire simulation. We demonstrate the benefits and limitations of each of these approaches and propose the need for a single unifying construct capable of authoring functional, purposeful, autonomous actors which conform to a global narrative in an interactive simulation.

[1]  E. Hall,et al.  The Hidden Dimension , 1970 .

[2]  L. F. Henderson,et al.  The Statistics of Crowd Fluids , 1971, Nature.

[3]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[4]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[5]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[6]  A. Tellegen,et al.  An alternative "description of personality": the big-five factor structure. , 1990, Journal of personality and social psychology.

[7]  Gunnar G. Løvås,et al.  Modeling and Simulation of Pedestrian Traffic Flow , 1994 .

[8]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  J. S. Wiggins,et al.  The five-factor model of personality : theoretical perspectives , 1996 .

[10]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[11]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[12]  Aaron Bryan Loyall,et al.  Believable agents: building interactive personalities , 1997 .

[13]  Nagui M. Rouphail,et al.  Effect of Pedestrians on Capacity of Signalized Intersections , 1998 .

[14]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[15]  Craig W. Reynolds Steering Behaviors For Autonomous Characters , 1999 .

[16]  Harry J. P. Timmermans,et al.  A Multi-Agent Cellular Automata System for Visualising Simulated Pedestrian Activity , 2000, ACRI.

[17]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[18]  Eric Menou Real-Time Character Animation Using Multi-layered Scripts and Spacetime Optimization , 2001, International Conference on Virtual Storytelling.

[19]  N. Badler,et al.  Toward Representing Agent Behaviors Modified by Personality and Emotion , 2002 .

[20]  Soraia Raupp Musse,et al.  Modeling individual behaviors in crowd simulation , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[21]  Andrew Stern,et al.  Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade , 2003 .

[22]  Céline Loscos,et al.  Intuitive crowd behavior in dense urban environments using local laws , 2003, Proceedings of Theory and Practice of Computer Graphics, 2003..

[23]  Robert Michael Young,et al.  Managing interaction between users and agents in a multi-agent storytelling environment , 2003, AAMAS '03.

[24]  Nadia Magnenat-Thalmann,et al.  Generic personality and emotion simulation for conversational agents , 2004, Comput. Animat. Virtual Worlds.

[25]  Nadia Magnenat-Thalmann,et al.  Generic personality and emotion simulation for conversational agents: Research Articles , 2004 .

[26]  Brian Magerko,et al.  AI Characters and Directors for Interactive Computer Games , 2004, AAAI.

[27]  Andreas Schadschneider,et al.  Extended Floor Field CA Model for Evacuation Dynamics , 2004, IEICE Trans. Inf. Syst..

[28]  Stephen Chenney,et al.  Flow tiles , 2004, SCA '04.

[29]  Stéphane Donikian,et al.  Crowd of Virtual Humans: a New Approach for Real Time Navigation in Complex and Structured Environments , 2004, Comput. Graph. Forum.

[30]  Norman I. Badler,et al.  Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Grenoble, France, August 27-29, 2004 , 2004, Symposium on Computer Animation.

[31]  Demetri Terzopoulos,et al.  Autonomous pedestrians , 2005, SCA '05.

[32]  Stacy Marsella,et al.  PsychSim: Modeling Theory of Mind with Decision-Theoretic Agents , 2005, IJCAI.

[33]  Patrick Gebhard,et al.  ALMA: a layered model of affect , 2005, AAMAS '05.

[34]  Serge P. Hoogendoorn,et al.  Pedestrian Travel Behavior Modeling , 2005 .

[35]  Stacy Marsella,et al.  THESPIAN: An Architecture for Interactive Pedagogical Drama , 2005, AIED.

[36]  Felix A. Fischer,et al.  An integrated framework for adaptive reasoning about conversation patterns , 2005, AAMAS '05.

[37]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.

[38]  Demetri Terzopoulos,et al.  A decision network framework for the behavioral animation of virtual humans , 2007, SCA '07.

[39]  Dimitris N. Metaxas,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Group Behavior from Video: a Data-driven Approach to Crowd Simulation , 2022 .

[40]  Norman I. Badler,et al.  Controlling individual agents in high-density crowd simulation , 2007, SCA '07.

[41]  Sébastien Paris,et al.  Pedestrian Reactive Navigation for Crowd Simulation: a Predictive Approach , 2007, Comput. Graph. Forum.

[42]  Stefan Kopp,et al.  The Behavior Markup Language: Recent Developments and Challenges , 2007, IVA.

[43]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[44]  Dinesh Manocha,et al.  Interactive navigation of multiple agents in crowded environments , 2008, I3D '08.

[45]  Norman I. Badler,et al.  Virtual Crowds: Methods, Simulation, and Control , 2008, Virtual Crowds: Methods, Simulation, and Control.

[46]  Norman I. Badler,et al.  Virtual Crowds: Methods, Simulation, and Control (Synthesis Lectures on Computer Graphics and Animation) , 2008 .

[47]  Petros Faloutsos,et al.  Egocentric affordance fields in pedestrian steering , 2009, I3D '09.

[48]  Norman I. Badler,et al.  Smart Events and Primed Agents , 2010, IVA.

[49]  J. Pettré,et al.  A synthetic-vision based steering approach for crowd simulation , 2010, ACM Trans. Graph..

[50]  Boyang Li,et al.  Creating Customized Game Experiences by Leveraging Human Creative Effort: A Planning Approach , 2010, AGS.

[51]  Glenn Reinman,et al.  Multi-actor Planning for Directable Simulations , 2011, 2011 Workshop on Digital Media and Digital Content Management.

[52]  Glenn Reinman,et al.  Parallelized egocentric fields for autonomous navigation , 2012, The Visual Computer.

[53]  Norman I. Badler,et al.  Selecting Agents for Narrative Roles , 2011, Intelligent Narrative Technologies.

[54]  Dinesh Manocha,et al.  Simulating heterogeneous crowd behaviors using personality trait theory , 2011, SCA '11.

[55]  Norman I. Badler,et al.  How the Ocean Personality Model Affects the Perception of Crowds , 2011, IEEE Computer Graphics and Applications.

[56]  Glenn Reinman,et al.  A Behavior-Authoring Framework for Multiactor Simulations , 2011, IEEE Computer Graphics and Applications.

[57]  Norman I. Badler,et al.  Parameterizing Behavior Trees , 2011, MIG.

[58]  Glenn Reinman,et al.  A modular framework for adaptive agent-based steering , 2011, SI3D.

[59]  Glenn Reinman,et al.  Footstep navigation for dynamic crowds , 2011, SI3D.

[60]  Norman I. Badler,et al.  Event-Centric Control for Background Agents , 2011, ICIDS.

[61]  Mubbasir Kapadia,et al.  Navigation and steering for autonomous virtual humans. , 2013, Wiley interdisciplinary reviews. Cognitive science.

[62]  Norman I. Badler,et al.  Multi-domain real-time planning in dynamic environments , 2013, SCA '13.

[63]  Norman I. Badler,et al.  ADAPT: The Agent Developmentand Prototyping Testbed , 2014, IEEE Trans. Vis. Comput. Graph..

[64]  Norman I. Badler,et al.  ADAPT: The Agent Developmentand Prototyping Testbed , 2013, IEEE Transactions on Visualization and Computer Graphics.