Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Group Behavior from Video: a Data-driven Approach to Crowd Simulation

Crowd simulation techniques have frequently been used to animate a large group of virtual humans in computer graphics applications. We present a data-driven method of simulating a crowd of virtual humans that exhibit behaviors imitating real human crowds. To do so, we record the motion of a human crowd from an aerial view using a camcorder, extract the two-dimensional moving trajectories of each individual in the crowd, and then learn an agent model from observed trajectories. The agent model decides each agent's actions based on features of the environment and the motion of nearby agents in the crowd. Once the agent model is learned, we can simulate a virtual crowd that behaves similarly to the real crowd in the video. The versatility and flexibility of our approach is demonstrated through examples in which various characteristics of group behaviors are captured and reproduced in simulated crowds.

[1]  Soraia Raupp Musse,et al.  A Model of Human Crowd Behavior : Group Inter-Relationship and Collision Detection Analysis , 1997, Computer Animation and Simulation.

[2]  Sunil Arya,et al.  ANN: library for approximate nearest neighbor searching , 1998 .

[3]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1998 .

[4]  John Funge,et al.  Cognitive modeling: knowledge, reasoning and planning for intelligent characters , 1999, SIGGRAPH.

[5]  Sung Yong Shin,et al.  A hierarchical approach to interactive motion editing for human-like figures , 1999, SIGGRAPH.

[6]  Leonidas J. Guibas,et al.  Scalable nonlinear dynamical systems for agent steering and crowd simulation , 2001, Comput. Graph..

[7]  Dirk Helbing,et al.  Self-Organizing Pedestrian Movement , 2001 .

[8]  Andreas Schadschneider,et al.  Simulation of evacuation processes using a bionics-inspired cellular automaton model for pedestrian dynamics , 2002 .

[9]  Nancy M. Amato,et al.  Better Group Behaviors in Complex Environments using Global Roadmaps , 2002 .

[10]  David C. Brogan,et al.  Realistic human walking paths , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[11]  R. Hughes.  The flow of human crowds , 2003 .

[12]  Tsai-Yen Li,et al.  Motion planning for a crowd of robots , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[13]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Mark H. Overmars,et al.  Eurographics/ACM SIGGRAPH Symposium on Computer Animation (2004) , 2022 .

[15]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[16]  Jessica K. Hodgins,et al.  Reactive pedestrian path following from examples , 2004, The Visual Computer.

[17]  Michael Gleicher,et al.  Scalable behaviors for crowd simulation , 2004, Comput. Graph. Forum.

[18]  Stephen Chenney,et al.  Flow tiles , 2004, SCA '04.

[19]  Leslie Pack Kaelbling,et al.  A Dynamical Model of Visually-Guided Steering, Obstacle Avoidance, and Route Selection , 2003, International Journal of Computer Vision.

[20]  David Salesin,et al.  Keyframe-based tracking for rotoscoping and animation , 2004, ACM Trans. Graph..

[21]  Sung Yong Shin,et al.  On‐line motion blending for real‐time locomotion generation , 2004, Comput. Animat. Virtual Worlds.

[22]  Stéphane Donikian,et al.  Crowd of Virtual Humans: a New Approach for Real Time Navigation in Complex and Structured Environments , 2004, Comput. Graph. Forum.

[23]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[24]  Daniel Thalmann,et al.  Planning with Smart Objects , 2005, WSCG.

[25]  Yu-Chi Lai,et al.  Group motion graphs , 2005, SCA '05.

[26]  Magnus Egerstedt,et al.  What Are the Ants Doing? Vision-Based Tracking and Reconstruction of Control Programs , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[27]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  N. Badler,et al.  Crowd simulation incorporating agent psychological models, roles and communication , 2005 .

[29]  Lucas Kovar,et al.  Fast and accurate goal-directed motion synthesis for crowds , 2005, SCA '05.

[30]  Jehee Lee,et al.  Motion patches: buildings blocks for virtual environments annotated with motion data , 2005, SIGGRAPH 2005.

[31]  Jehee Lee,et al.  Motion patches: building blocks for virtual environments annotated with motion data , 2006, ACM Trans. Graph..

[32]  Adrien Treuille,et al.  Continuum crowds , 2006, SIGGRAPH 2006.

[33]  Jean-Paul Laumond,et al.  Real-time navigating crowds: scalable simulation and rendering: Research Articles , 2006 .

[34]  Daniel Thalmann,et al.  Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/cav.147 , 2022 .

[35]  Adrien Treuille,et al.  Continuum crowds , 2006, ACM Trans. Graph..

[36]  Demetri Terzopoulos,et al.  Autonomous pedestrians , 2007, Graph. Model..