Learning Behavior Patterns from Video: A Data-driven Framework for Agent-based Crowd Modeling

This paper proposes a generic data-driven crowd modeling framework to generate crowd behaviors that can match the video data. The proposed framework uses a dual-layer mechanism to model the crowd behaviors. The bottom layer models the microscopic collision avoidance behaviors, while the top layer models the macroscopic crowd behaviors such as the goal selection patterns and the path navigation patterns. Based on the dual-layer mechanism, an automatic learning method is proposed to learn the model components from video data. To validate its effectiveness, the proposed framework is applied to generate the crowd behaviors in New York Grand Central Terminal. The simulation results demonstrate that the proposed method is able to construct effective model that can generate the desired emergent crowd behaviors and can offer promising prediction performance.

[1]  Michael Lees,et al.  Automatic rule identification for agent-based crowd models through gene expression programming , 2014, AAMAS.

[2]  Daniel Cohen-Or,et al.  Fitting behaviors to pedestrian simulations , 2009, SCA '09.

[3]  Harry Gifford.  Crowd Simulation , 2013 .

[4]  Dinesh Manocha,et al.  Modeling collision avoidance behavior for virtual humans , 2010, AAMAS.

[5]  Robert T. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Mubarak Shah,et al.  A Streakline Representation of Flow in Crowded Scenes , 2010, ECCV.

[8]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Wentong Cai,et al.  Crowd modeling and simulation technologies , 2010, TOMC.

[10]  Dahua Lin,et al.  Learning visual flows: A Lie algebraic approach , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Marshall F. Tappen,et al.  Learning pedestrian dynamics from the real world , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  Soraia Raupp Musse,et al.  Using computer vision to simulate the motion of virtual agents , 2007, Comput. Animat. Virtual Worlds.

[13]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[14]  Yngvi Björnsson,et al.  Simulation-Based Approach to General Game Playing , 2008, AAAI.

[15]  B. Welford.  Note on a Method for Calculating Corrected Sums of Squares and Products , 1962 .

[16]  Dinesh Manocha,et al.  Modeling, Simulation and Visual Analysis of Crowds , 2013, The International Series in Video Computing.

[17]  Demetri Terzopoulos,et al.  Autonomous pedestrians , 2005, SCA '05.

[18]  Michael Lees,et al.  EA-based evacuation planning using agent-based crowd simulation , 2014, Proceedings of the Winter Simulation Conference 2014.

[19]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[20]  Luis E. Ortiz,et al.  Who are you with and where are you going? , 2011, CVPR 2011.

[21]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Jehee Lee,et al.  Morphable crowds , 2010, SIGGRAPH 2010.

[23]  Michael Lees,et al.  Title Density-based evolutionary framework for crowd model calibration , 2018 .

[24]  Dinesh Manocha,et al.  Modeling, Simulation and Visual Analysis of Crowds: A Multidisciplinary Perspective , 2013, Modeling, Simulation and Visual Analysis of Crowds.

[25]  W. Eric L. Grimson,et al.  Modeling and estimating persistent motion with geometric flows , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Milind Tambe,et al.  ESCAPES: evacuation simulation with children, authorities, parents, emotions, and social comparison , 2011, AAMAS.

[27]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.

[28]  Dirk Helbing,et al.  Dynamics of crowd disasters: an empirical study. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Dirk Helbing,et al.  Specification of the Social Force Pedestrian Model by Evolutionary Adjustment to Video Tracking Data , 2007, Adv. Complex Syst..

[30]  Daniel Thalmann,et al.  Hierarchical Model for Real Time Simulation of Virtual Human Crowds , 2001, IEEE Trans. Vis. Comput. Graph..

[31]  Stephen John Turner,et al.  A Data-Driven Crowd Simulation Model Based on Clustering and Classification , 2013, 2013 IEEE/ACM 17th International Symposium on Distributed Simulation and Real Time Applications.

[32]  Dinesh Manocha,et al.  Parameter estimation and comparative evaluation of crowd simulations , 2014, Comput. Graph. Forum.

[33]  Dimitris N. Metaxas,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Group Behavior from Video: a Data-driven Approach to Crowd Simulation , 2022 .

[34]  Wentong Cai,et al.  Agent‐based human behavior modeling for crowd simulation , 2008, Comput. Animat. Virtual Worlds.