A Human and Group Behaviour Simulation Evaluation Framework utilising Composition and Video Analysis

In this work, we present the modular crowd simulation evaluation through composition framework, which provides a quantitative comparison between different pedestrian and crowd simulation approaches. Evaluation is made based on the comparison of source footage against synthetic video created through novel composition techniques. The proposed framework seeks to reduce the complexity of simulation evaluation and provide a platform from which the comparison of differing simulation algorithms and parametric tuning can be conducted to improve simulation accuracy or provide measures of similarity between crowd simulation algorithms and source data. Through the use of features designed to mimic the human visual system, specific simulation properties can be evaluated relative to sample footage. Validation was performed on a number of popular crowd data sets and through comparisons of multiple pedestrian and crowd simulation algorithms.

[1]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[2]  Sos S. Agaian,et al.  Human visual system based similarity metrics , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[3]  George Yannis,et al.  A critical assessment of pedestrian behaviour models , 2009 .

[4]  Ivan Laptev,et al.  Data-driven crowd analysis in videos , 2011, ICCV.

[5]  Dirk Helbing,et al.  Crowd behaviour during high-stress evacuations in an immersive virtual environment , 2016, Journal of The Royal Society Interface.

[6]  Z. Zivkovic.  Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[7]  Sergio A. Velastin,et al.  Crowd analysis: a survey , 2008, Machine Vision and Applications.

[8]  Yan Liu,et al.  Accurate indoor tracking using a mobile phone and non-overlapping camera sensor networks , 2012, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[9]  Yiorgos Chrysanthou,et al.  A Data‐Driven Framework for Visual Crowd Analysis , 2014, Comput. Graph. Forum.

[10]  Dinesh Manocha,et al.  A statistical similarity measure for aggregate crowd dynamics , 2012, ACM Trans. Graph..

[11]  Ernst Heinrich Weber,et al.  De pulsu, resorptione, auditu et tactu. Annotationes anatomicae et physiologicae , 1834 .

[12]  Seungho Lee,et al.  An integrated pedestrian behavior model based on Extended Decision Field Theory and Social Force model , 2010, Proceedings of the 2010 Winter Simulation Conference.

[13]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Tim J. Ellis,et al.  Path detection in video surveillance , 2002, Image Vis. Comput..

[15]  Daniel Cohen-Or,et al.  Context‐Dependent Crowd Evaluation , 2010, Comput. Graph. Forum.

[16]  Kenneth Tze Kin Teo,et al.  Kalman filtering based object tracking in surveillance video system , 2011 .

[17]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[18]  Shaogang Gong,et al.  From Semi-supervised to Transfer Counting of Crowds , 2013, 2013 IEEE International Conference on Computer Vision.

[19]  Sergio A. Velastin,et al.  Selecting and evaluating data for training a pedestrian detector for crowded conditions , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[20]  Takamasa Iryo,et al.  Microscopic pedestrian simulation model combined with a tactical model for route choice behaviour , 2010 .

[21]  Dimitrios Makris,et al.  Clustered Spatio-temporal Manifolds for Online Action Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  Yongtae Do,et al.  On the neural computation of the scale factor in perspective transformation camera model , 2013, 2013 10th IEEE International Conference on Control and Automation (ICCA).

[23]  Vasileios Argyriou,et al.  Quad-Tree Motion Estimation in the Frequency Domain Using Gradient Correlation , 2005, IEEE Transactions on Multimedia.

[24]  Carol O'Sullivan,et al.  Path patterns: analyzing and comparing real and simulated crowds , 2016, I3D.

[25]  Gregory D. Hager,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, CVPR.

[26]  Mark H. Overmars,et al.  A Predictive Collision Avoidance Model for Pedestrian Simulation , 2009, MIG.

[27]  Glenn Reinman,et al.  SteerBench: a benchmark suite for evaluating steering behaviors , 2009, Comput. Animat. Virtual Worlds.

[28]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[29]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Bikramjit Banerjee,et al.  Evaluation and Comparison of Multi-agent Based Crowd Simulation Systems , 2010, AGS.

[31]  Frank Dignum.  Agents for Games and Simulations II , 2011 .

[32]  Takayuki Kanda,et al.  Pedestrian Group Behaviour Analysis under Different Density Conditions , 2014 .

[33]  Nicolas Courty,et al.  Crowd Flow Characterization with Optimal Control Theory , 2009, ACCV.

[34]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  J M Zanker,et al.  Does Motion Perception Follow Weber's Law? , 1995, Perception.

[36]  Shuqiang Guo,et al.  Camera Pose Estimation Using Frequency Analysis , 2014, 2014 International Conference on Information Science & Applications (ICISA).

[37]  Glenn Reinman,et al.  Scenario space: characterizing coverage, quality, and failure of steering algorithms , 2011, SCA '11.

[38]  Serge P. Hoogendoorn,et al.  State-of-the-art crowd motion simulation models , 2013 .

[39]  Daniel Cohen-Or,et al.  Data Driven Evaluation of Crowds , 2009, MIG.

[40]  Dimitrios Makris,et al.  G3Di: A Gaming Interaction Dataset with a Real Time Detection and Evaluation Framework , 2014, ECCV Workshops.

[41]  Alistair A. Young,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2017, MICCAI 2017.

[42]  Takamasa Iryo,et al.  A Pedestrian Model Considering Anticipatory Behaviour for Capacity Evaluation , 2009 .

[43]  Stéphane Donikian,et al.  Experiment-based modeling, simulation and validation of interactions between virtual walkers , 2009, SCA '09.

[44]  Claudio Rosito Jung,et al.  Towards a quantitative approach for comparing crowds , 2012, Comput. Animat. Virtual Worlds.

[45]  Tieniu Tan,et al.  Tracking people through occlusions , 2004, ICPR 2004.

[46]  Dariu Gavrila,et al.  Pedestrian Detection and Tracking Using a Mixture of View-Based Shape–Texture Models , 2008, IEEE Transactions on Intelligent Transportation Systems.

[47]  Stefano Soatto,et al.  Tracklet Descriptors for Action Modeling and Video Analysis , 2010, ECCV.

[48]  Dinesh Manocha,et al.  Interactive simulation of dynamic crowd behaviors using general adaptation syndrome theory , 2012, I3D '12.

[49]  Torsten Sattler,et al.  Camera Pose Voting for Large-Scale Image-Based Localization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[50]  D. Helbing,et al.  Self-Organization Phenomena in Pedestrian Crowds , 1998, cond-mat/9806152.

[51]  Craig W. Reynolds.  Steering Behaviors For Autonomous Characters , 1999 .

[52]  Vasileios Argyriou,et al.  Sub-Hexagonal Phase Correlation for Motion Estimation , 2011, IEEE Transactions on Image Processing.

[53]  Dinesh Manocha,et al.  Parameter estimation and comparative evaluation of crowd simulations , 2014, Comput. Graph. Forum.

[54]  Armin Seyfried,et al.  Analyzing Stop-and-Go Waves by Experiment and Modeling , 2011 .

[55]  Taras I. Lakoba,et al.  Modifications of the Helbing-Molnár-Farkas-Vicsek Social Force Model for Pedestrian Evolution , 2005, Simul..

[56]  Vasileios Argyriou,et al.  Crowd Simulation for Dynamic Environments based on Information Spreading and Agents’ Personal Interests , 2014 .

[57]  Franziska Klügl-Frohnmeyer,et al.  Agent-Based Pedestrian Simulation of Train Evacuation Integrating Environmental Data , 2009, KI.

[58]  Michael J. Black,et al.  A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them , 2013, International Journal of Computer Vision.

[59]  Gang Qiao,et al.  The Role of Data-driven Priors in Multi-agent Crowd Trajectory Estimation , 2017, AAAI.