Video-based Bottleneck Detection utilizing Lagrangian Dynamics in Crowded Scenes

Avoiding bottleneck situations in crowds is critical for the safety and comfort of people at large events or in public transportation. Based on the work of Lagrangian motion analysis we propose a novel video-based bottleneck-detector by identifying characteristic stowage patterns in crowd-movements captured by optical flow fields. The Lagrangian framework allows to assess complex time-dependent crowd-motion dynamics at large temporal scales near the bottleneck by two dimensional Lagrangian fields. In particular we propose long-term temporal filtered Finite Time Lyapunov Exponents (FTLE) fields that provide towards a more global segmentation of the crowd movements and allows to capture its deformations when a crowd is passing a bottleneck. Finally, these deformations are used for an automatic spatio-temporal detection of such situations. The performance of the proposed approach is shown in extensive evaluations on the existing Jülich and AGO-RASET datasets, that we have updated with ground truth data for spatio-temporal bottleneck analysis.

[1]  G. Haller A variational theory of hyperbolic Lagrangian Coherent Structures , 2010 .

[2]  Tobias Senst,et al.  Robust local optical flow: Long-range motions and varying illuminations , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[3]  Denis Bartolo,et al.  Dynamic response and hydrodynamics of polarized crowds , 2019, Science.

[4]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Soraia Raupp Musse,et al.  Crowd Analysis Using Computer Vision Techniques , 2010, IEEE Signal Processing Magazine.

[6]  Tobias Senst,et al.  Crowd Violence Detection Using Global Motion-Compensated Lagrangian Features and Scale-Sensitive Video-Level Representation , 2017, IEEE Transactions on Information Forensics and Security.

[7]  Mubarak Shah,et al.  Visual crowd surveillance through a hydrodynamics lens , 2011, Commun. ACM.

[8]  Nicolas Courty,et al.  AGORASET: a dataset for crowd video analysis , 2012 .

[9]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  M. Arshad,et al.  Underwater crowd flow detection using Lagrangian dynamics , 2009 .

[11]  Andreas Schadschneider,et al.  Empirical Study of the Influence of Social Groups in Evacuation Scenarios , 2016 .

[12]  Tobias Senst,et al.  Detecting People Carrying Objects Utilizing Lagrangian Dynamics , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[13]  Bernhard Steffen,et al.  New Insights into Pedestrian Flow Through Bottlenecks , 2009, Transp. Sci..

[14]  Vahid Azizi,et al.  Finding the Convex Hull of a Simple Polygon , 2010, CSC.

[15]  Tobias Senst,et al.  A Lagrangian framework for video analytics , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[16]  Jack Sklansky,et al.  Finding the convex hull of a simple polygon , 1982, Pattern Recognit. Lett..

[17]  Mubarak Shah,et al.  Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Bingbing Ni,et al.  Crowded Scene Analysis: A Survey , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  G. Haller Lagrangian Coherent Structures , 2015 .

[20]  Armin Seyfried,et al.  Collective phenomena in crowds—Where pedestrian dynamics need social psychology , 2017, PloS one.

[21]  R. Hughes The flow of human crowds , 2003 .

[22]  Armin Seyfried,et al.  Experimental Study on Pedestrian Flow through Wide Bottleneck , 2014 .

[23]  Sahin Albayrak,et al.  Human action recognition using Lagrangian descriptors , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).