AONet: Active Offset Network for crowd flow prediction

Abstract Predicting crowd flow is of great importance to public safety and traffic management. The crowd flow is difficult to predict accurately and timely due to the uncertainty of the future positions. In this paper, we propose a novel Active Offset Network (AONet), in which ActiveGRU (Active Gate Recurrent Unit) is designed to predict the variation of pedestrians’ positions in the crowd flow. Its inner location-variant recurrent structure is implemented by utilizing convolution operation on low dimensional spatio-temporal sequences to obtain fractional offset locations. Afterwards, the sampling locations are determined by bilinear interpolation on fractional offset locations. Moreover, a probabilistic sparse strategy is introduced to reduce the links between sampling locations during supervised training. Finally, the experiments over popular benchmarks demonstrate that our method can actively characterize the future positions of pedestrians. Meanwhile, the performance of the proposed AONet is superior over state-of-art baselines with regard to both accuracy and computational savings.

[1]  Md Zakirul Alam Bhuiyan,et al.  Deep Irregular Convolutional Residual LSTM for Urban Traffic Passenger Flows Prediction , 2020, IEEE Transactions on Intelligent Transportation Systems.

[2]  Stefan Roth,et al.  MOT16: A Benchmark for Multi-Object Tracking , 2016, ArXiv.

[3]  Jian-Huang Lai,et al.  Detecting abnormal crowd behaviors based on the div-curl characteristics of flow fields , 2019, Pattern Recognit..

[4]  Dit-Yan Yeung,et al.  Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model , 2017, NIPS.

[5]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[6]  Sultan Daud Khan Congestion detection in pedestrian crowds using oscillation in motion trajectories , 2019, Eng. Appl. Artif. Intell..

[7]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.

[8]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[9]  Xiaogang Wang,et al.  Coherent Filtering: Detecting Coherent Motions from Crowd Clutters , 2012, ECCV.

[10]  Tobias Senst,et al.  Optical Flow Dataset and Benchmark for Visual Crowd Analysis , 2018, 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[11]  Xiaogang Wang,et al.  Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Xiaogang Wang,et al.  Learning Scene-Independent Group Descriptors for Crowd Understanding , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Antoni Martínez-Ballesté,et al.  Move, Attend and Predict: An attention-based neural model for people's movement prediction , 2018, Pattern Recognit. Lett..

[14]  Wang-chun Woo,et al.  Operational Application of Optical Flow Techniques to Radar-Based Rainfall Nowcasting , 2017 .

[15]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[16]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Tianrui Li,et al.  Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networks , 2017, Artif. Intell..