Mixed Traffic Trajectory Prediction Using LSTM-Based Models in Shared Space

Real–world behaviors of human road users in a non-regulated space (shared space) are complex. Firstly, there is no explicit regulation in such an area. Users self-organize to share the space. They are more likely to use as little energy as possible to reach their destinations in the shortest possible way, and try to avoid any potential collision. Secondly, different types of users (pedestrians, cyclists, and vehicles) behave differently. For example, pedestrians are more flexible to change their speed and trajectory, while cyclists and vehicles are more or less limited by their travel device—abrupt changes might lead to danger. While there are established models to describe the behavior of individual humans (e.g. Social Force model), due to the heterogeneity of transport modes and diversity of environments, hand-crafted models have difficulties in handling complicated interactions in mixed traffic. To this end, this paper proposes using a Long Short–Term Memory (LSTM) recurrent neural networks based deep learning approach to model user behaviors. It encodes user position coordinates, sight of view, and interactions between different types of neighboring users as spatio–temporal features to predict future trajectories with collision avoidance. The real–world data–driven method can be trained with pre-defined neural networks to circumvent complex manual design and calibration. The results show that ViewType-LSTM, which mimics how a human sees and reacts to different transport modes can well predict mixed traffic trajectories in a shared space at least in the next 3 s, and is also robust in complicated situations.

[1]  Mohan M. Trivedi,et al.  Learning trajectory patterns by clustering: Experimental studies and comparative evaluation , 2009, CVPR.

[2]  Bernhard Friedrich,et al.  Modeling of shared space with multi-modal traffic using a multi-layer social force approach , 2015 .

[3]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.

[4]  Martin Fellendorf,et al.  Modeling Concepts for Mixed Traffic , 2012 .

[5]  Emma Clarke,et al.  Shared space - the alternative approach to calming traffic , 2006 .

[6]  Ioannis Kaparias,et al.  Analysing the perceptions of pedestrians and drivers to shared space , 2012 .

[7]  Luca Bertinetto,et al.  Fully-Convolutional Siamese Networks for Object Tracking , 2016, ECCV Workshops.

[8]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[9]  G T Taoka BREAK REACTION TIMES OF UNALERTED DRIVERS , 1989 .

[10]  Trisalyn A. Nelson,et al.  A review of quantitative methods for movement data , 2013, Int. J. Geogr. Inf. Sci..

[11]  C. Richards,et al.  The negotiation of stationary and moving obstructions during walking: anticipatory locomotor adaptations and preservation of personal space. , 2005, Motor control.

[12]  Roger Dunn,et al.  A Review of the Evolution of Shared (Street) Space Concepts in Urban Environments , 2014 .

[13]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[14]  Andreas Krause,et al.  Robot navigation in dense human crowds: the case for cooperation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[15]  Luis E. Ortiz,et al.  Who are you with and where are you going? , 2011, CVPR 2011.

[16]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[17]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Xiaogang Wang,et al.  Pedestrian Behavior Understanding and Prediction with Deep Neural Networks , 2016, ECCV.

[20]  Nikos Pelekis,et al.  Clustering uncertain trajectories , 2011, Knowledge and Information Systems.

[21]  Fei-Yue Wang,et al.  Capturing Car-Following Behaviors by Deep Learning , 2018, IEEE Transactions on Intelligent Transportation Systems.

[22]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[23]  C. Schiermeyer,et al.  A discrete choice model for solving conflict situations between pedestrians and vehicles in shared space , 2017, 1709.09412.

[24]  Slava Kisilevich,et al.  A conceptual framework and taxonomy of techniques for analyzing movement , 2011, J. Vis. Lang. Comput..

[25]  Bernhard Friedrich,et al.  A multi-layer social force approach to model interactions in shared spaces using collision prediction , 2017 .