Long-term path prediction in urban scenarios using circular distributions

Abstract Human ability to foresee the near future plays a key role in everyone's life to prevent potentially dangerous situations. To be able to make predictions is crucial when people have to interact with the surrounding environment. Modeling such capability can lead to the design of automated warning systems and provide moving robots with an intelligent way of interaction with changing situation. In this work we focus on a typical urban human-scene where we aim at predicting an agent's behavior using a stochastic model. In this approach, we fuse the various factors that would contribute to a human motion in different contexts. Our method uses previously observed trajectories to build point-wise circular distributions that after combination, provide a statistical smooth prediction towards the most likely areas. More specifically, a ray-launching procedure, based on a semantic segmentation, gives a coarse scene representation for collision avoidance; a nearly-constant velocity dynamic model smooths the acceleration progression and knowledge of the agent's destination may further steer the path prediction. Experimental results in structured scenes, validate the effectiveness of the method in predicting paths in comparison to actual trajectories.

[1]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Ioannis A. Kakadiaris,et al.  Modeling local behavior for predicting social interactions towards human tracking , 2014, Pattern Recognit..

[3]  Roland Siegwart,et al.  Motion Planning for Car-Like Vehicles in Dynamic Urban Scenarios , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Luis E. Ortiz,et al.  Who are you with and where are you going? , 2011, CVPR 2011.

[5]  Martial Hebert,et al.  Activity Forecasting , 2012, ECCV.

[6]  Bernardo Wagner,et al.  Autonomous robot navigation based on OpenStreetMap geodata , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[7]  David F. Fouhey,et al.  Predicting Object Dynamics in Scenes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Imran N. Junejo,et al.  Multi feature path modeling for video surveillance , 2004, ICPR 2004.

[9]  Stefan Roth,et al.  People-tracking-by-detection and people-detection-by-tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Fredrik Gustafsson,et al.  EKF/UKF maneuvering target tracking using coordinated turn models with polar/Cartesian velocity , 2014, 17th International Conference on Information Fusion (FUSION).

[11]  Martial Hebert,et al.  Patch to the Future: Unsupervised Visual Prediction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Jin Young Choi,et al.  Visual Path Prediction in Complex Scenes with Crowded Moving Objects , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Shishir K. Shah,et al.  Human Trajectory Forecasting In Indoor Environments Using Geometric Context , 2014, ICVGIP.

[14]  Silvio Savarese,et al.  Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes , 2016, ECCV.

[15]  Christian Laugier,et al.  Intentional Motion Online Learning and Prediction , 2005, FSR.

[16]  Lu Wang,et al.  Adaptive human motion analysis and prediction , 2011, Pattern Recognit..

[17]  Ilaria Bartolini,et al.  Imagination: Exploiting Link Analysis for Accurate Image Annotation , 2007, Adaptive Multimedia Retrieval.

[18]  Kai Oliver Arras,et al.  Inverse Reinforcement Learning algorithms and features for robot navigation in crowds: An experimental comparison , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  X. Rong Li,et al.  A comparative study of multiple-model algorithms for maneuvering target tracking , 2005, SPIE Defense + Commercial Sensing.

[20]  Eike Rehder,et al.  Goal-Directed Pedestrian Prediction , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[21]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Gonzalo Ferrer,et al.  Bayesian Human Motion Intentionality Prediction in urban environments , 2014, Pattern Recognit. Lett..

[23]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Silvio Savarese,et al.  Knowledge Transfer for Scene-Specific Motion Prediction , 2016, ECCV.

[25]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[27]  Francisco Madrigal,et al.  Goal-oriented visual tracking of pedestrians with motion priors in semi-crowded scenes , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Dinesh Manocha,et al.  GLMP- realtime pedestrian path prediction using global and local movement patterns , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[30]  Song-Chun Zhu,et al.  Inferring "Dark Matter" and "Dark Energy" from Videos , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Nuno Vasconcelos,et al.  Anomaly Detection and Localization in Crowded Scenes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Takayuki Kanda,et al.  Modeling and Prediction of Pedestrian Behavior based on the Sub-goal Concept , 2012, Robotics: Science and Systems.

[33]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[34]  Silvio Savarese,et al.  Point-based path prediction from polar histograms , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[35]  Michael Goldhammer,et al.  Pedestrian's Trajectory Forecast in Public Traffic with Artificial Neural Networks , 2014, 2014 22nd International Conference on Pattern Recognition.

[36]  Tieniu Tan,et al.  Learning activity patterns using fuzzy self-organizing neural network , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  X. R. Li,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[38]  Chong Wang,et al.  Simultaneous image classification and annotation , 2009, CVPR.

[39]  Kai Oliver Arras,et al.  Learning socially normative robot navigation behaviors with Bayesian inverse reinforcement learning , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Ioannis A. Kakadiaris,et al.  What Do I See? Modeling Human Visual Perception for Multi-person Tracking , 2014, ECCV.