Multiple human trajectory prediction and cooperative navigation modeling in crowded scenes

As mobile robots start operating in environments crowded with humans, human-aware navigation is required to make these robots navigate safely, efficiently and in socially compliant manner. People navigate in an interactive and cooperative fashion so that, they are able to find their path to a destination even if there is no clear route leading to it. There are significant efforts to solve this problem for mobile robots; however, they are not scalable to high human density and learning based approaches depend heavily on the context and configuration of the set they are trained with. We develop a method which infers initial trajectories from Gaussian processes and updates these trajectories jointly for all agents using a cost based interaction approach. We condition Gaussian processes online with the best hypothesis at each step of prediction horizon. The method is tested on a common public dataset and it is shown that it outperforms two state-of-the-art approaches in terms of human-likeness of predicted trajectories.

[1]  Kai Oliver Arras,et al.  Inverse Reinforcement Learning algorithms and features for robot navigation in crowds: An experimental comparison , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  J. Cacioppo,et al.  On seeing human: a three-factor theory of anthropomorphism. , 2007, Psychological review.

[3]  M. E. Shaw,et al.  Empirical investigations of a reconceptualized personal space , 1980 .

[4]  Wolfram Burgard,et al.  Feature-Based Prediction of Trajectories for Socially Compliant Navigation , 2012, Robotics: Science and Systems.

[5]  G. Csibra,et al.  Goal attribution without agency cues: the perception of ‘pure reason’ in infancy , 1999, Cognition.

[6]  P. Fiorini,et al.  Motion planning in dynamic environments using the relative velocity paradigm , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[7]  Irfan A. Essa,et al.  Detecting regions of interest in dynamic scenes with camera motions , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Thomas Bak,et al.  Trajectory planning for robots in dynamic human environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Gianni Ferretti,et al.  Generation of human walking paths , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  R. Kram,et al.  Energetic cost and preferred speed of walking in obese vs. normal weight women. , 2005, Obesity research.

[11]  Stephen Bitgood,et al.  Not Another Step! Economy of Movement and Pedestrian Choice Point Behavior in Shopping Malls , 2006 .

[12]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Luc Van Gool,et al.  Wrong turn - No dead end: A stochastic pedestrian motion model , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[14]  Wolfram Burgard,et al.  Socially compliant mobile robot navigation via inverse reinforcement learning , 2016, Int. J. Robotics Res..

[15]  Dirk Helbing,et al.  Pedestrian, Crowd and Evacuation Dynamics , 2013, Encyclopedia of Complexity and Systems Science.

[16]  Ninad Pradhan,et al.  Robot crowd navigation using predictive position fields in the potential function framework , 2011, Proceedings of the 2011 American Control Conference.

[17]  R. Kram,et al.  Effects of obesity and sex on the energetic cost and preferred speed of walking. , 2006, Journal of applied physiology.

[18]  Andreas Krause,et al.  Robot navigation in dense human crowds: the case for cooperation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Cara M. Wall-Scheffler,et al.  Energetic Consequences of Human Sociality: Walking Speed Choices among Friendly Dyads , 2013, PloS one.

[20]  Stephen Cameron,et al.  3-D Path Planning and Target Trajectory Prediction for the Oxford Aerial Tracking System , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[21]  E. Hall,et al.  The Hidden Dimension , 1970 .

[22]  Yasushi Nakauchi,et al.  A Social Robot that Stands in Line , 2002, Auton. Robots.

[23]  P. Willems,et al.  Effect of load and speed on the energetic cost of human walking , 2005, European Journal of Applied Physiology.

[24]  A. Colman Cooperation, psychological game theory, and limitations of rationality in social interaction , 2003, Behavioral and Brain Sciences.

[25]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Andreas Krause,et al.  Unfreezing the robot: Navigation in dense, interacting crowds , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Cara M. Wall-Scheffler,et al.  Size and Shape: Morphology's Impact on Human Speed and Mobility , 2012 .

[28]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1986 .

[29]  Wolfram Burgard,et al.  Teaching mobile robots to cooperatively navigate in populated environments , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[31]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[32]  Jean Oh,et al.  Modeling cooperative navigation in dense human crowds , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Pete Trautman,et al.  Sparse interacting Gaussian processes: Efficiency and optimality theorems of autonomous crowd navigation , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[34]  Dirk Helbing,et al.  Self-Organizing Pedestrian Movement , 2001 .

[35]  C. Richards,et al.  The negotiation of stationary and moving obstructions during walking: anticipatory locomotor adaptations and preservation of personal space. , 2005, Motor control.

[36]  Li Fei-Fei,et al.  Tracking Millions of Humans in Crowded Spaces , 2017, Group and Crowd Behavior for Computer Vision.

[37]  Paolo Fiorini,et al.  Motion Planning in Dynamic Environments Using Velocity Obstacles , 1998, Int. J. Robotics Res..

[38]  Eric Sommerlade,et al.  Modelling pedestrian trajectory patterns with Gaussian processes , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[39]  Mark Reynolds,et al.  SS-LSTM: A Hierarchical LSTM Model for Pedestrian Trajectory Prediction , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[40]  Yoram Koren,et al.  Potential field methods and their inherent limitations for mobile robot navigation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[41]  Martin Buss,et al.  Understanding Human Avoidance Behavior: Interaction-Aware Decision Making Based on Game Theory , 2016, Int. J. Soc. Robotics.

[42]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[43]  Kai Oliver Arras,et al.  People tracking with human motion predictions from social forces , 2010, 2010 IEEE International Conference on Robotics and Automation.

[44]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[45]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  P. Willems,et al.  The energy cost of walking in children , 2000, Pflügers Archiv.

[47]  R. Simmons,et al.  COMPANION: A Constraint-Optimizing Method for Person-Acceptable Navigation , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[48]  Bernt Schiele,et al.  Long-Term On-board Prediction of People in Traffic Scenes Under Uncertainty , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[49]  Dirk Wollherr,et al.  Human-Like Motion Planning Based on Game Theoretic Decision Making , 2018, Int. J. Soc. Robotics.

[50]  Kurt Konolige,et al.  The Office Marathon: Robust navigation in an indoor office environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[51]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[52]  Trung Dung Ngo,et al.  Socially aware robot navigation system in human interactive environments , 2017, Intell. Serv. Robotics.

[53]  R. M. Alexander,et al.  Energetics and optimization of human walking and running: the 2000 Raymond Pearl memorial lecture. , 2002 .

[54]  Shawn M O'Connor,et al.  Fast visual prediction and slow optimization of preferred walking speed. , 2012, Journal of neurophysiology.

[55]  David Lee,et al.  The influence of subjects' personality traits on personal spatial zones in a human-robot interaction experiment , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[56]  Dinesh Manocha,et al.  TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Alberto Del Bimbo,et al.  Context-Aware Trajectory Prediction , 2017, 2018 24th International Conference on Pattern Recognition (ICPR).

[58]  M. Gill,et al.  DNA Variation in the SNAP25 Gene Confers Risk to ADHD and Is Associated with Reduced Expression in Prefrontal Cortex , 2013, PloS one.

[59]  Satoshi Kagami,et al.  A probabilistic model of human motion and navigation intent for mobile robot path planning , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[60]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.