Robot Navigation Based on Human Trajectory Prediction and Multiple Travel Modes

For a mobile robot, navigation skills that are safe, efficient, and socially compliant in crowded, dynamic environments are essential. This is a particularly challenging problem as it requires the robot to accurately predict pedestrians’ movements, analyse developing traffic situations, and plan its own path or trajectory accordingly. Previous approaches still exhibit low accuracy for pedestrian trajectory prediction, and they are prone to generate infeasible trajectories under complex crowded conditions. In this paper, we develop an improved socially conscious model to learn and predict a pedestrian’s future trajectory. To generate more efficient and safer trajectories in a changing crowed space, an online path planning algorithm considering pedestrians’ predicted movements and the feasibility of the candidate trajectories is proposed. Then, multiple traffic states are defined to guide the robot finding the optimal navigation strategies under changing traffic situations in a crowded area. We have demonstrated the performance of our approach outperforms state-of-the-art approaches with public datasets, in low-density and simulated medium-density crowded scenarios.

[1]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[2]  Timm Linder,et al.  People Detection, Tracking and Visualization Using ROS on a Mobile Service Robot , 2016 .

[3]  Torsten Bertram,et al.  Trajectory modification considering dynamic constraints of autonomous robots , 2012, ROBOTIK.

[4]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[5]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Dinesh Manocha,et al.  SocioSense: Robot navigation amongst pedestrians with social and psychological constraints , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Ying Hu,et al.  Human trajectory prediction for automatic guided vehicle with recurrent neural network , 2018, The Journal of Engineering.

[8]  Min Cheol Lee,et al.  Artificial potential field based path planning for mobile robots using a virtual obstacle concept , 2003, Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003).

[9]  Thierry Siméon,et al.  Path Deformation Roadmaps: Compact Graphs with Useful Cycles for Motion Planning , 2008, Int. J. Robotics Res..

[10]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[12]  Chang Liu,et al.  Parallel Interacting Multiple Model-Based Human Motion Prediction for Motion Planning of Companion Robots , 2015, IEEE Transactions on Automation Science and Engineering.

[13]  Tarek M. Sobh,et al.  UB SWARM: HARDWARE IMPLEMENTATION OF HETEROGENEOUS SWARM ROBOT WITH FAULT DETECTION AND POWER MANAGEMENT , 2016 .

[14]  Yoshua Bengio,et al.  Equilibrated adaptive learning rates for non-convex optimization , 2015, NIPS.

[15]  David Hsu,et al.  Intention-aware online POMDP planning for autonomous driving in a crowd , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  David González,et al.  A Review of Motion Planning Techniques for Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.

[17]  Wentong Cai,et al.  Learning behavior patterns from video for agent-based crowd modeling and simulation , 2016, Autonomous Agents and Multi-Agent Systems.

[18]  Torsten Bertram,et al.  Integrated online trajectory planning and optimization in distinctive topologies , 2017, Robotics Auton. Syst..

[19]  Jean Oh,et al.  Modeling cooperative navigation in dense human crowds , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[20]  David Hsu,et al.  DESPOT: Online POMDP Planning with Regularization , 2013, NIPS.

[21]  Rainer Stiefelhagen,et al.  A Controlled Interactive Multiple Model Filter for Combined Pedestrian Intention Recognition and Path Prediction , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[22]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[23]  Jean Oh,et al.  Social Attention: Modeling Attention in Human Crowds , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Reinhard Klette,et al.  Tracking of 2D or 3D Irregular Movement by a Family of Unscented Kalman Filters , 2012, J. Inform. and Commun. Convergence Engineering.

[25]  Torsten Bertram,et al.  Online trajectory prediction and planning for social robot navigation , 2017, 2017 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[26]  Sarosh H. Patel,et al.  UB robot swarm — Design, implementation, and power management , 2016, 2016 12th IEEE International Conference on Control and Automation (ICCA).

[27]  Torsten Bertram,et al.  Kinodynamic trajectory optimization and control for car-like robots , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[28]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[29]  Yukinori Kobayashi,et al.  Path Smoothing Techniques in Robot Navigation: State-of-the-Art, Current and Future Challenges , 2018, Sensors.

[30]  C. G. Keller,et al.  Will the Pedestrian Cross? A Study on Pedestrian Path Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[31]  Dani Lischinski,et al.  Crowds by Example , 2007, Comput. Graph. Forum.