Predicting human navigation goals based on Bayesian inference and activity regions

Abstract Anticipation of human movements is of great importance for service robots, as it is necessary to avoid interferences and predict areas where human–robot collaboration may be needed. In indoor scenarios, human movements often depend on objects with which they interacted before. For example, if a human interacts with a cup the probability that a table or coffee machine might be the next navigation goal is high. Typically, objects are grouped together in regions depending on the related activities so that environments consist of a set of activity regions. For example, a workspace region may contain a PC, a chair, and a table with many smaller objects on top of it. In this article, we present an approach to predict the navigation goal of a moving human in indoor environments. We hereby combine prior knowledge about typical human transitions between activity regions with robot observations about the human’s current pose and the last object interaction to predict the navigation goal using Bayesian inference. In the experimental evaluation in several simulated environments we demonstrate that our approach leads to a significantly more accurate prediction of the navigation goal in comparison to previous work. Furthermore, we show in a real-world experiment how such human motion anticipation can be used to realize foresighted navigation with an assistance robot, i.e. how predicted human movements can be used to increase the time efficiency of the robot’s navigation policy by early anticipating the user’s navigation goal and moving towards it.

[1]  Nils Bore,et al.  Human-centric partitioning of the environment , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[2]  Dariu M. Gavrila,et al.  Human motion trajectory prediction: a survey , 2019, Int. J. Robotics Res..

[3]  Reinhard Klein,et al.  Where Can I Help? Human-Aware Placement of Service Robots , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[4]  Hannes Sommer,et al.  A Data-driven Model for Interaction-Aware Pedestrian Motion Prediction in Object Cluttered Environments , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[6]  Anthony G. Cohn,et al.  Unsupervised Human Activity Analysis for Intelligent Mobile Robot , 2018, KI - Künstliche Intelligenz.

[7]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[8]  Robert Fitch,et al.  Bayesian intention inference for trajectory prediction with an unknown goal destination , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[10]  Sebastian Thrun,et al.  Learning user models of mobility-related activities through instrumented walking aids , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[11]  Dinesh Manocha,et al.  Predicting Pedestrian Trajectories Using Velocity-Space Reasoning , 2012, WAFR.

[12]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[13]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots , 2004 .

[14]  Ville Kyrki,et al.  Hypermap Mapping Framework and its Application to Autonomous Semantic Exploration , 2020, 2020 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[15]  Sven Behnke,et al.  Bonn Activity Maps: Dataset Description , 2019, ArXiv.

[16]  Wolfram Burgard,et al.  Socially compliant mobile robot navigation via inverse reinforcement learning , 2016, Int. J. Robotics Res..

[17]  Maren Bennewitz,et al.  Speeding up person finding using hidden Markov models , 2019, Robotics Auton. Syst..

[18]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Silvio Savarese,et al.  Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes , 2016, ECCV.

[20]  Gonzalo Ferrer,et al.  Robot social-aware navigation framework to accompany people walking side-by-side , 2016, Autonomous Robots.

[21]  Hema Swetha Koppula,et al.  Learning human activities and object affordances from RGB-D videos , 2012, Int. J. Robotics Res..