HI Robot: Human intention-aware robot planning for safe and efficient navigation in crowds

We present an algorithmic framework for the early classification of human intentions, and use it to accurately predict future human motions when planning the path of a robot in an environment that is shared with humans. During an off-line learning phase, a classifier that can recognize when a human intends to interact with the robot is trained. At runtime, this trained classifier allows us to recognize humans who intend to interact with, or obstruct, the robot in some way. We validate our approach using both recorded and simulated data in an environment in which some humans intentionally obstruct the robot. Our classifier identifies these potential blockers, thus allowing the robot to safely and efficiently navigate the environment by minimizing the chances of being blocked.

[1]  Craig W. Reynolds.  Steering Behaviors For Autonomous Characters , 1999 .

[2]  David Lee,et al.  Close encounters: spatial distances between people and a robot of mechanistic appearance , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[3]  Dmitry Berenson,et al.  Human-robot collaborative manipulation planning using early prediction of human motion , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Dinesh Manocha,et al.  BRVO: Predicting pedestrian trajectories using velocity-space reasoning , 2015, Int. J. Robotics Res..

[5]  Yang Wang,et al.  Recognizing human actions from still images with latent poses , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Joel W. Burdick,et al.  Robot Motion Planning in Dynamic, Uncertain Environments , 2012, IEEE Transactions on Robotics.

[7]  Christian Laugier,et al.  Dynamic Obstacle Avoidance in uncertain environment combining PVOs and Occupancy Grid , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Songhwai Oh,et al.  Real-time navigation in crowded dynamic environments using Gaussian process motion control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Dinesh Manocha,et al.  Interactive navigation of multiple agents in crowded environments , 2008, I3D '08.

[11]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[12]  Hema Swetha Koppula,et al.  Anticipating Human Activities Using Object Affordances for Reactive Robotic Response , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Mohamed Chetouani,et al.  Potential human reaction aware mobile robot motion planner: Potential cost minimization framework , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[14]  David Duvenaud,et al.  Automatic model construction with Gaussian processes , 2014 .

[15]  Thomas Bak,et al.  Adaptive human aware navigation based on motion pattern analysis , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[16]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[17]  Han-Pang Huang,et al.  A mobile robot that understands pedestrian spatial behaviors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Han-Pang Huang,et al.  Robot Motion Planning in Dynamic Uncertain Environments , 2011, Adv. Robotics.

[19]  Bart Selman,et al.  Unstructured human activity detection from RGBD images , 2011, 2012 IEEE International Conference on Robotics and Automation.

[20]  Aaron F. Bobick,et al.  Probabilistic human action prediction and wait-sensitive planning for responsive human-robot collaboration , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[21]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[22]  Andreas Krause,et al.  Unfreezing the robot: Navigation in dense, interacting crowds , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[24]  P. Molnár.  Social Force Model for Pedestrian Dynamics Typeset Using Revt E X 1 , 1995 .

[25]  E. Hall,et al.  The Hidden Dimension , 1970 .

[26]  Takayuki Kanda,et al.  Escaping from Children’s Abuse of Social Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Carlos Martínez,et al.  Human-robot collaboration in manufacturing: Quantitative evaluation of predictable, convergent joint action , 2013, IEEE ISR 2013.

[28]  Dinesh Manocha,et al.  Simulating heterogeneous crowd behaviors using personality trait theory , 2011, SCA '11.

[29]  Wolfram Burgard,et al.  Feature-Based Prediction of Trajectories for Socially Compliant Navigation , 2012, Robotics: Science and Systems.