Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation

We consider the problem of navigating a mobile robot through dense human crowds. We begin by exploring a fundamental impediment to classical motion planning algorithms called the “freezing robot problem”: once the environment surpasses a certain level of dynamic complexity, the planner decides that all forward paths are unsafe, and the robot freezes in place (or performs unnecessary maneuvers) to avoid collisions. We argue that this problem can be avoided if the robot anticipates human cooperation, and accordingly we develop interacting Gaussian processes, a prediction density that captures cooperative collision avoidance, and a “multiple goal” extension that models the goal-driven nature of human decision making. We validate this model with an empirical study of robot navigation in dense human crowds (488 runs), specifically testing how cooperation models effect navigation performance. The multiple goal interacting Gaussian processes algorithm performs comparably with human teleoperators in crowd densities nearing 0.8 humans/m2, while a state-of-the-art non-cooperative planner exhibits unsafe behavior more than three times as often as the multiple goal extension, and twice as often as the basic interacting Gaussian process approach. Furthermore, a reactive planner based on the widely used dynamic window approach proves insufficient for crowd densities above 0.55 people/m2. We also show that our non-cooperative planner or our reactive planner capture the salient characteristics of nearly any dynamic navigation algorithm. Based on these experimental results and theoretical observations, we conclude that a cooperation model is critical for safe and efficient robot navigation in dense human crowds.

[1]  Christian Laugier,et al.  Dynamic Obstacle Avoidance in uncertain environment combining PVOs and Occupancy Grid , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[2]  John Maurice Carson,et al.  Robust Model Predictive Control with a Reactive Safety Mode , 2008 .

[3]  Oliver Brock,et al.  High-speed navigation using the global dynamic window approach , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[4]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..

[5]  Joel W. Burdick,et al.  Probabilistic Collision Checking With Chance Constraints , 2011, IEEE Transactions on Robotics.

[6]  Andreas Krause,et al.  Robot navigation in dense human crowds: the case for cooperation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[7]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[8]  Marc Toussaint,et al.  On Stochastic Optimal Control and Reinforcement Learning by Approximate Inference , 2012, Robotics: Science and Systems.

[9]  Yoram Koren,et al.  Potential field methods and their inherent limitations for mobile robot navigation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[11]  L. Blackmore Robust Path Planning and Feedback Design Under Stochastic Uncertainty , 2008 .

[12]  Takayuki Kanda,et al.  Interactive Humanoid Robots for a Science Museum , 2007, IEEE Intell. Syst..

[13]  Kurt Konolige,et al.  The Office Marathon: Robust navigation in an indoor office environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Wendy Ju,et al.  Expressing thought: Improving robot readability with animation principles , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Thomas Bak,et al.  Trajectory planning for robots in dynamic human environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Dieter Fox,et al.  Learning GP-BayesFilters via Gaussian process latent variable models , 2009, Auton. Robots.

[17]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[18]  W. Burgard,et al.  Inferring Navigation Policies for Mobile Robots from Demonstrations , 2013 .

[19]  Paolo Fiorini,et al.  Motion Planning in Dynamic Environments Using Velocity Obstacles , 1998, Int. J. Robotics Res..

[20]  Rachid Alami,et al.  Exploiting human cooperation in human-centered robot navigation , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[21]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[22]  Takayuki Kanda,et al.  Friendly Patrolling: A Model of Natural Encounters , 2011, Robotics: Science and Systems.

[23]  Kai Oliver Arras,et al.  People tracking with human motion predictions from social forces , 2010, 2010 IEEE International Conference on Robotics and Automation.

[24]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[25]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Charles R. Rosenberg,et al.  Interaction With Mobile Robots in Public Places , 2000 .

[27]  Hui X. Li,et al.  A probabilistic approach to optimal robust path planning with obstacles , 2006, 2006 American Control Conference.

[28]  Andreas Krause,et al.  Unfreezing the robot: Navigation in dense, interacting crowds , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[30]  Martin Buss,et al.  Safety assessment of trajectories for navigation in uncertain and dynamic environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[31]  Sebastian Thrun,et al.  Online self-calibration for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[32]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[33]  Dinesh Manocha,et al.  The Hybrid Reciprocal Velocity Obstacle , 2011, IEEE Transactions on Robotics.

[34]  Marc Toussaint,et al.  Robot trajectory optimization using approximate inference , 2009, ICML '09.

[35]  Wolfram Burgard,et al.  Teaching mobile robots to cooperatively navigate in populated environments , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Thierry Fraichard,et al.  A Short Paper about Motion Safety , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[37]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[38]  Takayuki Kanda,et al.  Field trial of networked social robots in a shopping mall , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Christian Laugier,et al.  Probabilistic motion planning among moving obstacles following typical motion patterns , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Andrew P. Sage,et al.  Uncertainty in Artificial Intelligence , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Leila Takayama,et al.  Influences on proxemic behaviors in human-robot interaction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Anind K. Dey,et al.  Navigate like a cabbie: probabilistic reasoning from observed context-aware behavior , 2008, UbiComp.

[43]  Maja J. Mataric,et al.  People-aware navigation for goal-oriented behavior involving a human partner , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[44]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[45]  Candace L. Sidner,et al.  Engagement rules for human-robot collaborative interactions , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[46]  Christophe Andrieu,et al.  Particle methods for change detection, system identification, and control , 2004, Proceedings of the IEEE.

[47]  Hajime Asama,et al.  Inevitable collision states. A step towards safer robots? , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[48]  Joelle Pineau,et al.  Experiences with a mobile robotic guide for the elderly , 2002, AAAI/IAAI.

[49]  Panos E. Trahanias,et al.  Probabilistic Autonomous Robot Navigation in Dynamic Environments with Human Motion Prediction , 2010, Int. J. Soc. Robotics.

[50]  Wolfram Burgard,et al.  Feature-Based Prediction of Trajectories for Socially Compliant Navigation , 2012, Robotics: Science and Systems.

[51]  Christian Vollmer,et al.  Learning to navigate through crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[52]  Maja J. Mataric,et al.  A probabilistic framework for autonomous proxemic control in situated and mobile human-robot interaction , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[54]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.

[55]  N. Roy,et al.  On Stochastic Optimal Control and Reinforcement Learning by Approximate Inference , 2013 .

[56]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[57]  Maja J. Mataric,et al.  Proxemic Feature Recognition for Interactive Robots: Automating Metrics from the Social Sciences , 2011, ICSR.

[58]  Sara B. Kiesler,et al.  The advisor robot: tracing people's mental model from a robot's physical attributes , 2006, HRI '06.

[59]  Jonathan P. How,et al.  Probabilistically safe motion planning to avoid dynamic obstacles with uncertain motion patterns , 2013, Auton. Robots.

[60]  Sebastian Thrun,et al.  Planning under Uncertainty for Reliable Health Care Robotics , 2003, FSR.

[61]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[62]  N. Roy,et al.  Mobile Agent Trajectory Prediction using Bayesian Nonparametric Reachability Trees , 2011 .

[63]  Takayuki Kanda,et al.  An Interaction Design Framework for Social Robots , 2011, Robotics: Science and Systems.

[64]  Maja J. Mataric,et al.  Recognition of spatial dynamics for predicting social interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[65]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[66]  Siddhartha S. Srinivasa,et al.  Planning-based prediction for pedestrians , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  Anne Spalanzani,et al.  Understanding human interaction for probabilistic autonomous navigation using Risk-RRT approach , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[68]  Roland Siegwart,et al.  Robox at Expo.02: A large-scale installation of personal robots , 2003, Robotics Auton. Syst..

[69]  Nicholas Roy,et al.  A Bayesian Nonparametric Approach to Modeling Mobility Patterns , 2010, AAAI.

[70]  Joel W. Burdick,et al.  Robotic motion planning in dynamic, cluttered, uncertain environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[71]  Takayuki Kanda,et al.  Who will be the customer?: a social robot that anticipates people's behavior from their trajectories , 2008, UbiComp.

[72]  Wolfram Burgard,et al.  Coastal navigation-mobile robot navigation with uncertainty in dynamic environments , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[73]  Nicholas Roy,et al.  An Interaction Design Framework for Social Robots , 2012 .

[74]  P. Abbeel,et al.  LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information , 2011 .

[75]  Luc Van Gool,et al.  Wrong turn - No dead end: A stochastic pedestrian motion model , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[76]  Tom Minka,et al.  Expectation Propagation for approximate Bayesian inference , 2001, UAI.

[77]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[78]  G. Swaminathan Robot Motion Planning , 2006 .

[79]  Robin R. Murphy Findings from NSF-JST-NIST Workshop on Rescue Robotics , 2010, 2010 IEEE Safety Security and Rescue Robotics.

[80]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[81]  Jessie Y. C. Chen,et al.  Human-Robot Teams Collaborating Socially, Organizationally, and Culturally , 2011 .

[82]  Takayuki Kanda,et al.  Position prediction in crossing behaviors , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[83]  Tingting Xu,et al.  The Autonomous City Explorer: Towards Natural Human-Robot Interaction in Urban Environments , 2009, Int. J. Soc. Robotics.

[84]  Joelle Pineau,et al.  Towards robotic assistants in nursing homes: Challenges and results , 2003, Robotics Auton. Syst..

[85]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[86]  Wolfram Burgard,et al.  Robotics: Science and Systems XV , 2010 .

[87]  E. Hall,et al.  The Hidden Dimension , 1970 .

[88]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[89]  Jonathan P. How,et al.  Sampling-Based Threat Assessment Algorithms for Intersection Collisions Involving Errant Drivers , 2010 .

[90]  Dinesh Manocha,et al.  Reciprocal n-Body Collision Avoidance , 2011, ISRR.

[91]  Michael A. Goodrich,et al.  On using mixed-initiative control: A perspective for managing large-scale robotic teams , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[92]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[93]  Ninad Pradhan,et al.  Robot crowd navigation using predictive position fields in the potential function framework , 2011, Proceedings of the 2011 American Control Conference.

[94]  Sebastian Thrun,et al.  Robots With Humanoid Features in Public Places: A Case Study , 2000, IEEE Intell. Syst..

[95]  Stephen Cameron,et al.  3-D Path Planning and Target Trajectory Prediction for the Oxford Aerial Tracking System , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[96]  Masahiro Fujita,et al.  An ethological and emotional basis for human-robot interaction , 2003, Robotics Auton. Syst..

[97]  Han-Pang Huang,et al.  Robot Motion Planning in Dynamic Uncertain Environments , 2011, Adv. Robotics.

[98]  Max Donath,et al.  American Control Conference , 1993 .

[99]  Satoshi Kagami,et al.  A probabilistic model of human motion and navigation intent for mobile robot path planning , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[100]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[101]  J. W. Nieuwenhuis,et al.  Boekbespreking van D.P. Bertsekas (ed.), Dynamic programming and optimal control - volume 2 , 1999 .

[102]  Emin Orhan Dirichlet Processes , 2012 .

[103]  M. Matarić,et al.  Benchmarks for evaluating socially assistive robotics , 2007 .

[104]  Siddhartha S. Srinivasa,et al.  The robotic busboy: Steps towards developing a mobile robotic home assistant , 2008 .

[105]  Takayuki Kanda,et al.  How do people walk side-by-side? — Using a computational model of human behavior for a social robot , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[106]  Li-Chen Fu,et al.  Human-Centered Robot Navigation—Towards a Harmoniously Human–Robot Coexisting Environment , 2011, IEEE Transactions on Robotics.

[107]  Dieter Fox,et al.  GP-BayesFilters: Bayesian filtering using Gaussian process prediction and observation models , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[108]  Shawn Michael Herman,et al.  A Particle Filtering Approach to Joint Passive Radar Tracking and Target Classification , 2002 .

[109]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[110]  Albert S. Huang,et al.  A Bayesian nonparametric approach to modeling motion patterns , 2011, Auton. Robots.

[111]  Thierry Fraichard,et al.  Inevitable Collision States: A probabilistic perspective , 2010, 2010 IEEE International Conference on Robotics and Automation.

[112]  Christian Laugier,et al.  Probabilistic navigation in dynamic environment using Rapidly-exploring Random Trees and Gaussian processes , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[113]  David K. Smith,et al.  Dynamic Programming and Optimal Control. Volume 1 , 1996 .

[114]  Sebastian Thrun,et al.  Spontaneous, short-term interaction with mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[115]  Nicholas Roy,et al.  Feature-Based Prediction of Trajectories for Socially Compliant Navigation , 2013 .

[116]  Hanqing Lu,et al.  Visual Tracking Using Particle Filters with Gaussian Process Regression , 2009, PSIVT.

[117]  Martin Buss,et al.  Safety assessment of robot trajectories for navigation in uncertain and dynamic environments , 2011, Autonomous Robots.

[118]  Kevin Waugh,et al.  Computational Rationalization: The Inverse Equilibrium Problem , 2011, ICML.

[119]  F. Large,et al.  Avoiding cars and pedestrians using velocity obstacles and motion prediction , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[120]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[121]  L. Blackmore,et al.  Optimal, Robust Predictive Control of Nonlinear Systems under Probabilistic Uncertainty using Particles , 2007, 2007 American Control Conference.

[122]  Rachid Alami,et al.  Dynamic generation and execution of human aware navigation plans , 2010, AAMAS.

[123]  Wolfram Burgard,et al.  The Interactive Museum Tour-Guide Robot , 1998, AAAI/IAAI.

[124]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[125]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[126]  Dirk Helbing,et al.  Self-Organizing Pedestrian Movement , 2001 .

[127]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.