Robot Motion Planning in Dynamic, Uncertain Environments

This paper presents a strategy for planning robot motions in dynamic, uncertain environments (DUEs). Successful and efficient robot operation in such environments requires reasoning about the future evolution and uncertainties of the states of the moving agents and obstacles. A novel procedure to account for future information gathering (and the quality of that information) in the planning process is presented. To approximately solve the stochastic dynamic programming problem that is associated with DUE planning, we present a partially closed-loop receding horizon control algorithm whose solution integrates prediction, estimation, and planning while also accounting for chance constraints that arise from the uncertain locations of the robot and obstacles. Simulation results in simple static and dynamic scenarios illustrate the benefit of the algorithm over classical approaches. The approach is also applied to more complicated scenarios, including agents with complex, multimodal behaviors, basic robot-agent interaction, and agent information gathering.

[1]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[2]  Thierry Siméon,et al.  The Stochastic Motion Roadmap: A Sampling Framework for Planning with Markov Motion Uncertainty , 2007, Robotics: Science and Systems.

[3]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[4]  L. Blackmore.  Robust Path Planning and Feedback Design Under Stochastic Uncertainty , 2008 .

[5]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[6]  Satoshi Kagami,et al.  A probabilistic model of human motion and navigation intent for mobile robot path planning , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Paolo Fiorini,et al.  Motion Planning in Dynamic Environments Using Velocity Obstacles , 1998, Int. J. Robotics Res..

[9]  Nicholas Roy,et al.  Efficient planning under uncertainty for a target-tracking micro-aerial vehicle , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Rachid Alami,et al.  A decisional framework for autonomous robots interacting with humans , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[11]  Matthias Althoff,et al.  Probabilistic collision state checker for crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Qiuming Zhu,et al.  Hidden Markov model for dynamic obstacle avoidance of mobile robot navigation , 1991, IEEE Trans. Robotics Autom..

[13]  Christian Vollmer,et al.  Learning to navigate through crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Joel W. Burdick,et al.  Robotic motion planning in dynamic, cluttered, uncertain environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Giuseppe Oriolo,et al.  A Bayesian framework for optimal motion planning with uncertainty , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  Stephen Cameron,et al.  3-D Path Planning and Target Trajectory Prediction for the Oxford Aerial Tracking System , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Joel W. Burdick,et al.  Probabilistic Collision Checking With Chance Constraints , 2011, IEEE Transactions on Robotics.

[18]  Hajime Asama,et al.  Inevitable collision states — a step towards safer robots? , 2004, Adv. Robotics.

[19]  Alain Lambert,et al.  Safe Path Planning in an Uncertain-Configuration Space using RRT , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[21]  O.H. Bosgra,et al.  Closed-loop stochastic model predictive control in a receding horizon implementation on a continuous polymerization reactor example , 2004, Proceedings of the 2004 American Control Conference.

[22]  Jun Yan,et al.  Incorporating state estimation into model predictive control and its application to network traffic control , 2005, Autom..

[23]  Christian Laugier,et al.  Dynamic Obstacle Avoidance in uncertain environment combining PVOs and Occupancy Grid , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[24]  Andrew Kurdila,et al.  A receding horizon controller for motion planning in the presence of moving obstacles , 2010, 2010 IEEE International Conference on Robotics and Automation.

[25]  John Maurice Carson,et al.  Robust Model Predictive Control with a Reactive Safety Mode , 2008 .

[26]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[27]  F. Large,et al.  Avoiding cars and pedestrians using velocity obstacles and motion prediction , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[28]  Anthony Stentz,et al.  Planning with Uncertainty in Position Using High-Resolution Maps , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[29]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[30]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[31]  Panos E. Trahanias,et al.  Predictive control of robot velocity to avoid obstacles in dynamic environments , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[32]  Michael Nikolaou,et al.  Chance‐constrained model predictive control , 1999 .

[33]  Masaki Hayashi,et al.  On motion planning of mobile robots which coexist and cooperate with human , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[34]  Erwin Prassler,et al.  Reflective navigation: individual behaviors and group behaviors , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[35]  Yoshiaki Kuwata,et al.  Robust Constrained Receding Horizon Control for Trajectory Planning , 2005 .

[36]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[37]  Dominique Gruyer,et al.  Safe path planning in an uncertain-configuration space , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[38]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[39]  Sebastian Thrun,et al.  Planning under Uncertainty for Reliable Health Care Robotics , 2003, FSR.

[40]  O. Bosgra,et al.  A full solution to the constrained stochastic closed-loop MPC problem via state and innovations feedback and its receding horizon implementation , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[41]  Dinesh Manocha,et al.  Reciprocal Velocity Obstacles for real-time multi-agent navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[42]  N. Roy,et al.  The Belief Roadmap: Efficient Planning in Belief Space by Factoring the Covariance , 2009, Int. J. Robotics Res..

[43]  Peilin Fu,et al.  Variance minimization approach for a class of dual control problems , 2002, IEEE Trans. Autom. Control..

[44]  Thierry Fraichard,et al.  Inevitable Collision States: A probabilistic perspective , 2010, 2010 IEEE International Conference on Robotics and Automation.