Robust sampling-based motion planning for autonomous vehicles in uncertain environments

While navigating, autonomous vehicles often must overcome significant uncertainty in their understanding of the world around them. Real-world environments may be cluttered and highly dynamic, with uncertainty in both the current state and future evolution of environmental constraints. The vehicle may also face uncertainty in its own motion. To provide safe navigation under such conditions, motion planning algorithms must be able to rapidly generate smooth, certifiably robust trajectories in real-time. The primary contribution of this thesis is the development of a real-time motion planning framework capable of generating feasible paths for autonomous vehicles in complex environments, with robustness guarantees under both internal and external uncertainty. By leveraging the trajectory-wise constraint checking of sampling-based algorithms, and in particular rapidly-exploring random trees (RRT), the proposed algorithms can efficiently evaluate and enforce complex robustness conditions. For linear systems under bounded uncertainty, a sampling-based motion planner is presented which iteratively tightens constraints in order to guarantee safety for all feasible uncertainty realizations. The proposed bounded-uncertainty RRT* (BURRT*) algorithm scales favorably with environment complexity. Additionally, by building upon RRT*, BU-RRT* is shown to be asymptotically optimal, enabling it to efficiently generate and optimize robust, dynamically feasible trajectories. For large and/or unbounded uncertainties, probabilistically feasible planning is provided through the proposed chance-constrained RRT (CC-RRT) algorithm. Paths generated by CC-RRT are guaranteed probabilistically feasible for linear systems under Gaussian uncertainty, with extensions considered for nonlinear dynamics, output models, and/or non-Gaussian uncertainty. Probabilistic constraint satisfaction is represented in terms of chance constraints, extending existing approaches by considering both internal and external uncertainty, subject to time-step-wise and path-wise feasibility constraints. An explicit bound on the total risk of constraint violation is developed which can be efficiently evaluated online for each trajectory. The proposed CC-RRT* algorithm extends this approach to provide asymptotic optimality guarantees; an admissible risk-based objective uses the risk bounds to incentivize risk-averse trajectories. Applications of this framework are shown for several motion planning domains, including parafoil terminal guidance and urban navigation, where the system is subject to challenging environmental and uncertainty characterizations. Hardware results demonstrate a mobile robot utilizing this framework to safely avoid dynamic obstacles.

[1]  B. Bethke,et al.  Real-time indoor autonomous vehicle test environment , 2008, IEEE Control Systems.

[2]  Anthony Stentz,et al.  The Focussed D* Algorithm for Real-Time Replanning , 1995, IJCAI.

[3]  Emilio Frazzoli,et al.  A martingale approach and time-consistent sampling-based algorithms for risk management in stochastic optimal control , 2013, 53rd IEEE Conference on Decision and Control.

[4]  Hui X. Li,et al.  A probabilistic approach to optimal robust path planning with obstacles , 2006, 2006 American Control Conference.

[5]  Leonidas J. Guibas,et al.  Bounded Uncertainty Roadmaps for Path Planning , 2008, WAFR.

[6]  Jonathan P. How,et al.  Probabilistically safe motion planning to avoid dynamic obstacles with uncertain motion patterns , 2013, Auton. Robots.

[7]  S. Patil,et al.  Estimating Probability of Collision for Safe Planning under Gaussian Motion and Sensing Uncertainty , 2012 .

[8]  Jonathan P. How,et al.  An optimizing sampling-based motion planner with guaranteed robustness to bounded uncertainty , 2014, 2014 American Control Conference.

[9]  L. Blackmore,et al.  Convex Chance Constrained Predictive Control without Sampling , 2009 .

[10]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[11]  D. Mayne,et al.  Min-max feedback model predictive control for constrained linear systems , 1998, IEEE Trans. Autom. Control..

[12]  Mark H. Overmars,et al.  Creating robust roadmaps for motion planning in changing environments , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  David Q. Mayne,et al.  Robust model predictive control of constrained linear systems with bounded disturbances , 2005, Autom..

[14]  Emilio Frazzoli,et al.  Bounds on tracking error using closed-loop rapidly-exploring random trees , 2010, Proceedings of the 2010 American Control Conference.

[15]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[16]  Luigi Chisci,et al.  Systems with persistent disturbances: predictive control with restricted constraints , 2001, Autom..

[17]  Thierry Siméon,et al.  The Stochastic Motion Roadmap: A Sampling Framework for Planning with Markov Motion Uncertainty , 2007, Robotics: Science and Systems.

[18]  Yoshiaki Kuwata,et al.  Trajectory planning for unmanned vehicles using robust receding horizon control , 2007 .

[19]  L. Blackmore Robust Path Planning and Feedback Design Under Stochastic Uncertainty , 2008 .

[20]  Anthony Stentz,et al.  Field D*: An Interpolation-Based Path Planner and Replanner , 2005, ISRR.

[21]  Bruce Randall Donald,et al.  Kinodynamic motion planning , 1993, JACM.

[22]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[23]  Nicholas Roy,et al.  Rapidly-exploring Random Belief Trees for motion planning under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Nicholas Roy,et al.  Planning in information space for a quadrotor helicopter in a GPS-denied environment , 2008, 2008 IEEE International Conference on Robotics and Automation.

[25]  Marco Pavone,et al.  Fast Marching Trees: A Fast Marching Sampling-Based Method for Optimal Motion Planning in Many Dimensions , 2013, ISRR.

[26]  Nicholas Roy,et al.  The Belief Roadmap: Efficient Planning in Linear POMDPs by Factoring the Covariance , 2007, ISRR.

[27]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[28]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[29]  Jonathan P. How,et al.  Probabilistic Feasibility for Nonlinear Systems with Non-Gaussian Uncertainty using RRT , 2011 .

[30]  Nancy M. Amato,et al.  FIRM: Sampling-based feedback motion-planning under motion uncertainty and imperfect measurements , 2014, Int. J. Robotics Res..

[31]  Emilio Frazzoli,et al.  Incremental Sampling-Based Algorithms for a Class of Pursuit-Evasion Games , 2010, WAFR.

[32]  Ian Sugel,et al.  Robust planning for autonomous parafoil , 2013 .

[33]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[34]  Jun Yan,et al.  Incorporating state estimation into model predictive control and its application to network traffic control , 2005, Autom..

[35]  Leslie Pack Kaelbling,et al.  LQR-RRT*: Optimal sampling-based motion planning with automatically derived extension heuristics , 2012, 2012 IEEE International Conference on Robotics and Automation.

[36]  Matthias Althoff,et al.  Probabilistic collision state checker for crowded environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[37]  Alberto Bemporad,et al.  Robust model predictive control: A survey , 1998, Robustness in Identification and Control.

[38]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[39]  J. Löfberg Minimax approaches to robust model predictive control , 2003 .

[40]  Joel W. Burdick,et al.  Robotic motion planning in dynamic, cluttered, uncertain environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[41]  J. How,et al.  Chance Constrained RRT for Probabilistic Robustness to Environmental Uncertainty , 2010 .

[42]  Jonathan P. How,et al.  Robust Trajectory Planning for Autonomous Parafoils under Wind Uncertainty , 2013 .

[43]  Jur P. van den Berg,et al.  Kinodynamic RRT*: Asymptotically optimal motion planning for robots with linear dynamics , 2013, 2013 IEEE International Conference on Robotics and Automation.

[44]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[45]  M Ono,et al.  Chance constrained finite horizon optimal control with nonconvex constraints , 2010, Proceedings of the 2010 American Control Conference.

[46]  Arthur G. Richards,et al.  Robust stable model predictive control with constraint tightening , 2006, 2006 American Control Conference.

[47]  Albert S. Huang,et al.  A Bayesian nonparametric approach to modeling motion patterns , 2011, Auton. Robots.

[48]  Thierry Fraichard,et al.  Inevitable Collision States: A probabilistic perspective , 2010, 2010 IEEE International Conference on Robotics and Automation.

[49]  Wolfram Burgard,et al.  Principles of Robot Motion: Theory, Algorithms, and Implementation ERRATA!!!! 1 , 2007 .

[50]  E. Feron,et al.  Real-time motion planning for agile autonomous vehicles , 2000, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[51]  Luke Fletcher,et al.  A Situationally Aware Voice‐commandable Robotic Forklift Working Alongside People in Unstructured Outdoor Environments , 2015, J. Field Robotics.

[52]  Emilio Frazzoli,et al.  Anytime computation of time-optimal off-road vehicle maneuvers using the RRT* , 2011, IEEE Conference on Decision and Control and European Control Conference.

[53]  Marco Pavone,et al.  Stochastic optimal control with dynamic, time-consistent risk constraints , 2013, 2013 American Control Conference.

[54]  L. Blackmore A Probabilistic Particle Control Approach to Optimal, Robust Predictive Control , 2006 .

[55]  Jonathan P. How,et al.  Performance and Lyapunov Stability of a Nonlinear Path Following Guidance Method , 2007 .

[56]  M. P. Vitus,et al.  A hybrid method for chance constrained control in uncertain environments , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[57]  Jonathan P. How,et al.  Motion Planning in Complex Environments using Closed-loop Prediction , 2008 .

[58]  Jonathan P. How,et al.  Aircraft trajectory planning with collision avoidance using mixed integer linear programming , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[59]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[60]  Eric C. Kerrigan,et al.  Optimization over state feedback policies for robust control with constraints , 2006, Autom..

[61]  Emilio Frazzoli,et al.  Improving the Performance of Sampling-Based Motion Planning With Symmetry-Based Gap Reduction , 2008, IEEE Transactions on Robotics.

[62]  Rajeev Sharma,et al.  On Motion Planning in Changing, Partially Predictable Environments , 1997, Int. J. Robotics Res..

[63]  P. Abbeel,et al.  LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information , 2011 .

[64]  R. P. Epy,et al.  RELIABLE ROBUST PATH PLANNING , 2010 .

[65]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[66]  Christian Laugier,et al.  Probabilistic navigation in dynamic environment using Rapidly-exploring Random Trees and Gaussian processes , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  Emilio Frazzoli,et al.  Probabilistically-sound and asymptotically-optimal algorithm for stochastic control with trajectory constraints , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[68]  Jonathan P. How,et al.  Real-Time Motion Planning With Applications to Autonomous Urban Driving , 2009, IEEE Transactions on Control Systems Technology.

[69]  Emilio Frazzoli,et al.  Anytime Motion Planning using the RRT* , 2011, 2011 IEEE International Conference on Robotics and Automation.

[70]  Nicholas Roy,et al.  Adapting probabilistic roadmaps to handle uncertain maps , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[71]  Emilio Frazzoli,et al.  Sampling-based optimal motion planning for non-holonomic dynamical systems , 2013, 2013 IEEE International Conference on Robotics and Automation.

[72]  Nancy M. Amato,et al.  FIRM: Feedback controller-based information-state roadmap - A framework for motion planning under uncertainty , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  Reid G. Simmons,et al.  Particle RRT for Path Planning with Uncertainty , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[74]  Sebastian Thrun,et al.  ARA*: Anytime A* with Provable Bounds on Sub-Optimality , 2003, NIPS.

[75]  Jonathan P. How,et al.  Real-Time Predictive Modeling and Robust Avoidance of Pedestrians with Uncertain, Changing Intentions , 2014, WAFR.

[76]  Jean-Claude Latombe,et al.  Numerical potential field techniques for robot path planning , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[77]  Pu Li,et al.  A probabilistically constrained model predictive controller , 2002, Autom..

[78]  Luke Fletcher,et al.  A perception-driven autonomous urban vehicle , 2008 .

[79]  Masahiro Ono,et al.  Iterative Risk Allocation: A new approach to robust Model Predictive Control with a joint chance constraint , 2008, 2008 47th IEEE Conference on Decision and Control.

[80]  Hajime Asama,et al.  Inevitable collision states. A step towards safer robots? , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[81]  Emilio Frazzoli,et al.  An incremental sampling-based algorithm for stochastic optimal control , 2012, 2012 IEEE International Conference on Robotics and Automation.

[82]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[83]  Aachen,et al.  Stochastic Inequality Constrained Closed-loop Model Predictive Control: With Application To Chemical Process Operation , 2004 .

[84]  Jonathan P. How,et al.  Robust Sampling-based Motion Planning with Asymptotic Optimality Guarantees , 2013 .

[85]  Paolo Fiorini,et al.  Motion Planning in Dynamic Environments Using Velocity Obstacles , 1998, Int. J. Robotics Res..

[86]  Claire J. Tomlin,et al.  On feedback design and risk allocation in chance constrained control , 2011, IEEE Conference on Decision and Control and European Control Conference.

[87]  Oliver Brock,et al.  Sampling-Based Motion Planning With Sensing Uncertainty , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[88]  Jonathan P. How,et al.  Information-Theoretic Motion Planning for Constrained Sensor Networks , 2013, J. Aerosp. Inf. Syst..

[89]  Sven Koenig,et al.  Fast replanning for navigation in unknown terrain , 2005, IEEE Transactions on Robotics.

[90]  Russ Tedrake,et al.  LQR-trees: Feedback motion planning on sparse randomized trees , 2009, Robotics: Science and Systems.

[91]  Nancy M. Amato,et al.  Robust online belief space planning in changing environments: Application to physical mobile robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[92]  Ian Postlethwaite,et al.  Multi-agent motion planning for nonlinear Gaussian systems , 2013, Int. J. Control.

[93]  N. Roy,et al.  Probabilistically Safe Avoidance of Dynamic Obstacles with Uncertain Motion Patterns , 2011 .

[94]  Ron Alterovitz,et al.  Rapidly-exploring roadmaps: Weighing exploration vs. refinement in optimal motion planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[95]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[96]  David W. Carter,et al.  Band-Limited Guidance and Control of Large Parafoils , 2009 .

[97]  N. Roy,et al.  The Belief Roadmap: Efficient Planning in Belief Space by Factoring the Covariance , 2009, Int. J. Robotics Res..

[98]  Karl Iagnemma,et al.  Stochastic mobility-based path planning in uncertain environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[99]  Emilio Frazzoli,et al.  Optimal motion planning with the half-car dynamical model for autonomous high-speed driving , 2013, 2013 American Control Conference.

[100]  B. Moor,et al.  Mixed integer programming for multi-vehicle path planning , 2001, 2001 European Control Conference (ECC).

[101]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[102]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[103]  L. Shepp,et al.  OPTIMAL PATHS FOR A CAR THAT GOES BOTH FORWARDS AND BACKWARDS , 1990 .

[104]  Tara N. Sainath,et al.  A voice-commandable robotic forklift working alongside humans in minimally-prepared outdoor environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[105]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[106]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[107]  Masahiro Ono,et al.  Paper Summary: Probabilistic Planning for Continuous Dynamic Systems under Bounded Risk , 2013, ICAPS.

[108]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[109]  Ron Alterovitz,et al.  Motion planning under uncertainty using iterative local optimization in belief space , 2012, Int. J. Robotics Res..

[110]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[111]  Eric C. Kerrigan,et al.  Input-to-state stability of robust receding horizon control with an expected value cost , 2008, Autom..

[112]  Emilio Frazzoli,et al.  Incremental Sampling-based Algorithms for Optimal Motion Planning , 2010, Robotics: Science and Systems.