Optimal Stochastic Vehicle Path Planning Using Covariance Steering

This letter addresses the problem of vehicle path planning in the presence of obstacles and uncertainties, a fundamental robotics problem. While several path planning algorithms have been proposed over the years, many of them have dealt with only deterministic environments or with only open-loop uncertainty, i.e., the uncertainty of the system state is not controlled and, typically, increases with time because of exogenous disturbances. This may lead to potentially conservative nominal paths. The typical approach to deal with disturbances and reduce uncertainty is to use a lower level feedback controller. We advocate the premise that, if a path planner can consider the closed-loop evolution of the system uncertainty, it can lead to less conservative, but still feasible, paths. To this end, in this letter, we develop an approach that is based on optimal covariance steering, which explicitly steers the state covariance for stochastic linear systems. We verify the proposed framework using extensive numerical simulations.

[1]  A. Mesbah,et al.  Stochastic Model Predictive Control: An Overview and Perspectives for Future Research , 2016, IEEE Control Systems.

[2]  A. Davari,et al.  Differential flatness-based trajectory planning for multiple unmanned aerial vehicles using mixed-integer linear programming , 2005, Proceedings of the 2005, American Control Conference, 2005..

[3]  Robin Deits,et al.  Efficient mixed-integer planning for UAVs in cluttered environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Steven Lake Waslander,et al.  Locally optimal decomposition for autonomous obstacle avoidance with the Tunnel-MILP algorithm , 2008, 2008 47th IEEE Conference on Decision and Control.

[5]  Jonathan P. How,et al.  Real-Time Motion Planning With Applications to Autonomous Urban Driving , 2009, IEEE Transactions on Control Systems Technology.

[6]  Robert E. Skelton,et al.  An improved covariance assignment theory for discrete systems , 1992 .

[7]  Efstathios Bakolas,et al.  Finite-horizon covariance control for discrete-time stochastic linear systems subject to input constraints , 2018, Autom..

[8]  Marcello Farina,et al.  Stochastic linear Model Predictive Control with chance constraints – A review , 2016 .

[9]  András Prékopa,et al.  Boole-Bonferroni Inequalities and Linear Programming , 1988, Oper. Res..

[10]  Panagiotis Tsiotras,et al.  Uncertainty Quantication and Control During Mars Powered Descent and Landing using Covariance Steering , 2018 .

[11]  Robin Deits,et al.  Computing Large Convex Regions of Obstacle-Free Space Through Semidefinite Programming , 2014, WAFR.

[12]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[13]  Panagiotis Tsiotras,et al.  Use of relaxation methods in sampling-based algorithms for optimal motion planning , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Kazuhide Okamoto,et al.  Optimal Covariance Control for Stochastic Systems Under Chance Constraints , 2018, IEEE Control Systems Letters.

[15]  Pieter Abbeel,et al.  LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information , 2010, Int. J. Robotics Res..

[16]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[17]  Pu Li,et al.  Advances and applications of chance-constrained approaches to systems optimisation under uncertainty , 2013, Int. J. Syst. Sci..

[18]  Nicholas Roy,et al.  Rapidly-exploring Random Belief Trees for motion planning under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Tryphon T. Georgiou,et al.  Optimal Steering of a Linear Stochastic System to a Final Probability Distribution, Part II , 2014, IEEE Transactions on Automatic Control.

[20]  Samuel C. Pinto,et al.  Risk Constrained Navigation Using MILP-MPC Formulation , 2017 .

[21]  Efstathios Bakolas,et al.  Stochastic linear systems subject to constraints , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[22]  Tryphon T. Georgiou,et al.  Optimal Steering of a Linear Stochastic System to a Final Probability Distribution, Part I , 2016, IEEE Transactions on Automatic Control.

[23]  J. How,et al.  Chance Constrained RRT for Probabilistic Robustness to Environmental Uncertainty , 2010 .

[24]  Vijay Kumar,et al.  Mixed-integer quadratic program trajectory generation for heterogeneous quadrotor teams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[25]  T. Iwasaki,et al.  Quadratic Optimization for Fixed Order Linear Controllers via Covariance Control , 1992, 1992 American Control Conference.

[26]  B. Moor,et al.  Mixed integer programming for multi-vehicle path planning , 2001, 2001 European Control Conference (ECC).

[27]  Nancy M. Amato,et al.  FIRM: Sampling-based feedback motion-planning under motion uncertainty and imperfect measurements , 2014, Int. J. Robotics Res..

[28]  Masahiro Ono,et al.  Chance-Constrained Optimal Path Planning With Obstacles , 2011, IEEE Transactions on Robotics.

[29]  Ron Alterovitz,et al.  Estimating probability of collision for safe motion planning under Gaussian motion and sensing uncertainty , 2012, 2012 IEEE International Conference on Robotics and Automation.

[30]  Jonathan P. How,et al.  Spacecraft trajectory planning with avoidance constraints using mixed-integer linear programming , 2002 .

[31]  Robert Skelton,et al.  A covariance control theory , 1985, 1985 24th IEEE Conference on Decision and Control.

[32]  Tryphon T. Georgiou,et al.  Optimal Steering of a Linear Stochastic System to a Final Probability Distribution—Part III , 2014, IEEE Transactions on Automatic Control.

[33]  L. Blackmore,et al.  Convex Chance Constrained Predictive Control without Sampling , 2009 .

[34]  Panagiotis Tsiotras,et al.  Finite-horizon covariance control of linear time-varying systems , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[35]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[36]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[37]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[38]  Robin Deits,et al.  Footstep planning on uneven terrain with mixed-integer convex optimization , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[39]  Jonathan P. How,et al.  Robust Sampling-based Motion Planning with Asymptotic Optimality Guarantees , 2013 .

[40]  C. Tomlin,et al.  Closed-loop belief space planning for linear, Gaussian systems , 2011, 2011 IEEE International Conference on Robotics and Automation.