MOMDP solving algorithms comparison for safe path planning problems in urban environments

This paper tackles a problem of UAV safe path planning in an urban environment where the onboard sensors can be unavailable such as GPS occlusion. The key idea is to perform UAV path planning along with its navigation an guidance mode planning where each of these modes uses different set of sensors and whose availability and performance are environment-dependent. It is supposed to have a-priori knowledge in a form of gaussians mixture maps of obstacles and sensors availabilities. These maps allow the use of an Extended Kalman Filter (EKF) to have an accurate state estimate. This paper proposes a planner model based on Mixed Observability Markov Decision Process (MOMDP) and EKF. It allows the planner to propagate such probability map information to the future path for choosing the best action minimizing the expected cost.

[1]  David Hsu,et al.  SARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces , 2008, Robotics: Science and Systems.

[2]  Bernard Mettler,et al.  Benchmarking of obstacle field navigation algorithms for autonomous helicopters , 2010 .

[3]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[4]  Donald W. K. Andrews,et al.  Consistent model and moment selection procedures for GMM estimation with application to dynamic panel data models , 2001 .

[5]  David Hsu,et al.  Monte Carlo Value Iteration for Continuous-State POMDPs , 2010, WAFR.

[6]  Yoko Watanabe,et al.  Safe Path Planning with Localization Uncertainty for Urban Operation of VTOL UAV , 2014 .

[7]  Carl E. Rasmussen,et al.  Gaussian process dynamic programming , 2009, Neurocomputing.

[8]  Joel Veness,et al.  Monte-Carlo Planning in Large POMDPs , 2010, NIPS.

[9]  David Hsu,et al.  Planning under Uncertainty for Robotic Tasks with Mixed Observability , 2010, Int. J. Robotics Res..

[10]  Olivier Sigaud,et al.  Processus décisionnels de Markov en intelligence artificielle , 2008 .

[11]  Blai Bonet,et al.  Solving POMDPs: RTDP-Bel vs. Point-based Algorithms , 2009, IJCAI.

[12]  Blai Bonet,et al.  Labeled RTDP: Improving the Convergence of Real-Time Dynamic Programming , 2003, ICAPS.

[13]  Csaba Szepesvári,et al.  Bandit Based Monte-Carlo Planning , 2006, ECML.

[14]  Roland Siegwart,et al.  Motion‐ and Uncertainty‐aware Path Planning for Micro Aerial Vehicles , 2014, J. Field Robotics.

[15]  Nicholas Roy,et al.  Rapidly-exploring Random Belief Trees for motion planning under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Yoko Watanabe,et al.  Towards a MOMDP model for UAV safe path planning in urban environment , 2017 .

[17]  D. Odijk,et al.  Prediction of GNSS Availability and Accuracy in Urban Environments Case Study Schiphol Airport , 2009 .

[18]  Olivier Buffet,et al.  A Closer Look at MOMDPs , 2010, 2010 22nd IEEE International Conference on Tools with Artificial Intelligence.