Explicit-risk-aware Path Planning with Reward Maximization

This paper develops a path planner that minimizes risk (e.g. motion execution) while maximizing accumulated reward (e.g., quality of sensor viewpoint) motivated by visual assistance or tracking scenarios in unstructured or confined environments. In these scenarios, the robot should maintain the best viewpoint as it moves to the goal. However, in unstructured or confined environments, some paths may increase the risk of collision; therefore there is a tradeoff between risk and reward. Conventional state-dependent risk or probabilistic uncertainty modeling do not consider path-level risk or is difficult to acquire. This risk-reward planner explicitly represents risk as a function of motion plans, i.e., paths. Without manual assignment of the negative impact to the planner caused by risk, this planner takes in a pre-established viewpoint quality map and plans target location and path leading to it simultaneously, in order to maximize overall reward along the entire path while minimizing risk. Exact and approximate algorithms are presented, whose solution is further demonstrated on a physical tethered aerial vehicle. Other than the visual assistance problem, the proposed framework also provides a new planning paradigm to address minimum-risk planning under dynamical risk and absence of substructure optimality and to balance the trade-off between reward and risk.

[1]  Siddharth Agarwal,et al.  Characteristics of indoor disaster environments for small UASs , 2014, 2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014).

[2]  P. Pardalos,et al.  Optimal Risk Path Algorithms , 2002 .

[3]  J. How,et al.  Function Approximation for Continuous Constrained MDPs , 2011 .

[4]  Eric Horvitz,et al.  Risk-Aware Planning: Methods and Case Study for Safer Driving Routes , 2017, AAAI.

[5]  Masahiro Ono,et al.  An Efficient Motion Planning Algorithm for Stochastic Dynamic Systems with Constraints on Probability of Failure , 2008, AAAI.

[6]  J. How,et al.  Chance Constrained RRT for Probabilistic Robustness to Environmental Uncertainty , 2010 .

[7]  Robin R. Murphy,et al.  Indoor UAV Localization Using a Tether , 2018, 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[8]  Nicholas Roy,et al.  The Belief Roadmap: Efficient Planning in Linear POMDPs by Factoring the Covariance , 2007, ISRR.

[9]  Giorgio Guglieri,et al.  A Minimum Risk Approach for Path Planning of UAVs , 2011, J. Intell. Robotic Syst..

[10]  Ian Postlethwaite,et al.  A Comprehensive Study on Flight Path Selection Algorithms , 2006 .

[11]  Pieter Abbeel,et al.  LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information , 2010, Int. J. Robotics Res..

[12]  Robin R. Murphy,et al.  Visual servoing for teleoperation using a tethered UAV , 2017, 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR).

[13]  A. R. Soltani,et al.  A fuzzy based multi-objective path planning of construction sites , 2004 .

[14]  Nicholas Roy,et al.  Rapidly-exploring Random Belief Trees for motion planning under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Jonathan P. How,et al.  An online algorithm for constrained POMDPs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  J. Vian,et al.  Trajectory Optimization with Risk Minimization for Military Aircraft , 1987 .

[17]  Geoffrey A. Hollinger,et al.  Risk‐aware Path Planning for Autonomous Underwater Vehicles using Predictive Ocean Models , 2013, J. Field Robotics.

[18]  Jonathan P. How,et al.  Robust Sampling-based Motion Planning with Asymptotic Optimality Guarantees , 2013 .

[19]  Claire J. Tomlin,et al.  On feedback design and risk allocation in chance constrained control , 2011, IEEE Conference on Decision and Control and European Control Conference.

[20]  Sylvie Thiébaux,et al.  RAO*: An Algorithm for Chance-Constrained POMDP's , 2016, AAAI.

[21]  Gaurav S. Sukhatme,et al.  Toward risk aware mission planning for Autonomous Underwater Vehicles , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Robin R. Murphy,et al.  Motion Planning for a UAV with a Straight or Kinked Tether , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Nancy M. Amato,et al.  FIRM: Sampling-based feedback motion-planning under motion uncertainty and imperfect measurements , 2014, Int. J. Robotics Res..

[24]  Jonathan P. How,et al.  A decentralized approach to multi-agent planning in the presence of constraints and uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  Ron Alterovitz,et al.  Motion planning under uncertainty using iterative local optimization in belief space , 2012, Int. J. Robotics Res..