Hierarchical Multi-objective planning: From mission specifications to contingency management

We propose a hierarchical planning framework for mission planning and execution in uncertain and dynamic environments. We consider missions that involve motion planning in large, cluttered environments, trading off mission objectives while satisfying logical/spatial/temporal constraints. Our framework enables the decomposition of the planning problem across different layers, leveraging the difference in spatial and temporal scales of the mission objectives. We show that this framework facilitates contingency management under unanticipated events. Interaction between the various layers requires consistent model abstractions and common message semantics. To satisfy these requirements, we adopt a generic knowledge-based architecture that is independent from a specific application domain. We show a specific instance of our framework using a Constrained Markov Decision Process (CMDP) planner at the higher level and a Multi-Objective Probabilistic Roadmap (MO-PRM) planner at the lower level. The resulting planning system is tested in a realistic scenario where an agent is tasked with a mission in a large urban threat rich environment under dynamic uncertain conditions. The mission specification includes a Linear Temporal Logic (LTL) formula that defines the desired behaviors, a list of metrics to be optimized and a list of constraints on time, resources and probability of mission success.

[1]  Lydia E. Kavraki,et al.  Motion planning with hybrid dynamics and temporal goals , 2010, 49th IEEE Conference on Decision and Control (CDC).

[2]  Jerry L. Franke,et al.  Holistic Contingency Management for Autonomous Unmanned Systems , 2006 .

[3]  Steven M. LaValle,et al.  Optimal motion planning for multiple robots having independent goals , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[4]  Emilio Frazzoli,et al.  Incremental sampling-based algorithm for minimum-violation motion planning , 2013, 52nd IEEE Conference on Decision and Control.

[5]  Calin Belta,et al.  Sampling-based temporal logic path planning , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Kay Chen Tan,et al.  Evolutionary artificial potential fields and their application in real time robot path planning , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[7]  Karl Henrik Johansson,et al.  Motion and action planning under LTL specifications using navigation functions and action description language , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Håkan L. S. Younes,et al.  PPDDL 1 . 0 : An Extension to PDDL for Expressing Planning Domains with Probabilistic Effects , 2004 .

[9]  Xu Chu Ding,et al.  Strategic planning under uncertainties via constrained Markov Decision Processes , 2013, 2013 IEEE International Conference on Robotics and Automation.

[10]  E. Martins On a multicriteria shortest path problem , 1984 .

[11]  David P. Miller,et al.  Experiences with an architecture for intelligent, reactive agents , 1995, J. Exp. Theor. Artif. Intell..

[12]  Ryo Takei,et al.  Optimal Control with Budget Constraints and Resets , 2011, SIAM J. Control. Optim..

[13]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[14]  Jeffrey M. Jaffe,et al.  Algorithms for finding paths with multiple constraints , 1984, Networks.

[15]  Ian M. Mitchell,et al.  Continuous path planning with multiple constraints , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[16]  Orna Kupferman,et al.  Model Checking of Safety Properties , 1999, CAV.

[17]  Oscar Castillo,et al.  Multiple Objective Genetic Algorithms for Path-planning Optimization in Autonomous Mobile Robots , 2006, Soft Comput..

[18]  Emilio Frazzoli,et al.  Sampling-based motion planning with deterministic μ-calculus specifications , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[19]  Craig Schlenoff,et al.  RCS : An Intelligent Agent Architecture , 2004 .

[20]  Pierre Hansen,et al.  Bicriterion Path Problems , 1980 .

[21]  Nicholas Roy,et al.  Rapidly-exploring Random Belief Trees for motion planning under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  Leslie Pack Kaelbling,et al.  Hierarchical task and motion planning in the now , 2011, 2011 IEEE International Conference on Robotics and Automation.