A new algorithm for probabilistic planning based on multi-objective optimization

With the fast development of AI planning, planning technology has been widely applied to robotics and automated cybernetics. Many researchers pay more and more attention to the uncertainty in AI planning, probabilistic planning is a important branch of uncertainty planning. In realistic domains, probabilistic planning often involves multiple objectives, where it aims to generate optimal set of plans to satisfy all these objectives. To date, most of probabilistic plan algorithms have only focused on single objective formulations that bound one of the objectives by making some unnatural assumptions. In this paper, we focus on the probabilistic planning problem with multiple objectives, and we introduce the multi-objective optimization method into probabilistic planning to define the multi-objective value function, we extend the single objective probabilistic algorithm learning depth-first search (LDFS) to its multi-objective counterpart multi-objective LDFS (MLDFS).We explain our implemented algorithm, the objective function we redefined, make conclusion and discuss our future work based on this framework.

[1]  Blai Bonet,et al.  Learning Depth-First Search: A Unified Approach to Heuristic Search in Deterministic and Non-Deterministic Settings, and Its Application to MDPs , 2006, ICAPS.

[2]  Richard E. Korf,et al.  Depth-First Iterative-Deepening: An Optimal Admissible Tree Search , 1985, Artif. Intell..

[3]  John Langford,et al.  Probabilistic Planning in the Graphplan Framework , 1999, ECP.

[4]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..

[5]  S. Kambhampati,et al.  Probabilistic Planning is Multi-objective! , 2007 .

[6]  James A. Hendler,et al.  Planning: What it is, What it could be, An Introduction to the Special Issue on Planning and Scheduling , 1995, Artif. Intell..

[7]  Daniel S. Weld,et al.  Probabilistic Planning with Information Gathering and Contingent Execution , 1994, AIPS.

[8]  Wen-Xiang Gu,et al.  An improved probabilistic planning algorithm based on PGraphPlan , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[9]  Shlomo Zilberstein,et al.  LAO*: A heuristic search algorithm that finds solutions with loops , 2001, Artif. Intell..

[10]  Blai Bonet,et al.  Faster Heuristic Search Algorithms for Planning with Uncertainty and Full Feedback , 2003, IJCAI.

[11]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[12]  Shi Zhong-ke,et al.  Overview of multi-objective optimization methods , 2004 .

[13]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[14]  Henry A. Kautz,et al.  BLACKBOX: A New Approach to the Application of Theorem Proving to Problem Solving , 1998 .

[15]  Craig Boutilier,et al.  Decision-Theoretic Planning: Structural Assumptions and Computational Leverage , 1999, J. Artif. Intell. Res..

[16]  Nicholas Kushmerick,et al.  An Algorithm for Probabilistic Planning , 1995, Artif. Intell..