An Algorithm Better than AO*?

Recently there has been a renewed interest in AO* as planning problems involving uncertainty and feedback can he naturally formulated as AND/OR graphs. In this work, we carry out what is prohably the first detailed empirical evaluation of AO* in relation to other AND/OR search algorithms. We compare AO* with two other methods: the well-known Value Iteration (VI) algorithm, and a new algorithm, Learning in Depth-First Search (LDFS). We consider instances from four domains. usc three different heuristic functions, and focus on the optimization of cost in the worst case (Max AND/OR graphs). Roughly we find that while AO* does better than VI in the presence of informed heuristics, VI does better than recent extensions of AO* in the presence of cycles in the AND/OR graph. At the same time, LOFS and its variant Bounded LOFS, which can be regarded as extensions of IDA*, are almost never slower than either AO* or VI, and in many cases, are orders-of-magnitude faster.

[1]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[2]  M. Garey Optimal Binary Identification Procedures , 1972 .

[3]  Alberto Martelli,et al.  Additive AND/OR Graphs , 1973, IJCAI.

[4]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Richard E. Korf,et al.  Real-Time Heuristic Search , 1990, Artif. Intell..

[6]  Krishna R. Pattipati,et al.  Application of heuristic search and information theory to sequential fault diagnosis , 1990, IEEE Trans. Syst. Man Cybern..

[7]  Richard E. Korf,et al.  Moving Target Search , 1991, IJCAI.

[8]  P. P. Chakrabarti Algorithms for Searching Explicit AND/OR Graphs and their Applications to Problem Reduction Search , 1994, Artif. Intell..

[9]  Alexander Reinefeld,et al.  Enhanced Iterative-Deepening Search , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[11]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[12]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[13]  Richard E. Korf,et al.  Moving-Target Search: A Real-Time Search for Changing Goals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..

[15]  Jonathan Schaeffer,et al.  Best-First Fixed-Depth Minimax Algorithms , 1996, J. Int. Comput. Games Assoc..

[16]  Carme Torras,et al.  An efficient algorithm for searching implicit AND/OR graphs with cycles , 2000, Artificial Intelligence.

[17]  Blai Bonet,et al.  Planning with Incomplete Information as Heuristic Search in Belief Space , 2000, AIPS.

[18]  Shlomo Zilberstein,et al.  LAO*: A heuristic search algorithm that finds solutions with loops , 2001, Artif. Intell..

[19]  Sven Koenig,et al.  Minimax real-time heuristic search , 2001, Artif. Intell..

[20]  Ambuj Mahanti,et al.  A Framework for Searching AND/OR Graphs with Cycles , 2003, ArXiv.

[21]  Blai Bonet,et al.  Labeled RTDP: Improving the Convergence of Real-Time Dynamic Programming , 2003, ICAPS.

[22]  Zhu Fuxi,et al.  A Solution to Billiard Balls Puzzle Using AO Algorithm and Its Application to Product Development , 2003, KES.

[23]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[24]  Blai Bonet,et al.  Learning Depth-First Search: A Unified Approach to Heuristic Search in Deterministic and Non-Deterministic Settings, and Its Application to MDPs , 2006, ICAPS.