Finding optimal satisficing strategies for and-or trees

Many tasks require evaluating a specified Boolean expression @f over a set of probabilistic tests whose costs and success probabilities are each known. A strategy specifies when to perform which test, towards determining the overall outcome of @f. We are interested in finding the strategy with the minimum expected cost. As this task is typically NP-hard-for example, when tests can occur many times within @f, or when there are probabilistic correlations between the test outcomes-we consider those cases in which the tests are probabilistically independent and each appears only once in @f. In such cases, @f can be written as an and-or tree, where each internal node corresponds to either the ''and'' or ''or'' of its children, and each leaf node is a probabilistic test. In this paper we investigate ''probabilistic and-or tree resolution'' (PAOTR), namely the problem of finding optimal strategies for and-or trees. We first consider a depth-first approach: evaluate each penultimate rooted subtree in isolation, replace each such subtree with a single ''mega-test'', and recurse on the resulting reduced tree. We show that the strategies produced by this approach are optimal for and-or trees with depth at most two but can be arbitrarily sub-optimal for deeper trees. Each depth-first strategy can be described by giving the linear relative order in which tests are to be executed, with the understanding that any test whose outcome becomes irrelevant is skipped. The class of linear strategies is strictly larger than depth-first strategies. We show that even the best linear strategy can also be arbitrarily sub-optimal. We next prove that an optimal strategy honors a natural partial order among tests with a common parent node (''leaf-sibling tests''), and use this to produce a dynamic programming algorithm that finds the optimal strategy in time O(d^2(r+1)^d), where r is the maximum number of leaf-siblings and d is the number of leaf-parents; hence, for trees with a bounded number of internal nodes, this run-time is polynomial in the tree size. We also present another special class of and-or trees for which this task takes polynomial time. We close by presenting a number of other plausible approaches to PAOTR, together with counterexamples to show their limitations.

[1]  Russell Greiner,et al.  Optimal depth-first strategies for and-or trees , 2002, AAAI/IAAI.

[2]  M. R. Garey,et al.  Optimal task sequencing with precedence constraints , 1973, Discrete Mathematics.

[3]  David E. Smith Controlling Backward Inference , 1989, Artif. Intell..

[4]  Russell Greiner,et al.  Finding Optimal Derivation Strategies in Redundant Knowledge Bases , 1991, Artif. Intell..

[5]  Stuart Dreyfus,et al.  Richard Bellman on the Birth of Dynamic Programming , 2002, Oper. Res..

[6]  Venkatesan Guruswami,et al.  Query strategies for priced information (extended abstract) , 2000, STOC '00.

[7]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[8]  Herbert A. Simon,et al.  Optimal Problem-Solving Search: All-Oor-None Solutions , 1975, Artif. Intell..

[9]  Jesfis Peral,et al.  Heuristics -- intelligent search strategies for computer problem solving , 1984 .

[10]  Jeffrey A. Barnett How much is Control Knowledge Worth? A Primitive Example , 1984, Artif. Intell..

[11]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[13]  Avi Wigderson,et al.  Randomized vs. deterministic decision tree complexity for read-once Boolean functions , 1991, [1991] Proceedings of the Sixth Annual Structure in Complexity Theory Conference.

[14]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[15]  Michael E. Saks,et al.  Probabilistic Boolean decision trees and the complexity of evaluating game trees , 1986, 27th Annual Symposium on Foundations of Computer Science (sfcs 1986).

[16]  Sartaj Sahni,et al.  Computationally Related Problems , 1974, SIAM J. Comput..

[17]  Miklos Santha On the Monte Carlo Boolean decision tree complexity of read-once formulae , 1991, [1991] Proceedings of the Sixth Annual Structure in Complexity Theory Conference.

[18]  Pekka Orponen,et al.  Probably Approximately Optimal Derivation Strategies , 1991, KR.

[19]  Michael Tarsi,et al.  Optimal Search on Some Game Trees , 1983, JACM.

[20]  Dan Geiger,et al.  Optimal Satisficing Tree Searches , 1991, AAAI.

[21]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[22]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .