Computational complexity and approximization methods of most relevant explanation

Most Relevant Explanation (MRE) is a new approach to generating explanations for given evidence in Bayesian networks. MRE has a solution space containing all the partial instantiations of target variables and is extremely hard to solve. We show in this paper that the deci- sion problem of MRE is NP PP -complete. For large Bayesian networks, approximate methods may be the only feasible solutions. We observe that the solution space of MRE has a special lattice structure that con- nects all the potential solutions together. The connectiv- ity motivates us to develop several efficient local search methods for solving MRE. Empirical results show that these methods can efficiently find the optimal MRE so- lutions for majority of the test cases in our experiments. In this paper, we develop several local search methods for solving MRE. Local methods have been shown to be effec- tive in solving MAP problems in Bayesian networks (Park & Darwiche 2001). We further observe that the solution space of MRE has a special lattice structure that connects all the potential solutions, which motivates us to design several lo- cal search strategies to find high-quality solutions efficiently. Empirical results show that these local search methods are not only efficient but also able to find the optimal solutions for most of the test cases in our experiments. The remainder of the paper is structured as follows. Sec- tion 2 reviews the formulation of Most Relevant Expla- nation. Section 3 proves that the decision problem of MRE is NP PP -complete. Section 4 develops several local search methods for solving MRE, including forward search, forward-backward search, and partial exhaustive search. Fi- nally, Section 5 presents the empirical evaluations of these local MRE methods on a set of benchmark Bayesian net- works.

[1]  Changhe Yuan,et al.  A General Framework for Generating Multivariate Explanations in Bayesian Networks , 2008, AAAI.

[2]  Michael L. Littman,et al.  The Computational Complexity of Probabilistic Planning , 1998, J. Artif. Intell. Res..

[3]  Stephen A. Cook,et al.  The complexity of theorem-proving procedures , 1971, STOC.

[4]  Toniann Pitassi,et al.  Stochastic Boolean Satisfiability , 2001, Journal of Automated Reasoning.

[5]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[6]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[7]  Lluís A. Belanche Muñoz,et al.  Feature selection algorithms: a survey and experimental evaluation , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[8]  James D. Park,et al.  MAP Complexity Results and Approximation Methods , 2002, UAI.

[9]  John T. Gill,et al.  Computational complexity of probabilistic Turing machines , 1974, STOC '74.

[10]  A. Darwiche,et al.  Complexity Results and Approximation Strategies for MAP Explanations , 2011, J. Artif. Intell. Res..

[11]  Changhe Yuan,et al.  Most Relevant Explanation: Properties, Algorithms, and Evaluations , 2009, UAI.

[12]  Adnan Darwiche,et al.  Approximating MAP using Local Search , 2001, UAI.

[13]  Branden Fitelson,et al.  Likelihoodism, Bayesianism, and relational confirmation , 2007, Synthese.