Value of Information in Probabilistic Logic Programs

In medical decision making, we have to choose among several expensive diagnostic tests such that the certainty about a patient's health is maximized while remaining within the bounds of resources like time and money. The expected increase in certainty in the patient's condition due to performing a test is called the value of information (VoI) for that test. In general, VoI relates to acquiring additional information to improve decision-making based on probabilistic reasoning in an uncertain system. This paper presents a framework for acquiring information based on VoI in uncertain systems modeled as Probabilistic Logic Programs (PLPs). Optimal decision-making in uncertain systems modeled as PLPs have already been studied before. But, acquiring additional information to further improve the results of making the optimal decision has remained open in this context. We model decision-making in an uncertain system with a PLP and a set of top-level queries, with a set of utility measures over the distributions of these queries. The PLP is annotated with a set of atoms labeled as "observable"; in the medical diagnosis example, the observable atoms will be results of diagnostic tests. Each observable atom has an associated cost. This setting of optimally selecting observations based on VoI is more general than that considered by any prior work. Given a limited budget, optimally choosing observable atoms based on VoI is intractable in general. We give a greedy algorithm for constructing a "conditional plan" of observations: a schedule where the selection of what atom to observe next depends on earlier observations. We show that, preempting the algorithm anytime before completion provides a usable result, the result improves over time, and, in the absence of a well-defined budget, converges to the optimal solution.

[1]  Andreas Krause,et al.  Optimal Nonmyopic Value of Information in Graphical Models - Efficient Algorithms and Theoretical Limits , 2005, IJCAI.

[2]  Stefan Wrobel,et al.  Active Learning of Partially Hidden Markov Models , 2001 .

[3]  L. van der Gaag,et al.  Selective evidence gathering for diagnostic belief networks , 1993 .

[4]  Vijay S. Mookerjee,et al.  Sequential Decision Models for Expert System Optimization , 1997, IEEE Trans. Knowl. Data Eng..

[5]  Eric Horvitz,et al.  An approximate nonmyopic computation for value of information , 1994, UAI 1994.

[6]  C. R. Ramakrishnan,et al.  Optimal Value of Information in Dynamic Bayesian Networks , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[7]  Taisuke Sato,et al.  PRISM: A Language for Symbolic-Statistical Modeling , 1997, IJCAI.

[8]  Luc De Raedt,et al.  DTProbLog: A Decision-Theoretic Probabilistic Prolog , 2010, AAAI.

[9]  Antonis C. Kakas,et al.  Special issue: abductive logic programming , 2000, The Journal of Logic Programming.

[10]  Tran Cao Son,et al.  Reasoning and planning with sensing actions, incomplete information, and static causal laws using answer set programming , 2006, Theory and Practice of Logic Programming.

[11]  Finn Verner Jensen,et al.  Myopic Value of Information in Influence Diagrams , 1997, UAI.

[12]  Fabrizio Riguzzi,et al.  The PITA system: Tabling and answer subsumption for reasoning under uncertainty , 2011, Theory Pract. Log. Program..

[13]  David Poole,et al.  The Independent Choice Logic and Beyond , 2008, Probabilistic Inductive Logic Programming.

[14]  Peter D. Turney Cost-Sensitive Classification: Empirical Evaluation of a Hybrid Genetic Decision Tree Induction Algorithm , 1994, J. Artif. Intell. Res..

[15]  Andreas Krause,et al.  Optimal Value of Information in Graphical Models , 2009, J. Artif. Intell. Res..

[16]  Andreas Krause,et al.  Near-optimal Nonmyopic Value of Information in Graphical Models , 2005, UAI.

[17]  Yoshitaka Kameya,et al.  Parameter Learning of Logic Programs for Symbolic-Statistical Modeling , 2001, J. Artif. Intell. Res..

[18]  Wei Hong,et al.  Model-Driven Data Acquisition in Sensor Networks , 2004, VLDB.

[19]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[20]  Luc De Raedt,et al.  ProbLog2: Probabilistic Logic Programming , 2015, ECML/PKDD.

[21]  Jan Maluszynski,et al.  Logic, Programming and Prolog (2ed) , 1995 .

[22]  Ronald A. Howard,et al.  Information Value Theory , 1966, IEEE Trans. Syst. Sci. Cybern..

[23]  Adnan Darwiche,et al.  Algorithms and Applications for the Same-Decision Probability , 2014, J. Artif. Intell. Res..

[24]  Michael C. Horsch,et al.  An Anytime Algorithm for Decision Making under Uncertainty , 1998, UAI.

[25]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[26]  Luc De Raedt,et al.  ProbLog: A Probabilistic Prolog and its Application in Link Discovery , 2007, IJCAI.

[27]  Luc De Raedt,et al.  On the Efficient Execution of ProbLog Programs , 2008, ICLP.