An explication of uncertain evidence in Bayesian networks: likelihood evidence and probabilistic evidence

This paper proposes a systematized presentation and a terminology for observations in a Bayesian network. It focuses on the three main concepts of uncertain evidence, namely likelihood evidence and fixed and not-fixed probabilistic evidence, using a review of previous literature. A probabilistic finding on a variable is specified by a local probability distribution and replaces any former belief in that variable. It is said to be fixed or not fixed regarding whether it has to be kept unchanged or not after the arrival of observation on other variables. Fixed probabilistic evidence is defined by Valtorta et al. (J Approx Reason 29(1):71–106 2002) under the name soft evidence, whereas the concept of not-fixed probabilistic evidence has been discussed by Chan and Darwiche (Artif Intell 163(1):67–90 2005). Both concepts have to be clearly distinguished from likelihood evidence defined by Pearl (1988), also called virtual evidence, for which evidence is specified as a likelihood ratio, that often represents the unreliability of the evidence. Since these three concepts of uncertain evidence are not widely understood, and the terms used to describe these concepts are not well established, most Bayesian networks engines do not offer well defined propagation functions to handle them. Firstly, we present a review of uncertain evidence and the proposed terminology, definitions and concepts related to the use of uncertain evidence in Bayesian networks. Then we describe updating algorithms for the propagation of uncertain evidence. Finally, we propose several results where the use of fixed or not-fixed probabilistic evidence is required.

[1]  Mark L. Krieg A Tutorial on Bayesian Belief Networks , 2001 .

[2]  Uffe Kjærulff,et al.  Bayesian Networks and Influence Diagrams: A Guide to Construction and Analysis , 2007, Information Science and Statistics.

[3]  Paulo Cesar G. da Costa,et al.  Envisioning Uncertainty in Geospatial Information , 2007, BMA.

[4]  Hao Tang,et al.  Basic Theory of Fuzzy Bayesian Networks and Its Application in Machinery Fault Diagnosis , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[5]  Mohamed Abdel Fattah A hybrid machine learning model for multi-document summarization , 2013, Applied Intelligence.

[6]  Scott Langevin,et al.  Knowledge representation, communication, and update in probability-based multiagent systems , 2010, AAMAS.

[7]  M. Vurro,et al.  Bayesian Belief Network to support conflict analysis for groundwater protection: the case of the Apulia region. , 2013, Journal of environmental management.

[8]  Marco Valtorta,et al.  Performance Evaluation of Algorithms for Soft Evidential Update in Bayesian Networks: First Results , 2008, SUM.

[9]  C. Goodier,et al.  USING A BAYESIAN NETWORK TO EVALUATE THE SOCIAL , ECONOMIC AND ENVIRONMENTAL IMPACTS OF COMMUNITY RENEWABLE ENERGY , 2013 .

[10]  Jirí Vomlel,et al.  Soft evidential update for probabilistic multiagent systems , 2002, Int. J. Approx. Reason..

[11]  W. Deming,et al.  On a Least Squares Adjustment of a Sampled Frequency Table When the Expected Marginal Totals are Known , 1940 .

[12]  Tao Chen,et al.  Latent Tree Models and Approximate Inference in Bayesian Networks , 2008, AAAI.

[13]  Mohamed Abid,et al.  Uncertain Evidence in Bayesian Networks: Presentation and Comparison on a Simple Example , 2012, IPMU.

[14]  Yun Peng,et al.  Bayesian Network Revision with Probabilistic Constraints , 2012, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[15]  Yun Peng,et al.  Modifying Bayesian Networks by Probability Constraints , 2005, UAI.

[16]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[17]  John M. Noble,et al.  Wiley Series in Probability and Statistics , 2009 .

[18]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[19]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[20]  Jiri Vomlel,et al.  Probabilistic reasoning with uncertain evidence , 2004 .

[21]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[22]  Jose Miguel Puerta,et al.  Handling numeric attributes when comparing Bayesian network classifiers: does the discretization method matter? , 2011, Applied Intelligence.

[23]  Yun Peng,et al.  Belief Update in Bayesian Networks Using Uncertain Evidence , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[24]  R. Jirousek,et al.  On the effective implementation of the iterative proportional fitting procedure , 1995 .

[25]  Changhe Yuan,et al.  Most Relevant Explanation in Bayesian Networks , 2011, J. Artif. Intell. Res..

[26]  Salem Benferhat,et al.  Inference in possibilistic network classifiers under uncertain observations , 2012, Annals of Mathematics and Artificial Intelligence.

[27]  Mohamed Abid,et al.  Fuzzy Evidence in Bayesian Network , 2011, 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[28]  Olivier Pourret,et al.  Bayesian networks : a practical guide to applications , 2008 .

[29]  Jirí Vomlel,et al.  Integrating inconsistent data in a probabilistic model , 2004, J. Appl. Non Class. Logics.

[30]  Adnan Darwiche,et al.  Sensitivity Analysis in Bayesian Networks: From Single to Multiple Parameters , 2004, UAI.

[31]  Kamel Mekhnacha,et al.  Bayesian Programming , 2013 .

[32]  Adnan Darwiche,et al.  On the Revision of Probabilistic Beliefs using Uncertain Evidence , 2003, IJCAI.

[33]  Véronique Delcroix,et al.  A Bayesian network for recurrent multi-criteria and multi-attribute decision problems: Choosing a manual wheelchair , 2013, Expert Syst. Appl..

[34]  M. Maalej,et al.  Understanding soft evidence as probabilistic evidence: Illustration with several use cases , 2013, 2013 5th International Conference on Modeling, Simulation and Applied Optimization (ICMSAO).

[35]  Francesco M. Malvestuto,et al.  An implementation of the iterative proportional fitting procedure by propagation trees , 2001 .

[36]  Michael Luby,et al.  Approximating Probabilistic Inference in Bayesian Belief Networks is NP-Hard , 1993, Artif. Intell..

[37]  Luciano Ferreira,et al.  A fuzzy-Bayesian model for supplier selection , 2012, Expert Syst. Appl..

[38]  Yun Peng,et al.  Bayesian Network Reasoning with Uncertain Evidences , 2010, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[39]  W. R. Shao,et al.  Bayesian Networks and Influence Diagrams: A Guide to Construction and Analysis , 2008 .

[40]  Jirí Vomlel,et al.  A Prototypical System for Soft Evidential Update , 2004, Applied Intelligence.

[41]  Sylvain Piechowiak,et al.  Comparative study of supervised classification algorithms for the detection of atmospheric pollution , 2011, Eng. Appl. Artif. Intell..

[42]  Hei Chan,et al.  Sensitivity analysis of probabilistic graphical models (「プリファレンスモデリングと推薦システム」及び一般) , 2007 .

[43]  Radim Jirousek,et al.  Solution of the marginal problem and decomposable distributions , 1991, Kybernetika.

[44]  Kevin B. Korb,et al.  Bayesian Artificial Intelligence, Second Edition , 2010 .

[45]  Steven Broekx,et al.  A review of Bayesian belief networks in ecosystem service modelling , 2013, Environ. Model. Softw..

[46]  Walmir M. Caminhas,et al.  Fault detection in dynamic systems by a Fuzzy/Bayesian network formulation , 2014, Appl. Soft Comput..

[47]  Lin Liu,et al.  Fuzzy Bayesian networks-a general formalism for representation, inference and learning with hybrid Bayesian networks , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[48]  Cory J. Butz,et al.  Incorporating Evidence in Bayesian Networks with the Select Operator , 2005, Canadian Conference on AI.

[49]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[50]  Jeroen Keppens,et al.  Compositional Bayesian modelling for computation of evidence collection strategies , 2011, Applied Intelligence.

[51]  Masami Takikawa,et al.  Representation for Dynamic Situation Modeling , 2002 .

[52]  Jean-Paul Chilès,et al.  Wiley Series in Probability and Statistics , 2012 .

[53]  Yun Peng,et al.  An Efficient Method for Probabilistic Knowledge Integration , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[54]  D. Dubois,et al.  Belief Change Rules in Ordinal and Numerical Uncertainty Theories , 1998 .

[55]  R. Jeffrey The Logic of Decision , 1984 .

[56]  James F. Baldwin,et al.  Inference and learning in fuzzy bayesian networks , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[57]  Marco Valtorta,et al.  Agent-encapsulated bayesian networks , 1998 .

[58]  Kevin B. Korb,et al.  Bayesian Artificial Intelligence , 2004, Computer science and data analysis series.

[59]  Marco Valtorta,et al.  Agent-encapsulated Bayesian networks and the rumor problem , 2010, AAMAS.

[60]  Adnan Darwiche,et al.  Modeling and Reasoning with Bayesian Networks , 2009 .

[61]  Anders L. Madsen,et al.  LAZY Propagation: A Junction Tree Inference Algorithm Based on Lazy Evaluation , 1999, Artif. Intell..

[62]  John M. Noble,et al.  Bayesian Networks: An Introduction , 2009 .

[63]  James F. Baldwin,et al.  An approach to hybrid probabilistic models , 2008, Int. J. Approx. Reason..

[64]  Chris I. Goodier,et al.  Using a bayesian network to evaluate the social, economic and environmental impacts of community deployed renewable energy , 2013 .