Fast Propagation Algorithms for Singly Connected Networks and their Applications to Information Retrieval

There are some problems in which the time required for evaluating a Bayesian network must not be long. This means that not all the propagation algorithms could be applied in these situations, and therefore an appropriate method must be chosen. A type of evaluation that fulfills this requirement is known generically as “anytime algorithm”. They are able to return an approximate output at any moment, solution that could be enough for some problems. In this paper two methods framed in this approach are presented. These are modifications of the Pearl’s exact propagation algorithm for singly connected networks, designed with the final aim of reducing the propagation effort in domain problems where the number of variables is very large and the domain knowledge could be represented using that topology. As a very suitable test bed for measuring their quality, the field of Information Retrieval was selected. Results of a detailed experimentation are presented as well, showing a good performance.

[1]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[2]  Avi Pfeffer,et al.  Semantics and Inference for Recursive Probability Models , 2000, AAAI/IAAI.

[3]  Luis M. de Campos,et al.  Building Bayesian network-based information retrieval systems , 2000, Proceedings 11th International Workshop on Database and Expert Systems Applications.

[4]  Fabio Gagliardi Cozman,et al.  Embedded Bayesian Networks: Anyspace, Anytime Probabilistic Inference , 2002 .

[5]  Michael P. Wellman,et al.  On state-space abstraction for anytime evaluation of Bayesian networks , 1996, SGAR.

[6]  William H. Hsu,et al.  A Survey of Algorithms for Real-Time Bayesian Network Inference , 2002 .

[7]  S. Robertson.  The probability ranking principle in IR , 1997 .

[8]  Berthier A. Ribeiro-Neto,et al.  A belief network model for IR , 1996, SIGIR '96.

[9]  Luis M. de Campos,et al.  Query Expansion in Information Retrieval Systems using a Bayesian Network-Based Thesaurus , 1998, UAI.

[10]  Ann E. Nicholson,et al.  treeNets: A Framework for Anytime Evaluation of Belief Networks , 1997, ECSQARU-FAPR.

[11]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[12]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[13]  Denise Draper,et al.  Localized Partial Evaluation of Belief Networks , 1994, UAI.

[14]  Fabio Crestani,et al.  “Is this document relevant?…probably”: a survey of probabilistic models in information retrieval , 1998, CSUR.

[15]  Luis M. de Campos,et al.  The BNR model: foundations and performance of a Bayesian network-based retrieval model , 2003, Int. J. Approx. Reason..