Hierarchical Bayesian Networks: An Approach to Classification and Learning for Structured Data

Bayesian Networks are one of the most popular formalisms for reasoning under uncertainty. Hierarchical Bayesian Networks (HBNs) are an extension of Bayesian Networks that are able to deal with structured domains, using knowledge about the structure of the data to introduce a bias that can contribute to improving inference and learning methods. In effect, nodes in an HBN are (possibly nested) aggregations of simpler nodes. Every aggregate node is itself an HBN modelling independences inside a subset of the whole world under consideration. In this paper we discuss how HBNs can be used as Bayesian classifiers for structured domains. We also discuss how HBNs can be further extended to model more complex data structures, such as lists or sets, and we present the results of preliminary experiments on the mutagenesis dataset.

[1]  De Raedt,et al.  Advances in Inductive Logic Programming , 1996 .

[2]  Dan Roth,et al.  Understanding Probabilistic Classifiers , 2001, ECML.

[3]  S. Muggleton.  Stochastic Logic Programs , 1996 .

[4]  J. W. Lloyd,et al.  Logic for Learning , 2003, Cognitive Technologies.

[5]  Avi Pfeffer,et al.  Object-Oriented Bayesian Networks , 1997, UAI.

[6]  Peter A. Flach,et al.  Probabilistic reasoning with terms , 2003 .

[7]  Daniel Kahneman,et al.  Probabilistic reasoning , 1993 .

[8]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine-mediated learning.

[9]  Peter A. Flach,et al.  Hierarchical Bayesian Networks: A Probabilistic Reasoning Model for Structured Domains , 2002 .

[10]  James Cussens,et al.  Parameter Estimation in Stochastic Logic Programs , 2001, Machine Learning.

[11]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[12]  Luc De Raedt,et al.  Adaptive Bayesian Logic Programs , 2001, ILP.

[13]  Luc De Raedt,et al.  Bayesian Logic Programs , 2001, ILP Work-in-progress reports.

[14]  Wai Lam,et al.  LEARNING BAYESIAN BELIEF NETWORKS: AN APPROACH BASED ON THE MDL PRINCIPLE , 1994, Comput. Intell..

[15]  Ashwin Srinivasan,et al.  Mutagenesis: ILP experiments in a non-determinate biological domain , 1994 .

[16]  Daphne Koller,et al.  Probabilistic Relational Models , 1999, ILP.

[17]  Peter A. Flach,et al.  Naive Bayesian Classification of Structured Data , 2004, Machine Learning.

[18]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[19]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[20]  Peter A. Flach,et al.  IBC: A First-Order Bayesian Classifier , 1999, ILP.

[21]  John W. Lloyd,et al.  Higher-Order Computational Logic , 2002, Computational Logic: Logic Programming and Beyond.

[22]  Peter A. Flach,et al.  1BC2: A True First-Order Bayesian Classifier , 2002, ILP.

[23]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[24]  Luc De Raedt,et al.  Machine Learning: ECML 2001 , 2001, Lecture Notes in Computer Science.