Foundations of Entropy Based Bayesian Networks: Theoretical Results & Rough Set Based Extraction from Data

We introduce the notion of an approximate Bayesian network, which almost keeps the information entropy of data. Theoretical results as well as relationships with fundamental constructs of the rough set theory provide novel tools for handling (approximate) Bayesian networks in the real life data analysis.

[1]  Wray L. Buntine.  A Guide to the Literature on Learning Probabilistic Networks from Data , 1996, IEEE Trans. Knowl. Data Eng..

[2]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[3]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Texts in Computer Science.

[4]  Zdzislaw Pawlak,et al.  Decision Rules, Bayes' Rule and Ruogh Sets , 1999, RSFDGrC.

[5]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[6]  Dominik Slezak,et al.  Approximate Reducts in Decision Tables , 1996 .

[7]  Jakub Wroblewski,et al.  Theoretical Foundations of Order-Based Genetic Algorithms , 1996, Fundam. Informaticae.

[8]  Dominik Slezak,et al.  Normalized Decision Functions and Measures for Inconsistent Decision Tables Analysis , 2000, Fundam. Informaticae.

[9]  Remco R. Bouckaert,et al.  Properties of Bayesian Belief Network Learning Algorithms , 1994, UAI.

[10]  Lech Polkowski,et al.  Rough Sets in Knowledge Discovery 2 , 1998 .

[11]  S. K. Michael Wong,et al.  Comparison of Rough-Set and Statistical Methods in Inductive Learning , 1986, Int. J. Man Mach. Stud..

[12]  J. N. Kapur,et al.  Entropy optimization principles with applications , 1992 .

[13]  R. Gallager.  Information Theory and Reliable Communication , 1968 .

[14]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[15]  Andrzej Skowron,et al.  Boolean Reasoning for Decision Rules Generation , 1993, ISMIS.

[16]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[17]  Z. Pawlak,et al.  Rough membership functions , 1994 .