Bayesian networks for lossless dataset compression

The recent explosion in research on probabilistic data mining algorithms such as Bayesian networks has been focussed primarily on their use in diagnostics, prediction and e cient inference. In this paper, we examine the use of Bayesian networks for a di erent purpose: lossless compression of large datasets. We present algorithms for automatically learning Bayesian networks and new structures called \Hu man networks" that model statistical relationships in the datasets, and algorithms for using these models to then compress the datasets. These algorithms often achieve signi cantly better compression ratios than achieved with common dictionary-based algorithms such those used by programs like ZIP.