Bayesian model averaging is not model combination
暂无分享,去创建一个
In a recent paper, Domingos (2000) compares Bayesian model averaging (BMA) to other model combination methods on some benchmark data sets, is surprised that BMA performs worst, and suggests that BMA may be flawed. These results are actually not surprising, especially in light of an earlier paper by Domingos (1997) where it was shown that model combination works by enriching the space of hypotheses, not by approximating a Bayesian model average. And the only flaw with BMA is the belief that it is an algorithm for model combination, when it is not.
[1] Pedro M. Domingos. Why Does Bagging Work? A Bayesian Account and its Implications , 1997, KDD.
[2] Pedro M. Domingos. Bayesian Averaging of Classifiers and the Overfitting Problem , 2000, ICML.