论文信息 - Comparison of lazy Bayesian rule, and tree-augmented Bayesian learning

Comparison of lazy Bayesian rule, and tree-augmented Bayesian learning

The naive Bayes classifier is widely used in interactive applications due to its computational efficiency, direct theoretical base, and competitive accuracy. However its attribute independence assumption can result in sub-optimal accuracy. A number of techniques have explored simple relaxations of the attribute independence assumption in order to increase accuracy. Among these, the lazy Bayesian rule (LBR) and the tree-augmented naive Bayes (TAN) have demonstrated strong prediction accuracy. However their relative performance has never been evaluated. The paper compares and contrasts these two techniques, finding that they have comparable accuracy and hence should be selected according to computational profile. LBR is desirable when small numbers of objects are to be classified while TAN is desirable when large numbers of objects are to be classified.

Geoffrey I. Webb | Zhihai Wang | Zhihai Wang

[1] Geoffrey I. Webb,et al. Lazy Learning of Bayesian Rules , 2000, Machine Learning.

[2] Pedro M. Domingos,et al. Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier , 1996, ICML.

[3] Nir Friedman,et al. Bayesian Network Classifiers , 1997, Machine Learning.

[4] Igor Kononenko,et al. Semi-Naive Bayesian Classifier , 1991, EWSL.

[5] Eamonn J. Keogh,et al. Learning augmented Bayesian classifiers: A comparison of distribution-based and classification-based approaches , 1999, AISTATS.

[6] Pat Langley,et al. Induction of Selective Bayesian Classifiers , 1994, UAI.

[7] Ron Kohavi,et al. Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[8] Mehran Sahami,et al. Learning Limited Dependence Bayesian Classifiers , 1996, KDD.

[9] Geoffrey I. Webb,et al. Lazy Bayesian Rules: A Lazy Semi-Naive Bayesian Learning Technique Competitive to Boosting Decision Trees , 1999, ICML.

[10] Ron Kohavi,et al. Scaling Up the Accuracy of Naive-Bayes Classifiers: A Decision-Tree Hybrid , 1996, KDD.

[11] CerquidesUbilabUBS AGBahnhofstrasse. Applying General Bayesian Techniques to Improve Tan Induction , 1999 .

[12] M. Pazzani. Constructive Induction of Cartesian Product Attributes , 1998 .