论文信息 - A Fast Ensemble of Regressors

A Fast Ensemble of Regressors

We have implemented a learning tool that combines the RepTree, the linear regression and the Decision Stump algorithms using the averaging methodology. We performed a large-scale comparison with other state-of-the-art algorithms and fast ensembles on several datasets and we took better accuracy in most cases using less time for training, too.

[1] Leo Breiman,et al. Bagging Predictors , 1996, Machine Learning.

[2] Ian Witten,et al. Data Mining , 2000 .

[3] Peter Tiño,et al. Managing Diversity in Regression Ensembles , 2005, J. Mach. Learn. Res..

[4] Pat Langley,et al. Induction of One-Level Decision Trees , 1992, ML.

[5] Ian H. Witten,et al. Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[6] J. Fox. Applied Regression Analysis, Linear Models, and Related Methods , 1997 .

[7] Ron Kohavi,et al. The Power of Decision Tables , 1995, ECML.

[8] N. Draper,et al. Applied Regression Analysis , 1966 .

[9] Christopher J. Merz,et al. UCI Repository of Machine Learning Databases , 1996 .

[10] John G. Cleary,et al. K*: An Instance-based Learner Using and Entropic Distance Measure , 1995, ICML.

[11] J. Friedman. Stochastic gradient boosting , 2002 .

[12] S. Sathiya Keerthi,et al. Improvements to the SMO algorithm for SVM regression , 2000, IEEE Trans. Neural Networks Learn. Syst..

[13] David P. Helmbold,et al. Boosting Methods for Regression , 2002, Machine Learning.

[14] Catherine Blake,et al. UCI Repository of machine learning databases , 1998 .

[15] Gary William Flake,et al. Efficient SVM Regression Training with SMO , 2002, Machine Learning.

[16] Salvatore J. Stolfo,et al. Distributed data mining in credit card fraud detection , 1999, IEEE Intell. Syst..