论文信息 - An Adaptive Version of the Boost by Majority Algorithm

An Adaptive Version of the Boost by Majority Algorithm

We propose a new boosting algorithm. This boosting algorithm is an adaptive version of the boost by majority algorithm and combines bounded goals of the boost by majority algorithm with the adaptivity of AdaBoost.The method used for making boost-by-majority adaptive is to consider the limit in which each of the boosting iterations makes an infinitesimally small contribution to the process as a whole. This limit can be modeled using the differential equations that govern Brownian motion. The new boosting algorithm, named BrownBoost, is based on finding solutions to these differential equations.The paper describes two methods for finding approximate solutions to the differential equations. The first is a method that results in a provably polynomial time algorithm. The second method, based on the Newton-Raphson minimization procedure, is much more efficient in practice but is not known to be polynomial.

Yoav Freund | Y. Freund

[1] Yoav Freund,et al. Boosting a weak learning algorithm by majority , 1995, COLT '90.

[2] Yoav Freund,et al. Boosting a weak learning algorithm by majority , 1990, COLT '90.

[3] Yoav Freund,et al. A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[4] Yoav Freund,et al. A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[5] Yoav Freund,et al. Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[6] Yoram Singer,et al. Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[7] Peter L. Bartlett,et al. Direct Optimization of Margins Improves Generalization in Combined Classifiers , 1998, NIPS.

[8] Yoram Singer,et al. Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[9] Yoav Freund,et al. Continuous Drifting Games , 2000, COLT.

[10] J. Friedman. Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[11] Arnold Neumaier,et al. Introduction to Numerical Analysis , 2001 .