A Survey on Accelerating the Classifier Training Using Various Boosting Schemes Within Cascades of Boosted Ensembles

In this paper, we study how to handle current issues encountered once training classifiers at intervals within the defined framework, i.e., the cascades of boosted ensembles (CoBEs). This CoBEs framework became more popular ones they are more successful in the face detector. From there on researchers started improvising the present procedure by implementing new procedures through various directions such as another possible boosting methods and attributes sets. In the present scenario, a big challenge faced by this framework is unreasonable classifier training runtimes. The lengthy runtimes are an obstacle for this framework, for the broader usage. In addition to this they deter the method of creating effective object detection applications. They also considered as verifications of other analyses when creating the testing of the latest theories and algorithms, which is an extreme challenge. One more limitation of this CoBEs framework is its reduced capability to train existing classifiers gradually. At present, the highest guarantee technique of combining latest data set into a live data set classifier is, to train a classifier from starting point using the combination of old and new data sets. It is unworthy and it is short of a defined modularity and removes important data obtained in earlier training. To work with the existing issues, the current paper studies and compares alternative CoBEs framework for training classifiers. The alternative framework reduces runtimes of training by a degree of enormity than regular CoBEs framework and introduces other accountability to the existing procedure. They obtain this, while keeping alive the generalization capability of existing classifiers. This paper also studies a new process for raising training of CoBEs classifiers and presents, how existing classifiers executed without retraining them from the start, i.e., boosting chain learning. Even though it is capable to increase the successful detection rates of existing classifiers (AdaBoost, FloatBoost), presently it is not capable to lower the negative detection rates.

[1]  Harry Shum,et al.  Statistical Learning of Multi-view Face Detection , 2002, ECCV.

[2]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[4]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[8]  Mariano Alvira,et al.  MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY and CENTER FOR BIOLOGICAL AND COMPUTATIONAL LEARNING DEPARTMENT OF BRAIN AND COGNITIVE SCIENCES A.I. Memo No.XXXX C.B.C.L Paper No.XXX An Empirical Comparison of SNoW and SVMs For Face Detection , 2001 .

[9]  Rong Xiao,et al.  Boosting chain learning for object detection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[11]  Javier Ruiz-del-Solar,et al.  A unified learning framework for object detection and classification using nested cascades of boosted classifiers , 2008, Machine Vision and Applications.

[12]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[13]  James M. Rehg,et al.  On the Design of Cascades of Boosted Ensembles for Face Detection , 2008, International Journal of Computer Vision.

[14]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[15]  Harry Shum,et al.  FloatBoost Learning for Classification , 2002, NIPS.