Multi-class AdaBoost learning of facial feature selection through Grid Computing

AdaBoost is an efficient method for producing a highly accurate learning algorithm by assembling multiple classifiers, but it is also widely known for its long duration of off-line learning. Especially, when it is applied for feature selection for object detection, its learning process is to exhaustively evaluate every feature in a large set. With the increasing of image resolution and complexity of feature transformation approaches, the computational time will be extremely long, which makes the large scale AdaBoost learning very difficult. In this paper, we have employed Grid Computing to solve the difficulty. The proposed algorithm is to select the most significant features for face recognition. The selection algorithm is derived from multi-class AdaBoost, which exhaustively evaluate every feature from a large set. The deployed Grid Computing system is actually used for High Throughput Computing specialised on advanced resource management. To utilizing Grid Computing on the feature selection process, we have improved multi-class AdaBoost learning algorithm with parallel structure, so that the task of High Performance Computing is accomplished in the environment of High Throughput Computing. With Grid Computing, selecting 200 features from a large set of 30240 features is finished in 20 days, while without Grid Computing the time would be more than two years. It shows that Grid Computing brings vast advantage to computer vision, machine learning, image processing, and pattern recognition.

[1]  James M. Ferryman,et al.  Faster learning via optimised Adaboost , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[2]  Hong Wei,et al.  Constructing Weak Learner and Performance Evaluation in AdaBoost , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[3]  Hong Wei,et al.  Face Verification Using GaborWavelets and AdaBoost , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Hong Wei,et al.  Facial Feature Extraction and Selection by Gabor Wavelets and Boosting , 2009, 2009 2nd International Congress on Image and Signal Processing.

[5]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[6]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[7]  Stephen I. Gallant,et al.  Perceptron-based learning algorithms , 1990, IEEE Trans. Neural Networks.

[8]  Robert P. W. Duin,et al.  Using two-class classifiers for multiclass classification , 2002, Object recognition supported by user interaction for service robots.

[9]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[10]  Matthew Wilcox,et al.  Cooperative Linux , 2004 .

[11]  Shaogang Gong,et al.  Audio- and Video-based Biometric Person Authentication , 1997, Lecture Notes in Computer Science.

[12]  Douglas Thain,et al.  How to measure a large open‐source distributed system , 2006, Concurr. Comput. Pract. Exp..

[13]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.