Particle swarm optimisation based AdaBoost for object detection

This paper proposes a new approach to using particle swarm optimisation (PSO) within an AdaBoost framework for object detection. Instead of using exhaustive search for finding good features to be used for constructing weak classifiers in AdaBoost, we propose two methods based on PSO. The first uses PSO to evolve and select good features only, and the weak classifiers use a simple decision stump. The second uses PSO for both selecting good features and evolving weak classifiers in parallel. These two methods are examined and compared on two challenging object detection tasks in images: detection of individual pasta pieces and detection of a face. The experimental results suggest that both approaches can successfully detect object positions and that using PSO for selecting good individual features and evolving associated weak classifiers in AdaBoost is more effective than for selecting features only. We also show that PSO can evolve and select meaningful features in the face detection task.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Leslie G. Valiant,et al.  Cryptographic limitations on learning Boolean formulae and finite automata , 1994, JACM.

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  Akinobu Shimizu,et al.  Robust face detection using Gabor filter features , 2005, Pattern Recognit. Lett..

[5]  Andreas Zell,et al.  Combining Adaboost learning and evolutionary search to select features for real-time object detection , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[6]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[7]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  David Bargeron,et al.  Boosting-based transductive learning for text detection , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[9]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[10]  Fabien Moutarde,et al.  COMBINING ADABOOST WITH A HILL-CLIMBING EVOLUTIONARY FEATURE SEARCH FOR EFFICIENT TRAINING OF PERFORMANT VISUAL OBJECT DETECTORS , 2006 .

[11]  Alejandro Echeverría,et al.  Evolutionary discriminant analysis , 2006, IEEE Transactions on Evolutionary Computation.

[12]  Gary Bradski,et al.  Learning-Based Computer Vision with Intels Open Source Computer Vision Library , 2005 .

[13]  Christophe Garcia,et al.  Convolutional face finder: a neural architecture for fast and robust face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[15]  L. Petersson,et al.  Response Binning: Improved Weak Classifiers for Boosting , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[16]  Andries Petrus Engelbrecht,et al.  Particle Swarm Optimization for Pattern Recognition and Image Processing , 2006, Swarm Intelligence in Data Mining.

[17]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  C. Metz.  ROC Methodology in Radiologic Imaging , 1986, Investigative radiology.

[19]  Robert E. Schapire,et al.  The Boosting Approach to Machine Learning An Overview , 2003 .

[20]  David D. Denison,et al.  Nonlinear estimation and classification , 2003 .

[21]  Javier Ruiz-del-Solar,et al.  Gender Classification of Faces Using Adaboost , 2006, CIARP.

[22]  Takio Kurita,et al.  Fast training algorithm by Particle Swarm Optimization and random candidate selection for rectangular feature based boosted detector , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[23]  Brendan McCane,et al.  On Training Cascade Face Detectors , 2003 .

[24]  Ajith Abraham,et al.  Swarm Intelligence in Data Mining (Studies in Computational Intelligence) , 2006 .

[25]  Ji-Xin Qian,et al.  An improved particle swarm optimization algorithm with neighborhoods topologies , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[26]  Stefano Cagnoni,et al.  Particle Swarm Optimization for Object Detection and Segmentation , 2007, EvoWorkshops.

[27]  Giorgio Valentini,et al.  Ensembles of Learning Machines , 2002, WIRN.

[28]  Chuanyi Ji,et al.  Combinations of Weak Classifiers , 1996, NIPS.

[29]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[30]  Lei Wang,et al.  A study of AdaBoost with SVM based weak learners , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[31]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[33]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[34]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[35]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[36]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[37]  Stan Z. Li,et al.  FloatBoost learning and statistical face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[39]  Muhammad Zubair Shafiq,et al.  Guidelines to Select Machine Learning Scheme for Classification of Biomedical Datasets , 2009, EvoBIO.

[40]  Ajith Abraham,et al.  Swarm Intelligence in Data Mining , 2009, Swarm Intelligence in Data Mining.

[41]  Takeo Kanade,et al.  Neural network-based face detection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.