Diversity-aware classifier ensemble selection via f-score

Display Omitted F-score measure used to rank the performance members of classifier ensembles.F-score based classifiers selection strategy proposed for online classification.Diversity-aware approach. Good balance between accuracy and generalization.Explicit handling of asymmetric samples distributions.Allows real-time video tracking via classification. The primary effect of using a reduced number of classifiers is a reduction in the computational requirements during learning and classification time. In addition to this obvious result, research shows that the fusion of all available classifiers is not a guarantee of best performance but good results on the average. The much researched issue of whether it is more convenient to fuse or to select has become even more of interest in recent years with the development of the Online Boosting theory, where a limited set of classifiers is continuously updated as new inputs are observed and classifications performed. The concept of online classification has recently received significant interest in the computer vision community. Classifiers can be trained on the visual features of a target, casting the tracking problem into a binary classification one: distinguishing the target from the background.Here we discuss how to optimize the performance of a classifier ensemble employed for target tracking in video sequences. In particular, we propose the F-score measure as a novel means to select the members of the ensemble in a dynamic fashion. For each frame, the ensemble is built as a subset of a larger pool of classifiers selecting its members according to their F-score. We observed an overall increase in classification accuracy and a general tendency in redundancy reduction among the members of an f-score optimized ensemble. We carried out our experiments both on benchmark binary datasets and standard video sequences.

[1]  Emilio Maggio,et al.  Video Tracking - Theory and Practice , 2011 .

[2]  Fabio Roli,et al.  Intrusion detection in computer networks by a modular ensemble of one-class classifiers , 2008, Inf. Fusion.

[3]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[4]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Peter Tiño,et al.  Managing Diversity in Regression Ensembles , 2005, J. Mach. Learn. Res..

[6]  Gian Luca Foresti,et al.  Real-time thresholding with Euler numbers , 2003, Pattern Recognit. Lett..

[7]  Chih-Jen Lin,et al.  Chapter 12 Combining SVMs with Various Feature Selection Strategies , 2006 .

[8]  Cynthia Rudin,et al.  Online coordinate boosting , 2008, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Carlo Tomasi,et al.  3D tracking = classification + interpolation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Ludmila I. Kuncheva,et al.  Switching between selection and fusion in combining classifiers: an experiment , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Gian Luca Foresti,et al.  Cascaded online boosting , 2010, Journal of Real-Time Image Processing.

[12]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[13]  Yanxi Liu,et al.  Online Selection of Discriminative Tracking Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jiri Matas,et al.  Training sequential on-line boosting classifier for visual tracking , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Robert P. W. Duin,et al.  Optimal Mean-Precision Classifier , 2009, MCS.

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Csaba Gáspár-Papanek,et al.  3-level Confidence Voting Strategy for Dynamic Fusion-Selection of Classifier Ensembles , 2009, Acta Cybern..

[18]  Shai Avidan Ensemble Tracking , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Josef Kittler,et al.  Combining Classifier for Face Identification at Unknown Views with a Single Model Image , 2004, SSPR/SPR.

[20]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Q. Henry Wu,et al.  Online training of support vector classifier , 2003, Pattern Recognit..

[22]  G. Yule On the Association of Attributes in Statistics: With Illustrations from the Material of the Childhood Society, &c , 1900 .

[23]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[24]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[25]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Robi Polikar,et al.  An ensemble based data fusion approach for early diagnosis of Alzheimer's disease , 2008, Inf. Fusion.

[27]  Ludmila I. Kuncheva Diversity in multiple classifier systems , 2005, Inf. Fusion.

[28]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[29]  Jean-Thierry Lapresté,et al.  Real-Time Tracking with Classifiers , 2006, WDV.

[30]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Fabio Roli,et al.  Design of effective neural network ensembles for image classification purposes , 2001, Image Vis. Comput..

[32]  Daniel Hernández-Lobato,et al.  An Analysis of Ensemble Pruning Techniques Based on Ordered Aggregation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[34]  Gian Luca Foresti,et al.  Selecting classifiers by F-score for real-time video tracking , 2010, 2010 13th International Conference on Information Fusion.

[35]  Levent Özgür,et al.  Text Categorization with Class-Based and Corpus-Based Keyword Selection , 2005, ISCIS.

[36]  Matti Aksela,et al.  Comparison of Classifier Selection Methods for Improving Committee Performance , 2003, Multiple Classifier Systems.

[37]  Francisco Herrera,et al.  A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[38]  Ahmed M. Elgammal,et al.  Boosting adaptive linear weak classifiers for online learning and tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Tat-Jen Cham,et al.  Online Learning Asymmetric Boosted Classifiers for Object Detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Fredric C. Gey,et al.  The relationship between recall and precision , 1994 .

[41]  Aleksandra Pizurica,et al.  Object Tracking Using Naive Bayesian Classifiers , 2008, ACIVS.

[42]  Ron Kohavi,et al.  Bias Plus Variance Decomposition for Zero-One Loss Functions , 1996, ICML.

[43]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[44]  Ludmila I. Kuncheva,et al.  That Elusive Diversity in Classifier Ensembles , 2003, IbPRIA.

[45]  Stuart J. Russell,et al.  Online bagging and boosting , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[46]  Arnold W. M. Smeulders,et al.  Robust Tracking Using Foreground-Background Texture Discrimination , 2006, International Journal of Computer Vision.

[47]  Shai Avidan,et al.  Support vector tracking , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Kagan Tumer,et al.  Classifier ensembles: Select real-world applications , 2008, Inf. Fusion.

[49]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[50]  Josef Kittler,et al.  Diversity-Based Classifier Selection for Adaptive Object Tracking , 2009, MCS.

[51]  Juan José Rodríguez Diez,et al.  Classifier Ensembles with a Random Linear Oracle , 2007, IEEE Transactions on Knowledge and Data Engineering.

[52]  Johannes R. Sveinsson,et al.  Classifying Remote Sensing Data with Support Vector Machines and Imbalanced Training Data , 2009, MCS.

[53]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.