A Novel Fusion Method for Semantic Concept Classification in Video

Semantic concept classification is a critical task for content-based video retrieval. Traditional methods of machine learning focus on increasing the accuracy of classifiers or models, and face the problems of inducing new data errors and algorithm complexity. Recent researches show that fusion strategies of ensemble learning have appeared promising for improving the classification performance, so some researchers begin to focus on the ensemble of multi-classifiers. The most widely known method of ensemble learning is the Adaboost algorithm. However, when comes to the video data, it encounters severe difficulties, such as visual feature diversity, sparse concepts, etc. In this paper, we proposed a novel fusion method based on the CACE (Combined Adaboost Classifier Ensembles) algorithm. We categorize the visual features by different granularities and define a pair-wise feature diversity measurement, then we construct the simple classifiers based on the feature diversity, and use modified Adaboost to fusion the classifier results. The CACE algorithm in our method makes it outperform the standard Adaboost algorithm as well as many other fusion methods. Experimental results on TRECVID 2007 show that our method is an effective and relatively robust fusion method.

[1]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[2]  Marcel Worring,et al.  The challenge problem for automated detection of 101 semantic concepts in multimedia , 2006, MM '06.

[3]  Zhaohui Wu,et al.  An Entropy-Based Diversity Measure for Classifier Combining and Its Application to Face Classifier Ensemble Thinning , 2004, SINOBIOMETRICS.

[4]  Dong Wang,et al.  Video diver: generic video indexing with diverse features , 2007, MIR '07.

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[7]  Sheng Tang,et al.  AP-Based Adaboost in High Level Feature Extraction at TRECVID , 2007, 2007 2nd International Conference on Pervasive Computing and Applications.

[8]  Abbas Golestani,et al.  A Novel Adaptive-Boost-Based Strategy for Combining Classifiers Using Diversity Concept , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[9]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[10]  Shengli Wu,et al.  Data fusion with estimated weights , 2002, CIKM '02.

[11]  Milind R. Naphade,et al.  Probabilistic Semantic Video Indexing , 2000, NIPS.

[12]  Sheng Tang,et al.  TRECVID 2007 High-Level Feature Extraction By MCG-ICT-CAS , 2007, TRECVID.