Integrating Relevance Feedback in Boosting for Content-Based Image Retrieval

Many content-based image retrieval applications suffer from small sample set and high dimensionality problems. Relevance feedback is often used to alleviate those problems. In this paper, we propose a novel interactive boosting framework to integrate user feedback into boosting scheme and bridge the gap between high-level semantic concept and low-level image features. Our method achieves more performance improvement from the relevance feedback than AdaBoost does because human judgment is accumulated iteratively to facilitate learning process. It also has obvious advantage over the classic relevance feedback method in that the classifiers are trained to pay more attention to wrongfully predicted samples in user feedback through a reinforcement training process. An interactive boosting scheme called i.Boost is implemented and tested using adaptive discriminant projection (ADP) as base classifiers, which not only combines but also enhances a set of ADP classifiers into a more powerful one. To evaluate its performance, several applications are designed on UCI benchmark data sets, Harvard, UMIST, ATT facial image data sets and COREL color image data sets. The proposed method is compared to normal AdaBoost, classic relevance feedback and the state-of-the-art projection-based classifiers. The experiment results show the superior performance of i.Boost and the interactive boosting framework.

[1]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[2]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[3]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[4]  Robert E. Schapire,et al.  How boosting the margin can also boost classifier complexity , 2006, ICML.

[5]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[6]  Qi Tian,et al.  Adaptive Discriminant Projection for Content-based Image Retrieval , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[8]  Thomas S. Huang,et al.  Small sample learning during multimedia retrieval using BiasMap , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Leslie G. Valiant,et al.  Cryptographic Limitations on Learning Boolean Formulae and Finite Automata , 1993, Machine Learning: From Theory to Applications.

[10]  David G. Stork,et al.  Pattern Classification , 1973 .

[11]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Qi Tian,et al.  Self-supervised learning based on discriminative nonlinear features for image classification , 2005, Pattern Recognit..

[13]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[14]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[15]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[16]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[17]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[18]  R. Tibshirani,et al.  Additive Logistic Regression : a Statistical View ofBoostingJerome , 1998 .

[19]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[20]  G. Clark,et al.  Reference , 2008 .