FIRE in ImageCLEF 2007: Support Vector Machines and Logistic Models to Fuse Image Descriptors for Photo Retrieval

Submissions to the photographic retrieval task of the ImageCLEF 2007 evaluation and improvements of our methods that were tested and evaluated after the official benchmark. We use our image retrieval system FIRE to combine a set of different image descriptors. The most important step in combining descriptors is to find a suitable weighting. Here, we evaluate empirically tuned linear combinations, a trained logistic regression model, and support vector machines to fuse the different descriptors. Additionally, clustered SIFT histograms are evaluated for the given task and show very good results --- both, alone and in combination with other features. A clear improvement over our evaluation performance is shown consistently over different combination schemes and feature sets.

[1]  C. Schmid,et al.  Object Class Recognition Using Discriminative Local Features , 2005 .

[2]  NeyHermann,et al.  Features for image retrieval , 2008 .

[3]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Hans Burkhardt,et al.  SVM-based Relevance Feedback in Image Retrieval using Invariant Feature Histograms , 2005, MVA.

[5]  Paul Clough,et al.  The IAPR TC-12 Benchmark: A New Evaluation Resource for Visual Information Systems , 2006 .

[6]  Fredric C. Gey,et al.  ENSM-SE at CLEF 2006 : Fuzzy Proximity Method with an Adhoc Influence Function in Evaluation of Multilingual and Multi-modal Information Retrieval 7th Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Alicante, Spain , 2007 .

[7]  Hermann Ney,et al.  Sparse Patch-Histograms for Object Classification in Cluttered Images , 2006, DAGM-Symposium.

[8]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[9]  Thomas Deselaers,et al.  Features for Image Retrieval , 2003 .

[10]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Marcus Jerome Pickering,et al.  A comparative study of evidence combination strategies , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Bernhard Schölkopf,et al.  Support vector learning , 1997 .

[13]  Hermann Ney,et al.  Image Retrieval and Annotation Using Maximum Entropy , 2006, CLEF.

[14]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[15]  Allan Hanbury,et al.  Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task , 2008, CLEF.

[16]  Sven Siggelkow,et al.  Feature histograms for content-based image retrieval , 2002 .

[17]  Hermann Ney,et al.  Discriminative training for object recognition using image patches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .