A novel dynamic multi-model relevance feedback procedure for content-based image retrieval

This paper deals with the problem of image retrieval in large databases with a big semantic gap by a relevance feedback procedure. We present a novel algorithm for modelling the users's preferences in the content-based image retrieval system.The proposed algorithm considers the probability of an image belonging to the set of those sought by the user, and estimates the parameters of several local logistic regression models whose inputs are the low-level image features. A Principal Component Analysis method is applied to the original vector to reduce its high dimensionality. The relevance probabilities predicted by these local models are combined by means of a weighted average. These weights are obtained according to the variance explained by the group of principal components used for each local model. These models are dynamically estimated in each iteration of the relevance feedback algorithm until the user is satisfied.This novel procedure has been tested in a collection with a large semantic gap, the Wikipedia collection. Two types of experiments have been performed, one with an automatic user and another with a typical user. The method is compared to some recent similar approaches in literature, obtaining very good performance in terms of the MAP evaluation measure.

[1]  Thomas S. Huang,et al.  One-class SVM for learning in image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Paul Clough,et al.  ImageCLEF: Experimental Evaluation in Visual Information Retrieval , 2010 .

[3]  Shaoping Ma,et al.  Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning , 2003, IEEE Trans. Image Process..

[4]  Nuno Vasconcelos,et al.  Learning from User Feedback in Image Retrieval Systems , 1999, NIPS.

[5]  Rob Hess,et al.  An open-source SIFTLibrary , 2010, ACM Multimedia.

[6]  Giorgio Giacinto,et al.  Dissimilarity Representation in Multi-feature Spaces for Image Retrieval , 2011, ICIAP.

[7]  Ying Liu,et al.  Semantic Clustering for Region-Based Image Retrieval , 2007, Ninth IEEE International Symposium on Multimedia Workshops (ISMW 2007).

[8]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[10]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[11]  Raimondo Schettini,et al.  A relevance feedback mechanism for content-based image retrieval , 1999, Inf. Process. Manag..

[12]  Christos Faloutsos,et al.  MindReader: Querying Databases Through Multiple Examples , 1998, VLDB.

[13]  TorralbaAntonio,et al.  Modeling the Shape of the Scene , 2001 .

[14]  Jing Peng,et al.  Improving image retrieval performance by inter-query learning with one-class support vector machines , 2004, Neural Computing & Applications.

[15]  Guillermo Ayala,et al.  A novel Bayesian framework for relevance feedback in image content-based retrieval systems , 2006, Pattern Recognit..

[16]  Ana M. García-Serrano,et al.  Multimedia Information Retrieval Based on Late Semantic Fusion Approaches: Experiments on a Wikipedia Image Collection , 2013, IEEE Transactions on Multimedia.

[17]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[18]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[19]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[20]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[22]  Esther de Ves,et al.  Modeling user preferences in content-based image retrieval: A novel attempt to bridge the semantic gap , 2015, Neurocomputing.

[23]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[24]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[25]  Esther de Ves,et al.  Applying logistic regression to relevance feedback in image retrieval systems , 2007, Pattern Recognit..

[26]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[27]  Adrian Popescu,et al.  Overview of the Wikipedia Image Retrieval Task at ImageCLEF 2011 , 2011, CLEF.

[28]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[29]  Kamal Jamshidi,et al.  A semantic model for general purpose content-based image retrieval systems , 2014, Comput. Electr. Eng..

[30]  Hermann Ney,et al.  Features for image retrieval: an experimental comparison , 2008, Information Retrieval.

[31]  Thomas S. Huang,et al.  Small sample learning during multimedia retrieval using BiasMap , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[32]  J. CoxI.,et al.  The Bayesian image retrieval system, PicHunter , 2000 .

[33]  Yiannis S. Boutalis,et al.  CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval , 2008, ICVS.

[34]  Ana M. García-Serrano,et al.  Multimodal Information Approaches for the Wikipedia Collection at ImageCLEF 2011 , 2011, CLEF.

[35]  NeyHermann,et al.  Features for image retrieval , 2008 .

[36]  Arnold W. M. Smeulders,et al.  The PicToSeek WWW image search system , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[37]  Muhammad Jawad Hussain,et al.  Complementary semantic model for content-based image retrieval , 2014, 2014 11th International Computer Conference on Wavelet Actiev Media Technology and Information Processing(ICCWAMTIP).