A novel long-term learning algorithm for relevance feedback in content-based image retrieval

Relevance feedback has proven to be a powerful tool to bridge the semantic gap between low-level features and high-level human concepts in content-based image retrieval (CBIR). However, traditional short-term relevance feedback technologies are confined to using the current feedback record only. Log-based long-term learning captures the semantic relationships among images in a database by analyzing the historical relevance information to boost the retrieval performance effectively. In this paper, we propose an expanded-judging model to analyze the historical log data’s semantic information and to expand the feedback sample set from both positive and negative relevant information. The index table is used to facilitate the log analysis. The expanded-judging model is applied in image retrieval by combining with short-term relevance feedback algorithms. Experiments were carried out to evaluate the proposed algorithm based on the Corel image database. The promising experimental results validate the effectiveness of our proposed expanded-judging model.

[1]  Rong Jin,et al.  A unified log-based relevance feedback scheme for image retrieval , 2006 .

[2]  Zahra Shoaie,et al.  Semantic image retrieval using relevance feedback and reinforcement learning algorithm , 2010, 2010 5th International Symposium On I/V Communications and Mobile Network.

[3]  Liang Zhang,et al.  A relevance feedback method in image retrieval by analyzing feedback log file , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[4]  Fabio Roli,et al.  Bayesian relevance feedback for content-based image retrieval , 2004, Pattern Recognit..

[5]  Hamid Reza Pourreza,et al.  A New Approach for Interactive Image Retrieval Based on Fuzzy Feedback and Support Vector Machine , 2008, 2008 International Conference on Computational Intelligence for Modelling Control & Automation.

[6]  Neamat El Gayar,et al.  A new approach in content-based image retrieval using fuzzy , 2009, Telecommun. Syst..

[7]  Sharad Mehrotra,et al.  Query reformulation for content based multimedia retrieval in MARS , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[8]  Wei Liu,et al.  Semi-supervised distance metric learning for Collaborative Image Retrieval , 2008, CVPR.

[9]  T.S. Huang,et al.  A relevance feedback architecture for content-based multimedia information retrieval systems , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[10]  José Alfredo Ferreira Costa,et al.  The Semantic Clustering of Images and Its Relation with Low Level Color Features , 2008, 2008 IEEE International Conference on Semantic Computing.

[11]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[12]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[13]  Xiaojun Qi,et al.  A fuzzy combined learning approach to content-based image retrieval , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[14]  Qiang Yang,et al.  A unified framework for semantics and feature based relevance feedback in image retrieval systems , 2000, ACM Multimedia.

[15]  Xiaojun Qi,et al.  Inter-query semantic learning approach to image retrieval , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Wei-Ying Ma,et al.  Learning an image manifold for retrieval , 2004, MULTIMEDIA '04.

[17]  Marina Ivasic-Kos,et al.  The analysis and overview of semantic image interpretation , 2009, Proceedings of the ITI 2009 31st International Conference on Information Technology Interfaces.

[18]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[19]  Kui Wu,et al.  A soft relevance framework in content-based image retrieval systems , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[21]  Nam Chul Kim,et al.  Content-Based Image Retrieval Using Multiresolution Color and Texture Features , 2008, IEEE Transactions on Multimedia.

[22]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[23]  Xiaojun Qi,et al.  A retrieval pattern-based inter-query learning approach for content-based image retrieval , 2010, 2010 IEEE International Conference on Image Processing.

[24]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[25]  Jie Zhang,et al.  A Long-Term Learning Algorithm in CBIR Based on Log-Analyzing , 2009, 2009 International Conference on Management and Service Science.

[26]  Mingjing Li,et al.  A statistical correlation model for image retrieval , 2001, MULTIMEDIA '01.

[27]  Shyi-Ming Chen,et al.  A new method for fuzzy information retrieval based on fuzzy hierarchical clustering and fuzzy inference techniques , 2005, IEEE Transactions on Fuzzy Systems.

[28]  Bing Wang,et al.  Image Retrieval using Long Term Learning Relevance Feedback , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[29]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[30]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[31]  Richa Singh,et al.  Integrating SVM classification with SVD watermarking for intelligent video authentication , 2009, Telecommun. Syst..

[32]  Steve McLaughlin,et al.  Comparative study of textural analysis techniques to characterise tissue from intravascular ultrasound , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[33]  Jake K. Aggarwal,et al.  CIRES: a system for content-based retrieval in digital image libraries , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..