Effective image retrieval techniques based on novel salient region segmentation and relevance feedback

This paper proposes an effective region-based image retrieval technique based on novel salient region segmentation and relevance feedback. With a good and fast segmentation technique, our system achieves an on-the-fly segmentation capability, which enables users to select particular regions for matching and feedbacks without waiting for image segmentation. Therefore, we adopt a relatively simple feedback schemes to derive the intent of the user. The experimental results show that the system performance is greatly improved with this capability. Furthermore, a Quick-match algorithm is also presented in this paper. The mechanism of the Quick-match algorithm is to exclude from distance computation regions that are of low possibility to be the top-Mmatches. This algorithm excludes most of regions from distance computation and therefore greatly cuts down the turnaround time of the retrieval with slightly degradation of precision.

[1]  Qionghai Dai,et al.  Multilabel Neighborhood Propagation for Region-Based Image Retrieval , 2008, IEEE Transactions on Multimedia.

[2]  Tom Minka,et al.  Modeling user subjectivity in image libraries , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[3]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[4]  Shiuh-Ku Weng,et al.  Color Texture Segmentation Using Color Transform and Feature Distributions , 2007, IEICE Trans. Inf. Syst..

[5]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[6]  James Ze Wang,et al.  Wavelet-based image indexing techniques with partial sketch retrieval capability , 1997, Proceedings of ADL '97 Forum on Research and Technology. Advances in Digital Libraries.

[7]  C.-Y. Li,et al.  Relevance feedback using generalized Bayesian framework with region-based optimization learning , 2005, IEEE Transactions on Image Processing.

[8]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[9]  Alexander Dimai.  Unsupervised extraction of salient region-descriptors for content based image retrieval , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[10]  David R. Bull,et al.  Combined morphological-spectral unsupervised image segmentation , 2005, IEEE Transactions on Image Processing.

[11]  David Hutchison,et al.  Semantic Image Retrieval Using Region-Based Relevance Feedback , 2006, Adaptive Multimedia Retrieval.

[12]  Hong-Jiang Zhang,et al.  An efficient and effective region-based image retrieval framework , 2004, IEEE Transactions on Image Processing.

[13]  Yi-Ping Hung,et al.  Region-based image retrieval using color-size features of watershed regions , 2009, J. Vis. Commun. Image Represent..

[14]  Bo Zhang,et al.  Relevance feedback in region-based image retrieval , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Chiou-Ting Hsu,et al.  Image retrieval with relevance feedback based on graph-theoretic region correspondence estimation , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[16]  Roberto Brunelli,et al.  Image Retrieval by Examples , 2000, IEEE Trans. Multim..

[17]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[18]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[19]  Hae-Kwang Kim,et al.  Region-based shape descriptor invariant to rotation, scale and translation , 2000, Signal Process. Image Commun..

[20]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Toshikazu Kato,et al.  Learning of personal visual impression for image database systems , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[22]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[23]  Eric J. Pauwels,et al.  Finding Salient Regions in Images: Nonparametric Clustering for Image Segmentation and Grouping , 1999, Comput. Vis. Image Underst..

[24]  Hyeran Byun,et al.  FRIP: a region-based image retrieval tool using automatic image segmentation and stepwise Boolean AND matching , 2005, IEEE Transactions on Multimedia.

[25]  Bruce G. Batchelor,et al.  Edge-Region-Based Segmentation of Range Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Matti Pietikäinen,et al.  Unsupervised texture segmentation using feature distributions , 1997, Pattern Recognit..

[27]  Nai-Chung Yang,et al.  Color-Based Image Salient Region Segmentation Using Novel Region Merging Strategy , 2008, IEEE Transactions on Multimedia.

[28]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[29]  Wei-Han Chang,et al.  A fast MPEG-7 dominant color extraction with new similarity measure for image retrieval , 2008, J. Vis. Commun. Image Represent..