Query definition using interactive saliency

Content-based image retrieval (CBIR) has been under investigation for a long time with many systems built to meet different application demands. However, in all systems, there is still a big gap between the user's expectation and the system's retrieval capabilities. Therefore, user interaction is an essential component of any CBIR system. Interaction up to now has mostly focused on global image features or similarities. We consider the interaction with salient details in the image i.e. points, lines, and regions. Interactive salient detail definition goes further than automatically summarizing the image into a set of salient details. We aim to dynamically update the user- and context-dependent definition of saliency based on relevance feedback from the user. In this paper, we propose an interaction framework for salient details from the perspective of the user.

[1]  Whoi-Yul Kim,et al.  Content-based trademark retrieval system using a visually salient feature , 1998, Image Vis. Comput..

[2]  Jake K. Aggarwal,et al.  Retrieval by classification of images containing large manmade objects using perceptual grouping , 2002, Pattern Recognit..

[3]  Arnold W. M. Smeulders,et al.  The PicToSeek WWW image search system , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[4]  Whoi-Yul Kim,et al.  Content-based trademark retrieval system using visually salient features , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jean-Michel Jolion,et al.  Detection of Interest Points for Image Indexation , 1999, VISUAL.

[8]  Cordelia Schmid,et al.  Indexing Based on Scale Invariant Interest Points , 2001, ICCV.

[9]  Luigi Cinque,et al.  Matching the resolution level to salient image features , 1998, Pattern Recognit..

[10]  Aleix M. Martínez,et al.  A New Approach to Object-Related Image Retrieval , 2000, J. Vis. Lang. Comput..

[11]  Arnold W. M. Smeulders,et al.  Color texture measurement and segmentation , 2005, Signal Process..

[12]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[13]  Ronen Basri,et al.  Extracting Salient Curves from Images: An Analysis of the Saliency Network , 2004, International Journal of Computer Vision.

[14]  Nicu Sebe,et al.  Content-based image retrieval using wavelet-based salient points , 2000, IS&T/SPIE Electronic Imaging.

[15]  Simone Santini,et al.  Emergent Semantics through Interaction in Image Databases , 2001, IEEE Trans. Knowl. Data Eng..

[16]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[17]  Eric J. Pauwels,et al.  Finding Salient Regions in Images: Nonparametric Clustering for Image Segmentation and Grouping , 1999, Comput. Vis. Image Underst..

[18]  Lance R. Williams,et al.  Segmentation of salient closed contours from real images , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Marcel Worring,et al.  Filter Image Browsing: Interactive Image Retrieval by Using Database Overviews , 2001, Multimedia Tools and Applications.

[20]  Bob J. Wielinga,et al.  Ontology-Based Photo Annotation , 2001, IEEE Intell. Syst..

[21]  Timothy F. Cootes,et al.  Locating Salient Object Features , 1998, BMVC.

[22]  Alexander Dimai.  Unsupervised extraction of salient region-descriptors for content based image retrieval , 1999, Proceedings 10th International Conference on Image Analysis and Processing.