Visual-Based Image Retrieval by Block Reallocation Considering Object Region

Visual-based image retrieval based on the visual similarity over the entire image is very useful when targeting various kinds of large-volume content. This method generally divides an image into grid-shaped blocks and uses similarities based on a comparison of image features between corresponding block regions in two different images. However, the method sometimes fails in terms of object-conscious retrieval when their backgrounds are almost the same but the only object is different or object's positions and/or sizes are different. In this paper, we propose a new method featuring the reallocation of some blocks into the object region (OB-blocks) and the new similarity score with placing weight on the OB-blocks, which are derived from visual saliency map. Our proposed method could realize the "visual-based and object-conscious" image retrieval. We verified the effectiveness of this method through comparison experiments.

[1]  H. Konbor,et al.  Image Retrieval based on Integration between YCbCr Color Histogram and Texture Feature , 2011 .

[2]  Chong-Wah Ngo,et al.  Evaluating bag-of-visual-words representations in scene classification , 2007, MIR '07.

[3]  Gregory D. Hager,et al.  Dynamic Foreground/Background Extraction from Images and Videos using Random Patches , 2006, NIPS.

[4]  Chong-Wah Ngo,et al.  Towards optimal bag-of-features for object categorization and semantic video retrieval , 2007, CIVR '07.

[5]  K. Poulose Jacob,et al.  CBIR Using Local and Global Properties of Image Sub-blocks , 2012 .

[6]  Jau-Ling Shih,et al.  Color Image Retrieval Based on Primitives of Color Moments , 2002, VISUAL.

[7]  Yongdong Zhang,et al.  A method for detecting salient regions using integrated features , 2012, ACM Multimedia.

[8]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[9]  A. Govardhan,et al.  Image Retrieval based on combined features of image sub-blocks , 2011 .

[10]  J. Pujari,et al.  Content Based Image Retrieval based on Color, Texture and Shape features using Image and its complement , 2008 .

[11]  Noboru Ohnishi,et al.  Image segmentation and object extraction based on geometric features of regions , 1998, Electronic Imaging.

[12]  Tamer Mehyar,et al.  An Enhancement on Content-Based Image Retrieval using Color and Texture Features , 2012 .

[13]  Kristen Grauman,et al.  Efficient region search for object detection , 2011, CVPR 2011.

[14]  Rong Jin,et al.  Unsupervised Ensemble Ranking: Application to Large-Scale Image Retrieval , 2010, 2010 20th International Conference on Pattern Recognition.

[15]  B. Prabhakara Rao,et al.  Comparative evaluation , 1996 .

[16]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Sungyoung Kim,et al.  Central Object Extraction for Object-Based Retrieval , 2003, CIVR.

[18]  Qi Tian,et al.  Combine user defined region-of-interest and spatial layout for image retrieval , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[19]  Derek Hoiem,et al.  Object-based image retrieval using the statistical structure of images , 2004, CVPR 2004.

[20]  L.-H. Chen,et al.  Colour image retrieval based on primitives of colour moments , 2002 .