Content based image retrieval based on relative locations of multiple regions of interest using selective regions matching

In this study, a novel technique for image retrieval based on selective regions matching using region codes is presented. All images in the database are uniformly divided into multiple regions and each region is assigned a 4-bit region code based upon its location relative to the central region. Dominant color and Local Binary Pattern (LBP) based texture features are extracted from these regions. Feature vectors together with their region codes are stored and indexed in the database. During retrieval, feature vectors of regions having region codes similar to the query image region are used for comparison. To reflect the user's intent in query formulation in a better way, an effective technique for Region of Interest (ROI) overlapping block selection is also proposed. Region codes are further used to find relative locations of multiple ROIs in query and target images. The performance of the proposed approach is tested on the MPEG-7 CCD database and Corel image database. Experimental results show that the proposed approach increases the accuracy and reduces image retrieval time.

[1]  Jiebo Luo,et al.  Color object detection using spatial-color joint probability functions , 2004, IEEE Transactions on Image Processing.

[2]  Kien A. Hua,et al.  Image Retrieval Based on Regions of Interest , 2003, IEEE Trans. Knowl. Data Eng..

[3]  André Ricardo Backes,et al.  Texture analysis and classification: A complex network-based approach , 2013, Inf. Sci..

[4]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[5]  J. Nang,et al.  Content-Based Image Retrieval Method using the Relative Location of Multiple ROIs , 2011 .

[6]  Kanad K. Biswas,et al.  Region-based image retrieval using integrated color, shape, and location index , 2004, Comput. Vis. Image Underst..

[7]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[8]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Yo-Ping Huang,et al.  An Efficient and Flexible Matching Strategy for Content-based Image Retrieval , 2010 .

[10]  Lei Zhang,et al.  Image retrieval based on micro-structure descriptor , 2011, Pattern Recognit..

[11]  Natalia Vassilieva.  Content-based image retrieval methods , 2009, Programming and Computer Software.

[12]  Xingyuan Wang,et al.  A novel method for image retrieval based on structure elements' descriptor , 2013, J. Vis. Commun. Image Represent..

[13]  Pradnya A. Vikhar.  Content-Based Image Retrieval (CBIR): State-of-the-Art and Future Scope for Research , 2010 .

[14]  Rung Ching Chen,et al.  A ROI image retrieval method based on CVAAO , 2008, Image Vis. Comput..

[15]  Özgür Ulusoy,et al.  Bilvideo-7: an MPEG-7- compatible video indexing and retrieval system , 2010 .

[16]  Rong-Tai Chen,et al.  A smart content-based image retrieval system based on color and texture feature , 2009, Image Vis. Comput..

[17]  Raimondo Schettini,et al.  Halfway through the semantic gap: Prosemantic features for image retrieval , 2011, Inf. Sci..

[18]  Runsheng Wang,et al.  Local multiple patterns based multiresolution gray-scale and rotation invariant texture classification , 2012, Inf. Sci..

[19]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  V. Tyagi,et al.  Multistage content-based image retrieval , 2012, 2012 CSI Sixth International Conference on Software Engineering (CONSEG).

[21]  Chien-Hsing Chou,et al.  Short Papers , 2001 .

[22]  M. Pauline Baker,et al.  Computer graphics with OpenGL , 1986 .

[23]  Xiangyang Wang,et al.  An effective image retrieval scheme using color, texture and shape features , 2011, Comput. Stand. Interfaces.

[24]  Qi Tian,et al.  Combine user defined region-of-interest and spatial layout for image retrieval , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[25]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[27]  Lai-Man Po,et al.  MIRROR: an interactive content based image retrieval system , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[28]  Kai-Kuang Ma,et al.  Colour Image Indexing Using SOM for Region-of-Interest Retrieval , 1999, Pattern Analysis & Applications.

[29]  Seok-Wun Ha,et al.  ROI Based Natural Image Retrieval Using Color and Texture Feature , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[30]  Jane You,et al.  Visual query processing for efficient image retrieval using a SOM-based filter-refinement scheme , 2012, Inf. Sci..

[31]  Henning Biermann,et al.  Regions-of-Interest and Spatial Layout for Content-Based Image Retrieval , 2001, Multimedia Tools and Applications.

[32]  Chaobing Huang,et al.  Regions of interest extraction from color image based on visual saliency , 2011, The Journal of Supercomputing.

[33]  Özgür Ulusoy,et al.  A histogram-based approach for object-based query-by-shape-and-color in image and video databases , 2005, Image Vis. Comput..