Combining SURF and MSER along with Color Features for Image Retrieval System Based on Bag of Visual Words

Content-Based Image Retrieval (CBIR) has received an extensive attention from researchers due to the rapid growing and widespread of image databases. Despite the massive research efforts consumed for CBIR, the completely satisfactory results have not yet been attained. In this article, we offer a new CBIR technique that relies on extracting Speeded Up Robust Features (SURF) and Maximally Stable Extremal Regions (MSER) feature descriptors as well as the color features; color correlograms and Improved Color Coherence Vector (ICCV). These features are joined and used to build a multidimensional feature vector. Bag-of-Visual-Words (BoVW) technique is utilized to quantize the extracted feature vector. Then, a multiclass Support Vector Machine (SVM) is implemented to classify the query images. The performance of the presented retrieval framework is analyzed and scrutinized by comparing it with three alternative approaches. The first one is based on extracting SURF descriptors while the second one is based on extracting SURF descriptors, color correlograms and ICCV. The third approach, on the other hand, is based on extracting MSER, color correlograms and ICCV. All implemented schemes are tested on two benchmark datasets; Corel-1000 and COIL-100 datasets. The empirical results show that our suggested approach has a superior discriminative classification and retrieval performance with respect to other approaches. The proposed method achieves average precisions of 88 and 93% for the Corel-1000 and COIL-100 datasets, respectively. Moreover, the proposed system has shown a substantial advance in the retrieval precision when compared with other existing systems.

[1]  Shashirekha H Mtech A Novel Approach for Image Retrieval using Combination of Features , 2015 .

[3]  Davar Giveki,et al.  A New Content Based Image Retrieval Model Based on Wavelet Transform , 2015 .

[4]  Niko Sünderhauf,et al.  COMPARING SEVERAL IMPLEMENTATIONS OF TWO RECENTLY PUBLISHED FEATURE DETECTORS , 2007 .

[5]  L Chandrika Implementation Image Retrieval and Classification with SURF Technique , 2014 .

[6]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[7]  Scott Krig,et al.  Interest Point Detector and Feature Descriptor Survey , 2014 .

[8]  Robert Marti,et al.  Which is the best way to organize/classify images by content? , 2007, Image Vis. Comput..

[9]  K.Velmurugan,et al.  Content-Based Image Retrieval using SURF and Colour Moments , 2011 .

[10]  Received January,et al.  A New SIFT-Based Image Descriptor Applicable for Content Based Image Retrieval , 2015 .

[11]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[12]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[13]  Md. Monirul Islam,et al.  A review on automatic image annotation techniques , 2012, Pattern Recognit..

[14]  M. V. Sudhamani,et al.  Object Based Image Retrieval from Database Using Combined Features , 2014, 2014 Fifth International Conference on Signal and Image Processing.

[15]  Luo Juan Multiple Feature Extraction Techniques in Image Stitching , 2015 .

[16]  Abdelkhalak Bahri,et al.  A SURF-COLOR MOMENTS FOR IMAGES RETRIEVAL BASED ON BAG-OF- FEATURES , 2013 .

[17]  Jialu Liu,et al.  Image Retrieval based on Bag-of-Words model , 2013, ArXiv.

[18]  S. Bhuvana,et al.  A NOVEL CONTENT BASED IMAGE RETRIEVAL MODEL BASED ON THE MOST RELEVANT FEATURES USING PARTICLE SWARM OPTIMIZATION , 2013 .

[19]  S. Kodituwakku Comparison of Color Features for Image Retrieval , 2010 .

[20]  P M Panchal,et al.  A Comparison of SIFT and SURF , 2013 .

[21]  Rehan Ashraf,et al.  Content Based Image Retrieval Using Embedded Neural Networks with Bandletized Regions , 2015, Entropy.

[22]  Mukesh Kumar,et al.  A New Image Retrieval System Based on CBIR , 2015 .

[23]  Vipin Tyagi,et al.  Content based image retrieval based on relative locations of multiple regions of interest using selective regions matching , 2014, Inf. Sci..

[24]  Eero Sormunen,et al.  End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive , 2004, Information Retrieval.

[25]  Mussarat Yasmin,et al.  Use of Low Level Features for Content Based Image Retrieval: Survey , 2013 .

[26]  Ahmed Afifi,et al.  Image Retrieval Based on Content Using Color Feature , 2012 .

[27]  Savvas A. Chatzichristofis,et al.  Image moment invariants as local features for content based image retrieval using the Bag-of-Visual-Words model , 2015, Pattern Recognit. Lett..

[28]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[29]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[31]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[32]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Ratika Sharma,et al.  A Survey: Content Based Image Retrieval Based On Color, Texture, Shape & Neuro Fuzzy , 2013 .

[34]  P.K.Bhargavi,et al.  A NOVEL CONTENT BASED IMAGE RETRIEVAL MODEL BASED ON THE MOST RELEVANT FEATURES USING PARTICLE SWARM OPTIMIZATION , 2013 .

[35]  Nourhan Zayed,et al.  Feature Extraction Techniques: Fundamental Concepts and Survey , 2016 .