A novel image retrieval based on rectangular spatial histograms of visual words

Content-based image retrieval (CBIR) provides a solution to search the images that are similar to a query image. From last few years, the bag-of-visual-words (BoVW) model gained significance and improved the performance of CBIR. In a standard BoVW model, an image is represented as an order-less histogram of visual words, by ignoring the spatial layout of the image. The spatial layout carries significant information that can enhance the image retrieval accuracy. In this paper, we present a novel method of image representation, which is based on the construction of histograms over two rectangular regions of an image. Division of the image into two rectangular regions at the time of construction of histograms adds the spatial information to the BoVW model. The proposed image representation uses separate visual words for upper and lower rectangular regions of an image. The experimental analysis carriedout on two image datasets validates that the proposed image representation based on the division of an image into histograms of rectangles increases the performance of image retrieval.

[1]  Luc Van Gool,et al.  Wide Baseline Stereo Matching based on Local, Affinely Invariant Regions , 2000, BMVC.

[2]  Andrew Zisserman,et al.  An Affine Invariant Salient Region Detector , 2004, ECCV.

[3]  Haibing Wang,et al.  Image retrieval using spatiograms of colors quantized by Gaussian Mixture Models , 2016, Neurocomputing.

[4]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[5]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[6]  Reda Alhajj,et al.  Efficient content-based image retrieval using Multiple Support Vector Machines Ensemble , 2012, Expert Syst. Appl..

[7]  Zahid Mehmood,et al.  A Novel Image Retrieval Based on a Combination of Local and Global Histograms of Visual Words , 2016 .

[8]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[9]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[10]  Zahid Mehmood,et al.  A survey on block based copy move image forgery detection techniques , 2015, 2015 International Conference on Emerging Technologies (ICET).

[11]  Lihi Zelnik-Manor,et al.  On SIFTs and their scales , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Zahid Mehmood,et al.  Copy-move forgery detection through stationary wavelets and local binary pattern variance for forensic analysis in digital images. , 2017, Forensic science international.

[14]  Cécile Barat,et al.  Spatial orientations of visual word pairs to improve Bag-of-Visual-Words model , 2012, BMVC.

[15]  Simon C. K. Shiu,et al.  Effective texture classification by texton encoding induced statistical features , 2015, Pattern Recognit..

[16]  Yen-Jen Chang,et al.  Fast color-spatial feature based image retrieval methods , 2011, Expert Syst. Appl..

[17]  Zahid Mehmood,et al.  An efficient forensic technique for exposing region duplication forgery in digital images , 2017, Applied Intelligence.

[18]  Zahid Mehmood,et al.  Image retrieval by addition of spatial information based on histograms of triangular regions , 2016, Comput. Electr. Eng..

[19]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Baochang Zhang,et al.  Spatial Weighting for Bag-of-Features Based Image Retrieval , 2013, IUKM.

[21]  Luiz Antônio Pereira Neves,et al.  Iterative Technique for Content-Based Image Retrieval using Multiple SVM Ensembles , 2013 .

[22]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[23]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[24]  Md. Monirul Islam,et al.  A review on automatic image annotation techniques , 2012, Pattern Recognit..

[25]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[26]  Licheng Jiao,et al.  Feature integration of EODH and Color-SIFT: Application to image retrieval based on codebook , 2014, Signal Process. Image Commun..

[27]  Khairullah Khan,et al.  Pattern and semantic analysis to improve unsupervised techniques for opinion target identification , 2016 .

[28]  Stéphane Herbin,et al.  Semantic hierarchies for image annotation: A survey , 2012, Pattern Recognit..

[29]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[30]  Bertrand Zavidovique,et al.  Content based image retrieval using motif cooccurrence matrix , 2004, Image Vis. Comput..

[31]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[32]  Dunja Mladenic,et al.  Image Hub Explorer: Evaluating Representations and Metrics for Content-Based Image Retrieval and Object Recognition , 2013, ECML/PKDD.

[33]  Shiv Ram Dubey,et al.  Rotation and scale invariant hybrid image descriptor and retrieval , 2015, Comput. Electr. Eng..

[34]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[35]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[36]  Zahid Mehmood,et al.  Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine , 2017, Applied Intelligence.

[37]  Kazuhiro Fukui,et al.  Feature Extraction Based on Co-occurrence of Adjacent Local Binary Patterns , 2011, PSIVT.

[38]  Andrew Zisserman,et al.  Sparse kernel approximations for efficient classification and detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  G. Wiselin Jiji,et al.  Content-based image retrieval techniques for the analysis of dermatological lesions using particle swarm optimization technique , 2015, Appl. Soft Comput..