Content-based image retrieval for categorized dataset by aggregating gradient and texture features

Content-based image retrieval is the process of retrieving images similar to the Query Image. The task of finding the dissimilarity among the different objects is the primary challenge in the content-based retrieval system. The challenge increases when the dissimilarity among similar objects is less. For instance, retrieving sunflowers from the dataset having different types of objects (i.e., the uncategorized dataset) like faces, rose, ball, mountains, etc. is a challenging task but what if the sunflowers are to be retrieved from the dataset having flowers only (i.e., the categorized dataset)? Such scenarios make content-based image retrieval more challenging because now the objects are very much similar to each other (categorized) and finding dissimilarity among them is a difficult task. In the state-of-the-art approaches, much work has been done on uncategorized data as compared to categorized one. The present paper proposes an image retrieval approach out of the objects of the same category as of Query Image. Gradient and texture features have been used for the retrieval of images out of the objects of the same category. The Proposed Approach has been applied to various categories of objects like flowers (roses, lily, sunflower), toys (cars, bears, frogs), dogs (Dalmatian, Pomeranian), etc. The Proposed Approach outperforms the state-of-the-art approaches by obtaining an average accuracy of 90 $$\%$$ % .

[1]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[2]  James Ze Wang,et al.  Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  John L. Spouge,et al.  Threshold Average Precision (TAP-k): a measure of retrieval designed for bioinformatics , 2010, Bioinform..

[4]  B. S. Manjunath,et al.  An efficient color representation for image retrieval , 2001, IEEE Trans. Image Process..

[5]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Amjad Rehman,et al.  Content-based image retrieval: a deep look at features prospectus , 2019, Int. J. Comput. Vis. Robotics.

[7]  Subrahmanyam Murala,et al.  Local energy oriented pattern for image indexing and retrieval , 2019, J. Vis. Commun. Image Represent..

[8]  Yong-Hwan Lee,et al.  Efficient image retrieval using advanced SURF and DCD on mobile platform , 2014, Multimedia Tools and Applications.

[9]  Jing Li,et al.  Deep Learning Using Symmetry, FAST Scores, Shape-Based Filtering and Spatial Mapping Integrated with CNN for Large Scale Image Retrieval , 2020, Symmetry.

[10]  Jianying Hu,et al.  Matching and retrieval based on the vocabulary and grammar of color patterns , 2000, IEEE Trans. Image Process..

[11]  Jian-Ping Li,et al.  GEO matching regions: multiple regions of interests using content based image retrieval based on relative locations , 2017, Multimedia Tools and Applications.

[12]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Alberto Del Bimbo,et al.  Image retrieval by color semantics , 1999, Multimedia Systems.

[14]  Noureddine Abbadeni,et al.  Computational Perceptual Features for Texture Representation and Retrieval , 2011, IEEE Transactions on Image Processing.

[15]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.