Hybrid Histogram Descriptor: A Fusion Feature Representation for Image Retrieval

Currently, visual sensors are becoming increasingly affordable and fashionable, acceleratingly the increasing number of image data. Image retrieval has attracted increasing interest due to space exploration, industrial, and biomedical applications. Nevertheless, designing effective feature representation is acknowledged as a hard yet fundamental issue. This paper presents a fusion feature representation called a hybrid histogram descriptor (HHD) for image retrieval. The proposed descriptor comprises two histograms jointly: a perceptually uniform histogram which is extracted by exploiting the color and edge orientation information in perceptually uniform regions; and a motif co-occurrence histogram which is acquired by calculating the probability of a pair of motif patterns. To evaluate the performance, we benchmarked the proposed descriptor on RSSCN7, AID, Outex-00013, Outex-00014 and ETHZ-53 datasets. Experimental results suggest that the proposed descriptor is more effective and robust than ten recent fusion-based descriptors under the content-based image retrieval framework. The computational complexity was also analyzed to give an in-depth evaluation. Furthermore, compared with the state-of-the-art convolutional neural network (CNN)-based descriptors, the proposed descriptor also achieves comparable performance, but does not require any training process.

[1]  Olivier Alata,et al.  Choice of a pertinent color space for color texture characterization using parametric spectral analysis , 2011, Pattern Recognit..

[2]  W. Köhler.  Gestalt psychology , 1967 .

[3]  Paolo Napoletano,et al.  Hand-Crafted vs Learned Descriptors for Color Texture Classification , 2017, CCIW.

[4]  Xiang Li,et al.  A Novel Tiny Object Recognition Algorithm Based on Unit Statistical Curvature Feature , 2016, ECCV.

[5]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Shiv Ram Dubey,et al.  Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval , 2016, IEEE Transactions on Image Processing.

[7]  Sukadev Meher,et al.  Detection of Moving Objects Using Fuzzy Color Difference Histogram Based Background Subtraction , 2016, IEEE Signal Processing Letters.

[8]  Changxin Gao,et al.  LEDTD: Local edge direction and texture descriptor for face recognition , 2016, Signal Process. Image Commun..

[9]  Subrahmanyam Murala,et al.  Joint histogram between color and local extrema patterns for object tracking , 2013, Electronic Imaging.

[10]  David Zhang,et al.  Robust Object Tracking Using Joint Color-Texture Histogram , 2009, Int. J. Pattern Recognit. Artif. Intell..

[11]  Yongsheng Zhao,et al.  A varied local edge pattern descriptor and its application to texture classification , 2016, J. Vis. Commun. Image Represent..

[12]  Qiong Song,et al.  High dynamic range infrared images detail enhancement based on local edge preserving filter , 2016 .

[13]  Paolo Napoletano,et al.  Evaluating color texture descriptors under large variations of controlled lighting conditions , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[15]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[16]  Bertrand Zavidovique,et al.  Content based image retrieval using motif cooccurrence matrix , 2004, Image Vis. Comput..

[17]  Charles R. Giardina,et al.  Elliptic Fourier features of a closed contour , 1982, Comput. Graph. Image Process..

[18]  Hua Lee,et al.  Image retrieval using indexed histogram of Void-and-Cluster Block Truncation Coding , 2016, Signal Process..

[19]  Jianzhong Wang,et al.  A novel image retrieval method based on hybrid information descriptors , 2014, J. Vis. Commun. Image Represent..

[20]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[21]  Giorgio Giacinto,et al.  Information fusion in content based image retrieval: A comprehensive overview , 2017, Inf. Fusion.

[22]  Raveendran Paramesran,et al.  Image Analysis Using Hahn Moments , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Subrahmanyam Murala,et al.  Local extrema co-occurrence pattern for color and texture image retrieval , 2015, Neurocomputing.

[24]  Lei Zhang,et al.  Image retrieval based on micro-structure descriptor , 2011, Pattern Recognit..

[25]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[26]  Alireza Mehri Dehnavi,et al.  Nucleus and cytoplasm segmentation in microscopic images using K-means clustering and region growing , 2015, Advanced biomedical research.

[27]  Paolo Napoletano,et al.  Improved opponent color local binary patterns: an effective local image descriptor for color texture classification , 2017, J. Electronic Imaging.

[28]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Haibing Wang,et al.  Image retrieval using spatiograms of colors quantized by Gaussian Mixture Models , 2016, Neurocomputing.

[31]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[32]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[33]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[34]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[35]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[36]  D. Jameson,et al.  An opponent-process theory of color vision. , 1957, Psychological review.

[37]  M. Pietikäinen,et al.  TEXTURE ANALYSIS WITH LOCAL BINARY PATTERNS , 2004 .

[38]  Thomas Young,et al.  II. The Bakerian Lecture. On the theory of light and colours , 1802, Philosophical Transactions of the Royal Society of London.

[39]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[40]  Alberto Del Bimbo,et al.  Visual Querying By Color Perceptive Regions , 1998, Pattern Recognit..

[41]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[43]  Moon-Chuen Lee,et al.  Video Segmentation Using Color Difference Histogram , 1998, Multimedia Information Analysis and Retrieval.

[44]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Anu Bala,et al.  Local texton XOR patterns: A new feature descriptor for content-based image retrieval , 2016 .

[46]  Wei Song,et al.  Efficient Retrieval of Massive Ocean Remote Sensing Images via a Cloud-Based Mean-Shift Algorithm , 2017, Sensors.

[47]  C. Won,et al.  Efficient Use of MPEG‐7 Edge Histogram Descriptor , 2002 .

[48]  Paul Southam,et al.  Theoretical and experimental comparison of different approaches for color texture classification , 2011, J. Electronic Imaging.