Local Parallel Cross Pattern: A Color Texture Descriptor for Image Retrieval

Riding the wave of visual sensor equipment (e.g., personal smartphones, home security cameras, vehicle cameras, and camcorders), image retrieval (IR) technology has received increasing attention due to its potential applications in e-commerce, visual surveillance, and intelligent traffic. However, determining how to design an effective feature descriptor has been proven to be the main bottleneck for retrieving a set of images of interest. In this paper, we first construct a six-layer color quantizer to extract a color map. Then, motivated by the human visual system, we design a local parallel cross pattern (LPCP) in which the local binary pattern (LBP) map is amalgamated with the color map in “parallel” and “cross” manners. Finally, to reduce the computational complexity and improve the robustness to image rotation, the LPCP is extended to the uniform local parallel cross pattern (ULPCP) and the rotation-invariant local parallel cross pattern (RILPCP), respectively. Extensive experiments are performed on eight benchmark datasets. The experimental results validate the effectiveness, efficiency, robustness, and computational complexity of the proposed descriptors against eight state-of-the-art color texture descriptors to produce an in-depth comparison. Additionally, compared with a series of Convolutional Neural Network (CNN)-based models, the proposed descriptors still achieve competitive results.

[1]  Alexander Kolesnikov,et al.  Estimating the number of clusters in a numerical data set via quantization error modeling , 2015, Pattern Recognit..

[2]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Manuel Fernández Delgado,et al.  Influence of normalization and color space to color texture classification , 2017, Pattern Recognit..

[4]  Jun Wu,et al.  Fusion framework for color image retrieval based on bag-of-words model and color local Haar binary patterns , 2016, J. Electronic Imaging.

[5]  Jianzhong Wang,et al.  Unsupervised feature selection by regularized matrix factorization , 2018, Neurocomputing.

[6]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[7]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[8]  Ying Wei,et al.  Hybrid Histogram Descriptor: A Fusion Feature Representation for Image Retrieval , 2018, Sensors.

[9]  Jianzhong Wang,et al.  Ordinal preserving matrix factorization for unsupervised feature selection , 2018, Signal Process. Image Commun..

[10]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[11]  Paolo Napoletano,et al.  Hand-Crafted vs Learned Descriptors for Color Texture Classification , 2017, CCIW.

[12]  Xudong Jiang,et al.  Noise-Resistant Local Binary Pattern With an Embedded Error-Correction Mechanism , 2013, IEEE Transactions on Image Processing.

[13]  M. Pietikäinen,et al.  TEXTURE ANALYSIS WITH LOCAL BINARY PATTERNS , 2004 .

[14]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[15]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[16]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[17]  Wei Song,et al.  Efficient Retrieval of Massive Ocean Remote Sensing Images via a Cloud-Based Mean-Shift Algorithm , 2017, Sensors.

[18]  Jiri Matas,et al.  Total recall II: Query expansion revisited , 2011, CVPR 2011.

[19]  Ming Yang,et al.  Query Specific Rank Fusion for Image Retrieval , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Paolo Napoletano,et al.  Evaluating color texture descriptors under large variations of controlled lighting conditions , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[22]  R. Balasubramanian,et al.  Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking , 2012, Signal Process..

[23]  Chandan Singh,et al.  Enhancing color image retrieval performance with feature fusion and non-linear support vector machine classifier , 2018 .

[24]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[25]  Jun Wu,et al.  Perceptual uniform descriptor and ranking on manifold for image retrieval , 2018, Inf. Sci..

[26]  Marcos X. Álvarez-Cid,et al.  Texture Description Through Histograms of Equivalent Patterns , 2012, Journal of Mathematical Imaging and Vision.

[27]  I. Jeena Jacob,et al.  Local Oppugnant Color Texture Pattern for image retrieval system , 2014, Pattern Recognit. Lett..

[28]  Mateu Sbert,et al.  Pairwise Cross Pattern: A Color-LBP Descriptor for Content-Based Image Retrieval , 2018, PCM.

[29]  Susan Standring PhD DSc Gray's Anatomy: The Anatomical Basis of Clinical Practice , 2005 .

[30]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[32]  Lei Zhang,et al.  Image retrieval based on micro-structure descriptor , 2011, Pattern Recognit..

[33]  Alireza Mehri Dehnavi,et al.  Nucleus and cytoplasm segmentation in microscopic images using K-means clustering and region growing , 2015, Advanced biomedical research.

[34]  Matti Pietikäinen,et al.  Rotation-invariant texture classification using feature distributions , 2000, Pattern Recognit..

[35]  Francesco Bianconi,et al.  Counting local n-ary patterns , 2019, Pattern Recognit. Lett..

[36]  Hua Lee,et al.  Image retrieval using indexed histogram of Void-and-Cluster Block Truncation Coding , 2016, Signal Process..

[37]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Jianzhong Wang,et al.  Adaptive multiple graph regularized semi-supervised extreme learning machine , 2018, Soft Comput..

[39]  Shiv Ram Dubey,et al.  Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval , 2016, IEEE Transactions on Image Processing.

[40]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[41]  Giorgio Giacinto,et al.  Information fusion in content based image retrieval: A comprehensive overview , 2017, Inf. Fusion.

[42]  Jianzhong Wang,et al.  A novel image retrieval method based on hybrid information descriptors , 2014, J. Vis. Commun. Image Represent..

[43]  Paolo Napoletano,et al.  Improved opponent color local binary patterns: an effective local image descriptor for color texture classification , 2017, J. Electronic Imaging.

[44]  Yuqi Chen,et al.  Semi-Supervised Ridge Regression with Adaptive Graph-Based Label Propagation , 2018, Applied Sciences.

[45]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[46]  Matti Pietikäinen,et al.  From BoW to CNN: Two Decades of Texture Representation for Texture Classification , 2018, International Journal of Computer Vision.