Histogram refinement for texture descriptor based image retrieval

Texture descriptors such as local binary patterns (LBP) have been successfully employed for feature extraction in image retrieval algorithms because of their high discriminating ability and computational efficiency. In this paper, we propose histogram feature refinement methods for enhancing performance of texture descriptor based content-based image retrieval (CBIR) systems. In the proposed approach for histogram refinement, each pixel in the query and database images is classified into one of the two categories based on the analysis of pixel values in its neighborhood. Local patterns corresponding to two sets of pixels are used to generate two histogram features for each image, effectively resulting in splitting of the original global histogram of texture descriptors into two based on the category of each pixel. Resulting histograms are then concatenated to form a single histogram feature. This study also explores three hybrid frameworks for histogram refinement in CBIR systems. Comparison of histogram features corresponding to query and database images are performed using the relative l1 distance metric. Performance evaluation on three publicly available benchmark image databases namely, GHIM 10000, COREL 1000 database, and Brodatz texture database shows that performances of existing texture descriptor based approaches improve considerably when the proposed histogram feature refinement is incorporated. Specifically, the average precision rate is improved by 6.02%, 5.69%, 4.79%, and 4.21% for LBP, local derivative pattern (LDP), local ternary pattern (LTP), and local tetra pattern (LTrP) descriptors, respectively on GHIM 10000 database. The proposed histogram refinement approaches also provide performance improvement for other texture descriptors considered in this study. A general framework for histogram refinement of texture descriptors.Improves retrieval performance of texture descriptor based CBIR systems.Performance improvement in CBIR validated using 9 texture descriptors.Marginal increase in average image retrieval time with 1.2s in the worst case.

[1]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Rong Xiao,et al.  Pairwise Rotation Invariant Co-Occurrence Local Binary Pattern , 2014, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ram Bilas Pachori,et al.  Classification of seizure and seizure-free EEG signals using local binary patterns , 2015, Biomed. Signal Process. Control..

[4]  Balasubramanian Raman,et al.  Local tri-directional patterns: A new texture feature descriptor for image retrieval , 2016, Digit. Signal Process..

[5]  Phil Brodatz.  Land, Sea, and Sky: A Photographic Album for Artists and Designers , 1976 .

[6]  Pod Hyb.  Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[7]  Matti Pietikäinen,et al.  Block-Based Methods for Image Retrieval Using Local Binary Patterns , 2005, SCIA.

[8]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Yilmaz Kaya,et al.  1D-local binary pattern based feature extraction for classification of epileptic EEG signals , 2014, Appl. Math. Comput..

[10]  David G. Stork,et al.  Pattern Classification , 1973 .

[11]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[12]  K. Mardia.  Measures of multivariate skewness and kurtosis with applications , 1970 .

[13]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[14]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[15]  Xudong Jiang,et al.  Relaxed local ternary pattern for face recognition , 2013, 2013 IEEE International Conference on Image Processing.

[16]  Jing-Yu Yang,et al.  Content-based image retrieval using computational visual attention model , 2015, Pattern Recognit..

[17]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[18]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ramin Zabih,et al.  Histogram refinement for content-based image retrieval , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[20]  John J. Soraghan,et al.  1-D Local Binary Patterns for onset detection of myoelectric signals , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[21]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[22]  Xudong Jiang,et al.  Noise-Resistant Local Binary Pattern With an Embedded Error-Correction Mechanism , 2013, IEEE Transactions on Image Processing.

[23]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[24]  Jiri Matas,et al.  Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[25]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[26]  Alberto Del Bimbo,et al.  The Mesh-LBP: A Framework for Extracting Local Binary Patterns From Discrete Manifolds , 2015, IEEE Transactions on Image Processing.

[27]  Stan Z. Li,et al.  Shape localization based on statistical method using extended local binary pattern , 2004, Third International Conference on Image and Graphics (ICIG'04).

[28]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[29]  C.-H. Lin,et al.  IMAGE RETRIEVAL AND CLASSIFICATION USING ADAPTIVE LOCAL BINARY PATTERNS BASED ON TEXTURE FEATURES , 2012 .

[30]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[31]  Zhiyong Wang,et al.  Spatially enhanced local binary pattern , 2012 .

[32]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[33]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[35]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[36]  Matti Pietikäinen,et al.  Rotation Invariant Image Description with Local Binary Pattern Histogram Fourier Features , 2009, SCIA.

[37]  Kuo-Chin Fan,et al.  A Novel Local Pattern Descriptor—Local Vector Pattern in High-Order Derivative Space for Face Recognition , 2014, IEEE Transactions on Image Processing.

[38]  Ram Bilas Pachori,et al.  Classification of seizure and seizure-free EEG signals using multi-level local patterns , 2014, 2014 19th International Conference on Digital Signal Processing.

[39]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Hyun Seung Yang,et al.  Sorted Consecutive Local Binary Pattern for Texture Classification , 2015, IEEE Transactions on Image Processing.