Local Neighborhood Intensity Pattern: A new texture feature descriptor for image retrieval

Abstract In this paper, a new texture descriptor based on the local neighborhood intensity difference is proposed for content based image retrieval (CBIR). For computation of texture features like Local Binary Pattern (LBP), the center pixel in a 3 × 3 window of an image is compared with all the remaining neighbors, one pixel at a time to generate a binary bit pattern. It ignores the effect of the adjacent neighbors of a particular pixel for its binary encoding and also for texture description. The proposed method is based on the concept that neighbors of a particular pixel hold significant amount of texture information that can be considered for efficient texture representation for CBIR. The main impact of utilizing the mutual relationship among adjacent neighbors is that we do not rely on the sign of the intensity difference between central pixel and one of its neighbors (Ii) only, rather we take into account the sign of difference values between Ii and its adjacent neighbors along with the central pixels and same set of neighbors of Ii. This makes our pattern more resistant to illumination changes. Moreover, most of the local patterns including LBP concentrates mainly on the sign information and thus ignores the magnitude. The magnitude information which plays an auxiliary role to supply complementary information of texture descriptor, is integrated in our approach by considering the mean of absolute deviation about each pixel Ii from its adjacent neighbors. Taking this into account, we develop a new texture descriptor, named as Local Neighborhood Intensity Pattern (LNIP) which considers the relative intensity difference between a particular pixel and the center pixel by considering its adjacent neighbors and generate a sign and a magnitude pattern. Finally, the sign pattern (LNIPS) and the magnitude pattern (LNIPM) are concatenated into a single feature descriptor to generate a more effective feature descriptor. The proposed descriptor has been tested for image retrieval on four databases, including three texture image databases - Brodatz texture image database, MIT VisTex database and Salzburg texture database and one face database - AT&T face database. The precision and recall values observed on these databases are compared with some state-of-art local patterns. The proposed method showed a significant improvement over many other existing methods.

[1]  Subrahmanyam Murala,et al.  Peak Valley Edge Patterns: A New Descriptor for Biomedical Image Indexing and Retrieval , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Shiv Ram Dubey,et al.  Local Bit-Plane Decoded Pattern: A Novel Feature Descriptor for Biomedical Image Retrieval , 2016, IEEE Journal of Biomedical and Health Informatics.

[3]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Shu-Yuan Chen,et al.  Retrieval of translated, rotated and scaled color textures , 2003, Pattern Recognit..

[5]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[6]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[7]  Dimitris E. Koulouriotis,et al.  Moment-based local binary patterns: A novel descriptor for invariant pattern recognition applications , 2013, Neurocomputing.

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  P.K. Biswas,et al.  Rotation-Invariant Texture Image Retrieval Using Rotated Complex Wavelet Filters , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Loris Nanni,et al.  Local binary patterns variants as texture descriptors for medical image analysis , 2010, Artif. Intell. Medicine.

[11]  Agma J. M. Traina,et al.  Retrieval by content of medical images using texture for tissue identification , 2003, 16th IEEE Symposium Computer-Based Medical Systems, 2003. Proceedings..

[12]  Yaniv Taigman,et al.  Descriptor Based Methods in the Wild , 2008 .

[13]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[14]  Shu Liao,et al.  Dominant Local Binary Patterns for Texture Classification , 2009, IEEE Transactions on Image Processing.

[15]  Guoliang Fan,et al.  Improved Local Ternary Patterns for Automatic Target Recognition in Infrared Imagery , 2015, Sensors.

[16]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[17]  Saliha Aouat,et al.  A New Texture Analysis Approach for Iris Recognition , 2014 .

[18]  Jing Zhang,et al.  Texture-Based Image Retrieval by Edge Detection Matching GLCM , 2008, 2008 10th IEEE International Conference on High Performance Computing and Communications.

[19]  Shengcai Liao,et al.  Learning Multi-scale Block Local Binary Patterns for Face Recognition , 2007, ICB.

[20]  Subrahmanyam Murala,et al.  MRI and CT image indexing and retrieval using local mesh peak valley edge patterns , 2014, Signal Process. Image Commun..

[21]  Shu Liao,et al.  Face Recognition by Using Elongated Local Binary Patterns with Average Maximum Distance Gradient Magnitude , 2007, ACCV.

[22]  Subrahmanyam Murala,et al.  Local Mesh Patterns Versus Local Binary Patterns: Biomedical Image Indexing and Retrieval , 2014, IEEE Journal of Biomedical and Health Informatics.

[23]  Changxin Gao,et al.  Multi-structure local binary patterns for texture classification , 2011, Pattern Analysis and Applications.

[24]  Prabir Kumar Biswas,et al.  Texture image retrieval using rotated wavelet filters , 2007, Pattern Recognit. Lett..

[25]  R. Balasubramanian,et al.  Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking , 2012, Signal Process..

[26]  Henning Müller,et al.  A reference data set for the evaluation of medical image retrieval systems. , 2004, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[27]  Xudong Jiang,et al.  Noise-Resistant Local Binary Pattern With an Embedded Error-Correction Mechanism , 2013, IEEE Transactions on Image Processing.

[28]  Balasubramanian Raman,et al.  Local neighborhood difference pattern: A new feature descriptor for natural and texture image retrieval , 2018, Multimedia Tools and Applications.

[29]  Turgay Çelik,et al.  Multiscale texture classification using dual-tree complex wavelet transform , 2009, Pattern Recognit. Lett..

[30]  Yang Zhao,et al.  Completed Local Binary Count for Rotation Invariant Texture Classification , 2012, IEEE Transactions on Image Processing.

[31]  Balasubramanian Raman,et al.  Center symmetric local binary co-occurrence pattern for texture, face and bio-medical image retrieval , 2015, J. Vis. Commun. Image Represent..

[32]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[33]  Richard Bowden,et al.  Local binary patterns for multi-view facial expression recognition , 2011 .

[34]  Xueming Qian,et al.  PLBP: An effective local binary patterns texture descriptor with pyramid representation , 2011, Pattern Recognit..

[35]  Zhenhua Guo,et al.  Rotation invariant texture classification using LBP variance (LBPV) with global matching , 2010, Pattern Recognit..

[36]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[37]  David Zhang,et al.  Robust Object Tracking Using Joint Color-Texture Histogram , 2009, Int. J. Pattern Recognit. Artif. Intell..

[38]  Balasubramanian Raman,et al.  Local tri-directional patterns: A new texture feature descriptor for image retrieval , 2016, Digit. Signal Process..

[39]  Mounir Sayadi,et al.  A new fuzzy segmentation approach based on S-FCM type 2 using LBP-GCO features , 2012, Signal Process. Image Commun..

[40]  A. Ahmadian,et al.  A texture classification method for diffused liver diseases using Gabor wavelets , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[41]  Yang Zhao,et al.  Completed robust local binary pattern for texture classification , 2013, Neurocomputing.

[42]  Subrahmanyam Murala,et al.  Spherical symmetric 3D local ternary patterns for natural, texture and biomedical image indexing and retrieval , 2015, Neurocomputing.

[43]  Satish Kumar Singh,et al.  Local directional gradient pattern: a local descriptor for face recognition , 2022, Multimedia Tools and Applications.

[44]  Feiniu Yuan,et al.  Video-based smoke detection with histogram sequence of LBP and LBPV pyramids , 2011 .

[45]  I. Jeena Jacob,et al.  Local Oppugnant Color Texture Pattern for image retrieval system , 2014, Pattern Recognit. Lett..

[46]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[47]  Nicu Sebe,et al.  Wavelet-based salient points for image retrieval , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[48]  C. Schmid,et al.  Description of Interest Regions with Center-Symmetric Local Binary Patterns , 2006, ICVGIP.

[49]  P. Reddy,et al.  Content based image indexing and retrieval using directional local extrema and magnitude patterns , 2014 .

[50]  Zhibin Pan,et al.  Feature based local binary pattern for rotation invariant texture classification , 2017, Expert Syst. Appl..

[51]  Subrahmanyam Murala,et al.  Directional local extrema patterns: a new descriptor for content based image retrieval , 2012, International Journal of Multimedia Information Retrieval.