Multidimensional Local Binary Pattern for Hyperspectral Image Classification

For the large amount of spatial and spectral information contained in hyperspectral image (HSI), feature description of HSI has attracted widespread concern in recent years. Existing deep learning-based HSI feature description algorithms require a large number of training samples and have poor interpretability. Therefore, it is necessary to develop an efficient HSI features description algorithm with interpretability based on machine learning. Local binary pattern (LBP) is a classical descriptor used to extract the local spatial texture features of images, which has been widely applied to image feature description and matching. However, the existing LBP algorithms for HSI are based on the single-dimensional description, which leads to the limitations on the expression of spatial–spectral information. Therefore, a multidimensional LBP (MDLBP) based on Clifford algebra for HSI is proposed in this article, which is able to extract spatial–spectral feature from multiple dimensions. First, with the theory of the Clifford algebra, a new representation of HSI including spatial and spectral information is built. Second, the geometric relationship between the local geometry of HSI in Clifford algebra space is calculated to realize the local multidimensional description of the local spatial–spectral information. Finally, a novel LBP coding algorithm for HSI is implemented based on the local multidimensional description to calculate the feature descriptor of HSI. The experimental results on HSI classification show that our proposed MDLBP algorithm can achieve higher accuracy than the representative spatial–spectral features and the existing LBP algorithms, especially in the scenery of small-scale training samples.

[1]  Valeriy Labunets Clifford Algebras as Unified Language for Image Processing and Pattern Recognition , 2004 .

[2]  Gerald Sommer,et al.  On Clifford neurons and Clifford multi-layer perceptrons , 2008, Neural Networks.

[3]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[4]  Deyu Meng,et al.  Integration of 3-dimensional discrete wavelet transform and Markov random field for hyperspectral image classification , 2017, Neurocomputing.

[5]  Feng Gao,et al.  Hyperspectral image classification based on local binary patterns and PCANet , 2018, International Conference on Graphic and Image Processing.

[6]  Wei Shi,et al.  A new framework of hyperspectral image classification based on spatial spectral interest point , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[7]  M. Dewhirst,et al.  Hyperspectral imaging of hemoglobin saturation in tumor microvasculature and tumor hypoxia development. , 2005, Journal of biomedical optics.

[8]  Dimitrios K. Iakovidis,et al.  Fuzzy Local Binary Patterns for Ultrasound Texture Characterization , 2008, ICIAR.

[9]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[10]  H. De Bie,et al.  On the Clifford-Fourier transform , 2010, 1003.0689.

[11]  Lu Zhi,et al.  Convolutional neural networks and local binary patterns for hyperspectral image classification , 2019, European Journal of Remote Sensing.

[12]  Roberto Sarmiento,et al.  Detecting brain tumor in pathological slides using hyperspectral imaging. , 2018, Biomedical optics express.

[13]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[14]  Uzi Vishne,et al.  Clifford algebras of binary homogeneous forms , 2012 .

[15]  Zuoyong Li,et al.  A New Face Tracking Algorithm Based on Local Binary Pattern and Skin Color Information , 2008, 2008 International Symposium on Computer Science and Computational Technology.

[16]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[17]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[18]  G. Sommer Geometric computing with Clifford algebras: theoretical foundations and applications in computer vision and robotics , 2001 .

[19]  Peijun Li,et al.  Rotation Invariant Texture Measured by Local Binary Pattern for Remote Sensing Image Classification , 2010, 2010 Second International Workshop on Education Technology and Computer Science.

[20]  Jean-Yves Ramel,et al.  Comparison between 2D and 3D Local Binary Pattern Methods for Characterisation of Three-Dimensional Textures , 2008, ICIAR.

[21]  David Hestenes,et al.  Generalized homogeneous coordinates for computational geometry , 2001 .

[22]  Weixin Xie,et al.  Coverage analysis for sensor networks based on Clifford algebra , 2008, Science in China Series F: Information Sciences.

[23]  D. Hestenes,et al.  Clifford Algebra to Geometric Calculus: A Unified Language for Mathematics and Physics , 1984 .

[24]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Hasan Demirel,et al.  3D discrete wavelet transform-based feature extraction for hyperspectral face recognition , 2018, IET Biom..

[26]  Yuejiao Sun,et al.  The research status and application of hyperspectral image target detection , 2017, Selected Proceedings from CSOE.

[27]  Noel D.G. White,et al.  Extraction of Spectral Information from Hyperspectral Data and Application of Hyperspectral Imaging for Food and Agricultural Products , 2016, Food and Bioprocess Technology.

[28]  James V. Taranik,et al.  Mapping rock forming minerals at Boundary Canyon, Death Valey National Park, California, using aerial SEBASS thermal infrared hyperspectral image data , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[29]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Vijayan K. Asari,et al.  Classification of hyperspectral image using multiscale spatial texture features , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[31]  Jun Li,et al.  Discriminative Low-Rank Gabor Filtering for Spectral–Spatial Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[33]  Bo Li,et al.  Multi-scale 3D deep convolutional neural network for hyperspectral image classification , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[34]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Yanshan Li,et al.  TSSLBP: tensor-based spatial–spectral local binary pattern , 2020 .

[36]  James E. Fowler,et al.  Spatial–spectral hyperspectral classification using local binary patterns and Markov random fields , 2017 .

[37]  Weixin Xie,et al.  TGSIFT: Robust SIFT Descriptor Based on Tensor Gradient for Hyperspectral Images , 2020 .

[38]  Qingquan Li,et al.  Three-Dimensional Local Binary Patterns for Hyperspectral Imagery Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Matti Pietikäinen,et al.  Rotation-Invariant Image and Video Description With Local Binary Pattern Features , 2012, IEEE Transactions on Image Processing.

[40]  Mohd. Zubir Mat Jafri,et al.  Feature selection from hyperspectral imaging for guava fruit defects detection , 2017, Other Conferences.

[41]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[42]  Li Pei-jun The Application of Extended LBP Texture in High Resolution Remote Sensing Image Classification , 2010 .

[43]  Patrick Lambert,et al.  3-D Deep Learning Approach for Remote Sensing Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Arif Mahmood,et al.  Hyperspectral Face Recognition With Spatiospectral Information Fusion and PLS Regression , 2015, IEEE Transactions on Image Processing.