Densely Connected Pyramidal Dilated Convolutional Network for Hyperspectral Image Classification

Recently, with the extensive application of deep learning techniques in the hyperspectral image (HSI) field, particularly convolutional neural network (CNN), the research of HSI classification has stepped into a new stage. To avoid the problem that the receptive field of naive convolution is small, the dilated convolution is introduced into the field of HSI classification. However, the dilated convolution usually generates blind spots in the receptive field, resulting in discontinuous spatial information obtained. In order to solve the above problem, a densely connected pyramidal dilated convolutional network (PDCNet) is proposed in this paper. Firstly, a pyramidal dilated convolutional (PDC) layer integrates different numbers of sub-dilated convolutional layers is proposed, where the dilated factor of the sub-dilated convolution increases exponentially, achieving multi-sacle receptive fields. Secondly, the number of sub-dilated convolutional layers increases in a pyramidal pattern with the depth of the network, thereby capturing more comprehensive hyperspectral information in the receptive field. Furthermore, a feature fusion mechanism combining pixel-by-pixel addition and channel stacking is adopted to extract more abstract spectral–spatial features. Finally, in order to reuse the features of the previous layers more effectively, dense connections are applied in densely pyramidal dilated convolutional (DPDC) blocks. Experiments on three well-known HSI datasets indicate that PDCNet proposed in this paper has good classification performance compared with other popular models.

[1]  Mary B Stuart,et al.  Hyperspectral Imaging in Environmental Monitoring: A Review of Recent Developments and Technological Advances in Compact Field Deployable Systems , 2019, Sensors.

[2]  Antonio J. Plaza,et al.  Deep&Dense Convolutional Neural Network for Hyperspectral Image Classification , 2018, Remote. Sens..

[3]  Jing Wang,et al.  Sea Ice Detection Based on an Improved Similarity Measurement Method Using Hyperspectral Data , 2017, 2017 IEEE 14th International Conference on Networking, Sensing and Control (ICNSC).

[4]  Claude Cariou,et al.  Improving K-Nearest Neighbor Approaches for Density-Based Pixel Clustering in Hyperspectral Remote Sensing Images , 2020, Remote. Sens..

[5]  An Advanced Spectral–Spatial Classification Framework for Hyperspectral Imagery Based on DeepLab v3+ , 2021, Applied Sciences.

[6]  Shunyi Zheng,et al.  Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network , 2020, Remote. Sens..

[7]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[8]  Yue Wu,et al.  Double-Branch Multi-Attention Mechanism Network for Hyperspectral Image Classification , 2019, Remote. Sens..

[9]  Carol X. Garzon‐Lopez,et al.  Species Classification in a Tropical Alpine Ecosystem Using UAV-Borne RGB and Hyperspectral Imagery , 2020, Drones.

[10]  Hyperspectral Image Classification—Traditional to Deep Models: A Survey for Future Prospects , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Naoya Takahashi,et al.  Densely connected multidilated convolutional networks for dense prediction tasks , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Licheng Jiao,et al.  Multipath Residual Network for Spectral-Spatial Hyperspectral Image Classification , 2019, Remote. Sens..

[13]  Tingkui Mu,et al.  Multiscale Information Fusion for Hyperspectral Image Classification Based on Hybrid 2D-3D CNN , 2021, Remote. Sens..

[14]  Sergio Benini,et al.  Deep Learning Meets Hyperspectral Image Analysis: A Multidisciplinary Review , 2019, J. Imaging.

[15]  Miaomiao Liang,et al.  Deep Residual Involution Network for Hyperspectral Image Classification , 2021, Remote. Sens..

[16]  Zheng Zhang,et al.  A Developed Siamese CNN with 3D Adaptive Spatial-Spectral Pyramid Pooling for Hyperspectral Image Classification , 2020, Remote. Sens..

[17]  Licheng Jiao,et al.  Fully Dense Multiscale Fusion Network for Hyperspectral Image Classification , 2019, Remote. Sens..

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Jakub Nalepa,et al.  Towards resource-frugal deep convolutional neural networks for hyperspectral image segmentation , 2020, Microprocess. Microsystems.

[20]  Christopher E. Ndehedehe,et al.  Deep support vector machine for hyperspectral image classification , 2020, Pattern Recognit..

[21]  Chenming Li,et al.  Hybrid Dilated Convolution with Multi-Scale Residual Fusion Network for Hyperspectral Image Classification , 2021, Micromachines.

[22]  Wei Yao,et al.  Multiple Spectral Resolution 3D Convolutional Neural Network for Hyperspectral Image Classification , 2021, Remote. Sens..

[23]  Xin Sun,et al.  Hyperspectral Image Segmentation via Frequency-Based Similarity for Mixed Noise Estimation , 2017, Remote. Sens..

[24]  Wenyi Liu,et al.  Hyperspectral Image Classification Based on Multi-Scale Residual Network with Attention Mechanism , 2021, Remote. Sens..

[25]  Guo Cao,et al.  Double-Branch Network with Pyramidal Convolution and Iterative Attention for Hyperspectral Image Classification , 2021, Remote. Sens..

[26]  Bogdan Zagajewski,et al.  Comparison of Support Vector Machine and Random Forest Algorithms for Invasive and Expansive Species Classification Using Airborne Hyperspectral Data , 2020, Remote. Sens..