Neighboring Region Dropout for Hyperspectral Image Classification

Deep neural networks (DNNs) exhibit great performance in the task of hyperspectral image (HSI) classification. However, these models are usually overparameterized and require large amounts of training data in order to properly avoid the curse of dimensionality and the variability of spectral signatures, thus suffering from overfitting problems when very few training samples are available, due to poor generalization ability in this particular case. The traditional regularization dropout (DO) strategy has been shown to be effective in fully connected DNNs but not in convolutional-based ones. This is mainly due to the way these architectures manage the spatial information. In this letter, we introduce a new approach to improve the generalization of convolutional-based models for HSI classification. Specifically, we develop a neighboring region DO technique that selectively cuts off certain neighboring outputs, creating spatial dropped regions. Our experimental results with two well-known HSIs reveal that the newly proposed method helps to achieve better classification accuracy than the traditional DO strategy, with a low computational cost.

[1]  Antonio J. Plaza,et al.  A Subspace-Based Multinomial Logistic Regression for Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[2]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[3]  Jun Li,et al.  Active Learning With Convolutional Neural Networks for Hyperspectral Image Classification Using a New Bayesian Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Mihai Datcu,et al.  Multisensor Earth Observation Image Classification Based on a Multimodal Latent Dirichlet Allocation Model , 2018, IEEE Geoscience and Remote Sensing Letters.

[5]  Yuan Yan Tang,et al.  Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images , 2019, IEEE Transactions on Cybernetics.

[6]  Wei Li,et al.  Data Augmentation for Hyperspectral Image Classification With Deep CNN , 2019, IEEE Geoscience and Remote Sensing Letters.

[7]  Lin Zhu,et al.  Generative Adversarial Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[9]  Antonio J. Plaza,et al.  Deep Pyramidal Residual Networks for Spectral–Spatial Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[11]  Antonio J. Plaza,et al.  Remote Sensing Image Fusion Using Hierarchical Multimodal Probabilistic Latent Semantic Analysis , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Pierre Baldi,et al.  Understanding Dropout , 2013, NIPS.

[13]  Quoc V. Le,et al.  DropBlock: A regularization method for convolutional networks , 2018, NeurIPS.

[14]  Antonio J. Plaza,et al.  Cloud implementation of the K-means algorithm for hyperspectral image analysis , 2016, The Journal of Supercomputing.

[15]  Filiberto Pla,et al.  Capsule Networks for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Zhenfeng Shao,et al.  A Novel Hierarchical Semisupervised SVM for Classification of Hyperspectral Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Jun Li,et al.  Hyperspectral Image Classification Using Random Occlusion Data Augmentation , 2019, IEEE Geoscience and Remote Sensing Letters.

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..