HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

With the development of deep learning, the performance of hyperspectral image (HSI) classification has been greatly improved in recent years. The shortage of training samples has become a bottleneck for further improvement of performance. In this paper, we propose a novel convolutional neural network framework for the characteristics of hyperspectral image data called HSI-CNN, which can also provides ideas for the processing of one-dimensional data. Firstly, the spectral-spatial feature is extracted from a target pixel and its neighbors. Then, a number of one-dimensional feature maps, obtained by convolution operation on spectral-spatial features, are stacked into a two-dimensional matrix. Finally, the two-dimensional matrix considered as an image is fed into standard CNN. This is why we call it HSI-CNN. In addition, we also implements two depth network classification models, called HSI-CNN+XGBoost and HSI-CapsNet, in order to compare the performance of our framework. Experiments show that the performance of hyperspectral image classification is improved efficiently with HSI-CNN framework. We evaluate the model's performance using four popular HSI datasets, which are the Kennedy Space Center (KSC), Indian Pines (IP), Pavia University scene (PU) and Salinas scene (SA). As far as we concerned, the accuracy of HSI-CNN has kept pace with the state-of-art methods, which is 99.28%, 99.09%, 99.57%, 98.97% separately.

[1]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[5]  M. Cochrane Using vegetation reflectance variability for species level classification of hyperspectral data , 2000 .

[6]  Graham Jewitt,et al.  Spatial mapping of leaf area index using hyperspectral remote sensing for hydrological applications with a particular focus on canopy interception , 2009 .

[7]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Hector Erives,et al.  Automated registration of hyperspectral images for precision agriculture , 2005 .

[9]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[10]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[12]  Haokui Zhang,et al.  Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network , 2017 .

[13]  Richard A. Hallett,et al.  Ash decline assessment in emerald ash borer-infested regions: A test of tree-level, hyperspectral technologies , 2008 .

[14]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[15]  John R. Miller,et al.  Hyperspectral Data Segmentation and Classification in Precision Agriculture: A Multi-Scale Analysis , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[16]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[17]  Yang Jin,et al.  Capsule Network Performance on Complex Data , 2017, ArXiv.

[18]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[19]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[20]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[21]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[22]  Dong Han,et al.  Cube-CNN-SVM: A Novel Hyperspectral Image Classification Method , 2016 .

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Haoliang Yuan Robust patch-based sparse representation for hyperspectral image classification , 2017, Int. J. Wavelets Multiresolution Inf. Process..

[25]  E. Cloutis,et al.  Review Article Hyperspectral geological remote sensing: evaluation of analytical techniques , 1996 .

[26]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[27]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[28]  John Shepanski,et al.  Hyperion, a space-based imaging spectrometer , 2003, IEEE Trans. Geosci. Remote. Sens..

[29]  Tao Li,et al.  Cube-CNN-SVM: A Novel Hyperspectral Image Classification Method , 2016, 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI).

[30]  Antonio J. Plaza,et al.  Spatial-Spectral Preprocessing Prior to Endmember Identification and Unmixing of Remotely Sensed Hyperspectral Data , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Ching Y. Suen,et al.  A novel hybrid CNN-SVM classifier for recognizing handwritten digits , 2012, Pattern Recognit..