Classification of Hyperspectral Data Using a Multi-Channel Convolutional Neural Network

In recent years, deep learning is widely used for hyperspectral image (HSI) classification, among them, convolutional neural network (CNN) is most popular. In this paper, we propose a method for hyperspectral data classification by multi-channel convolutional neural network (MC-CNN). In this framework, one dimensional CNN (1D-CNN) is mainly used to extract the spectral feature of hyperspectral images, two dimension CNN (2D-CNN) is mainly used to extract the spatial feature of hyperspectral images, three-dimensional CNN (3D-CNN) is mainly used to extract part of the spatial and spectral information. And then these features are merged and pull into the full connection layer. At last, using neural network classifiers like logistic regression, we can eventually get class labels for each pixel. For comparison and validation, we compare the proposed MC-CNN algorithm with the other three deep learning algorithms. Experimental results show that our MC-CNN-based algorithm outperforms these state-of-the-art algorithms. Showcasing the MC-CNN framework has huge potential for accurate hyperspectral data classification.

[1]  Haokui Zhang,et al.  Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network , 2017 .

[2]  Li Deng,et al.  Learning in the Deep-Structured Conditional Random Fields , 2009 .

[3]  Luis Samaniego,et al.  Supervised Classification of Remotely Sensed Imagery Using a Modified $k$-NN Technique , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Robert I. Damper,et al.  Customizing Kernel Functions for SVM-Based Hyperspectral Image Classification , 2008, IEEE Transactions on Image Processing.

[5]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[7]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Tara N. Sainath,et al.  Deep Belief Networks using discriminative features for phone recognition , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Guohui Zhang,et al.  Learning Convolutional Ranking-Score Function by Query Preference Regularization , 2017, IDEAL.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[13]  Helmi Zulhaidi Mohd Shafri,et al.  The Performance of Maximum Likelihood, Spectral Angle Mapper, Neural Network and Decision Tree Classifiers in Hyperspectral Image Analysis , 2007 .

[14]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[15]  Guohui Zhang,et al.  A Novel Image Tag Completion Method Based on Convolutional Neural Transformation , 2017, ICANN.

[16]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[18]  Jim Jing-Yan Wang,et al.  Learning convolutional neural network to maximize Pos@Top performance measure , 2016, ESANN.

[19]  Dong Yu,et al.  Language recognition using deep-structured conditional random fields , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.