Classification of hyperspectral image based on deep belief networks

Generally, dimensionality reduction methods, such as Principle Component Analysis (PCA) and Negative Matrix Factorization (NMF), are always applied as the preprocessing part in hyperspectral image classification so as to classify the constituent elements of every pixel in the scene efficiently. The results, however, would suffer the loss of detailed information inevitably. In this paper, deep learning frameworks, restricted Boltzmann machine (RBM) model and its deep structure deep belief networks (DBN), are introduced in hyperspectral image processing as the feature extraction and classification approach. The experiments are conducted on an airborne hyperspectral image. Further in the experiments, spatial-spectral classification is also practiced. Meanwhile, SVM with and without some classical feature extraction methods adopting before classification are employed as comparison. The results show the superior performance of the proposed approach.

[1]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[2]  Alfred O. Hero,et al.  Geodesic entropic graphs for dimension and entropy estimation in manifold learning , 2004, IEEE Transactions on Signal Processing.

[3]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[4]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[5]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[6]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[7]  R. Maronna Alan Julian Izenman (2008): Modern Multivariate Statistical Techniques: Regression, Classification and Manifold Learning , 2011 .

[8]  Alan Julian Izenman,et al.  Modern Multivariate Statistical Techniques: Regression, Classification, and Manifold Learning , 2008 .

[9]  Geoffrey E. Hinton Deep belief networks , 2009, Scholarpedia.

[10]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[11]  Alan Julian Izenman,et al.  Modern Multivariate Statistical Techniques , 2008 .

[12]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.