Unsupervised Feature-Learning for Hyperspectral Data with Autoencoders

This paper proposes novel autoencoders for unsupervised feature-learning from hyperspectral data. Hyperspectral data typically have many dimensions and a significant amount of variability such that many data points are required to represent the distribution of the data. This poses challenges for higher-level algorithms which use the hyperspectral data (e.g., those that map the environment). Feature-learning mitigates this by projecting the data into a lower-dimensional space where the important information is either preserved or enhanced. In many applications, the amount of labelled hyperspectral data that can be acquired is limited. Hence, there is a need for feature-learning algorithms to be unsupervised. This work proposes unsupervised techniques that incorporate spectral measures from the remote-sensing literature into the objective functions of autoencoder feature learners. The proposed techniques are evaluated on the separability of their feature spaces as well as on their application as features for a clustering task, where they are compared against other unsupervised feature-learning approaches on several different datasets. The results show that autoencoders using spectral measures outperform those using the standard squared-error objective function for unsupervised hyperspectral feature-learning.

[1]  Gary A. Shaw,et al.  Hyperspectral Image Processing for Automatic Target Detection Applications , 2003 .

[2]  Rishi Ramakrishnan,et al.  Illumination Invariant Outdoor Perception , 2015 .

[3]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Fabio Del Frate,et al.  Feature reduction of hyperspectral data using Autoassociative neural networks algorithms , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[5]  Bor-Chen Kuo,et al.  Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[6]  J. Boardman,et al.  High spatial resolution hyperspectral mapping of in-stream habitats, depths, and woody debris in mountain streams , 2003 .

[7]  I. Ginsberg,et al.  Unsupervised hyperspectral image analysis using independent component analysis , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[8]  Qian Du,et al.  Modified Fisher's Linear Discriminant Analysis for Hyperspectral Imagery , 2007, IEEE Geoscience and Remote Sensing Letters.

[9]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[10]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[11]  Anil M. Cheriyadat,et al.  Unsupervised Feature Learning for Aerial Scene Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  S. T. Seydi,et al.  A new land-cover match-based change detection for hyperspectral imagery , 2017 .

[13]  Alexander Wendel,et al.  Self-supervised weed detection in vegetable crops using ground based hyperspectral imaging , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Jon Atli Benediktsson,et al.  Linear Versus Nonlinear PCA for the Classification of Hyperspectral Data Based on the Extended Morphological Profiles , 2012, IEEE Geoscience and Remote Sensing Letters.

[15]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[16]  Chein-I Chang,et al.  An information-theoretic approach to spectral variability, similarity, and discrimination for hyperspectral image analysis , 2000, IEEE Trans. Inf. Theory.

[17]  Richard J. Murphy,et al.  Unsupervised feature learning for illumination robustness , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[18]  Chein-I Chang,et al.  Unsupervised target detection in hyperspectral images using projection pursuit , 2001, IEEE Trans. Geosci. Remote. Sens..

[19]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[20]  Lori M. Bruce,et al.  Why principal component analysis is not an appropriate feature extraction method for hyperspectral data , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[21]  C. Gueymard Parameterized transmittance model for direct beam and circumsolar spectral irradiance , 2001 .

[22]  Richard J. Murphy,et al.  Pretraining for Hyperspectral Convolutional Neural Network Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Richard J. Murphy,et al.  A Physics-Based Deep Learning Approach to Shadow Invariant Representations of Hyperspectral Images , 2018, IEEE Transactions on Image Processing.

[24]  Hermann J. Heege,et al.  Precision in Crop Farming , 2013, Springer Netherlands.

[25]  Thy-Hou Lin,et al.  Implementing the Fisher's Discriminant Ratio in a k-Means Clustering Algorithm for Feature Selection and Data Set Trimming , 2004, Journal of Chemical Information and Modeling.

[26]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[27]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[28]  Abel G. Silva-Filho,et al.  Hyperspectral images clustering on reconfigurable hardware using the k-means algorithm , 2003, 16th Symposium on Integrated Circuits and Systems Design, 2003. SBCCI 2003. Proceedings..

[29]  Yansheng Li,et al.  Unsupervised Spectral–Spatial Feature Learning With Stacked Sparse Autoencoder for Hyperspectral Imagery Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[30]  Harald van der Werff,et al.  Assessing the Influence of Reference Spectra on Synthetic SAM Classification Results , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[31]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[32]  Sildomar T. Monteiro,et al.  Evaluating Classification Techniques for Mapping Vertical Geology Using Field-Based Hyperspectral Sensors , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[34]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[35]  Pramod K. Varshney,et al.  Unsupervised classification of hyperspectral data: an ICA mixture model based approach , 2004 .

[36]  C. J. van Rijsbergen,et al.  Information Retrieval , 1979, Encyclopedia of GIS.

[37]  Sildomar T. Monteiro,et al.  Mapping Layers of Clay in a Vertical Geological Surface Using Hyperspectral Imagery: Variability in Parameters of SWIR Absorption Features under Different Conditions of Illumination , 2014, Remote. Sens..

[38]  J. Shan,et al.  Principal Component Analysis for Hyperspectral Image Classification , 2002 .

[39]  Xiao Xiang Zhu,et al.  Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[40]  S. J. Sutley,et al.  USGS Digital Spectral Library splib06a , 2007 .

[41]  Gregory Piatetsky-Shapiro,et al.  High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality , 2000 .

[42]  H. Bourlard,et al.  Auto-association by multilayer perceptrons and singular value decomposition , 1988, Biological Cybernetics.

[43]  Deyu Li,et al.  A feature selection method based on improved fisher's discriminant ratio for text sentiment classification , 2011, Expert Syst. Appl..

[44]  Richard J. Murphy,et al.  Hyperspectral CNN Classification with Limited Training Samples , 2016, BMVC.

[45]  M. Cugmas,et al.  On comparing partitions , 2015 .

[46]  Ka Yee Yeung,et al.  Principal component analysis for clustering gene expression data , 2001, Bioinform..

[47]  David A. Landgrebe,et al.  Analyzing high-dimensional multispectral data , 1993, IEEE Trans. Geosci. Remote. Sens..

[48]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[49]  Claude Cariou,et al.  Assessing the performance of two unsupervised dimensionality reduction techniques on hyperspectral APEX data for high resolution urban land-cover mapping , 2014 .