Segmented and non-segmented stacked denoising autoencoder for hyperspectral band reduction

Abstract Hyperspectral image (HSI) analysis often requires selecting the most informative bands instead of processing the whole data without losing the key information. Existing band reduction (BR) methods have the capability to reveal the nonlinear properties exhibited in the data but at the expense of losing its original representation. To cope with the said issue, an unsupervised non-linear segmented and non-segmented stacked denoising autoencoder (UDAE)-based BR method is proposed. Our aim is to find an optimal mapping and construct a lower-dimensional space that has a similar structure to the original data with least reconstruction error. The proposed method first confronts the original HS data into smaller regions in the spatial domain and then each region is processed by UDAE individually. This results in reduced complexity and improved efficiency of BR for classification. Our experiments on publicly available HS datasets with various types of classifiers demonstrate the effectiveness of UDAE method which equates favorably with other state-of-the-art dimensionality reduction and BR methods.

[1]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[2]  Wajahat Ali Khan,et al.  Fuzziness-based active learning framework to enhance hyperspectral image classification performance for discriminative and generative classifiers , 2018, PloS one.

[3]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[4]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[5]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[6]  David Gustafsson,et al.  Non-Linear Hyperspectral Subspace Mapping using Stacked Auto-Encoder , 2016, SAIS.

[7]  Seok-Won Lee,et al.  User-Independent Activity Recognition via Three-Stage GA-Based Feature Selection , 2014, Int. J. Distributed Sens. Networks.

[8]  Muhammad Ahmad,et al.  AIK Method for Band Clustering Using Statistics of Correlation and Dispersion Matrix , .

[9]  Xin-She Yang,et al.  Firefly Algorithm: Recent Advances and Applications , 2013, ArXiv.

[10]  Adil Mehmood Khan,et al.  Gait fingerprinting-based user identification on smartphones , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[11]  Qian Du,et al.  Hyperspectral Band Selection Using Improved Firefly Algorithm , 2016, IEEE Geoscience and Remote Sensing Letters.

[12]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[13]  Adolfo Martínez Usó,et al.  Clustering-Based Hyperspectral Band Selection Using Information Measures , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[15]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[16]  J. Shan,et al.  Principal Component Analysis for Hyperspectral Image Classification , 2002 .

[17]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[18]  Michael W. Prairie,et al.  Visual method for spectral band selection , 2004, IEEE Geoscience and Remote Sensing Letters.

[19]  David A. Clausi,et al.  Hyperspectral Image Classification With Limited Labeled Training Samples Using Enhanced Ensemble Learning and Conditional Random Fields , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[21]  Seok-Won Lee,et al.  Weed Image Classification using Wavelet Transform, Stepwise Linear Discriminant Analysis, and Support Vector Machines for an Automatic Spray Control System , 2014, J. Inf. Sci. Eng..

[22]  Lorenzo Bruzzone,et al.  Classification of Hyperspectral Images With Regularized Linear Discriminant Analysis , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[23]  M. Ahmad,et al.  A New Statistical Approach for Band Clustering and Band Selection Using K-Means Clustering , 2022 .

[24]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[25]  Ali Kashif Bashir,et al.  Metric similarity regularizer to enhance pixel similarity performance for hyperspectral unmixing , 2017 .

[26]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[27]  Adil Mehmood Khan,et al.  Graph-based spatial-spectral feature learning for hyperspectral image classification , 2017, IET Image Process..

[28]  V. Kecman,et al.  Iterative Single Data Algorithm for Training Kernel Machines from Huge Data Sets: Theory and Performance , 2005 .

[29]  Gunnar Rätsch,et al.  Totally corrective boosting algorithms that maximize the margin , 2006, ICML.

[30]  Nathan D. Cahill,et al.  Modularity versus Laplacian Eigenmaps for dimensionality reduction and classification of hyperspectral imagery , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[31]  Qi Wang,et al.  Hyperspectral Band Selection by Multitask Sparsity Pursuit , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[33]  David Bergström,et al.  Hyperspectral image analysis using deep learning — A review , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[34]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Ye Zhang,et al.  Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Qian Du,et al.  Optimized Hyperspectral Band Selection Using Particle Swarm Optimization , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  M. F. Baumgardner,et al.  220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3 , 2015 .

[38]  Xin-She Yang,et al.  Nature-Inspired Framework for Hyperspectral Band Selection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  James E. Fowler,et al.  Locality-Preserving Discriminant Analysis in Kernel-Induced Feature Spaces for Hyperspectral Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[40]  Qian Du,et al.  An Efficient Method for Supervised Hyperspectral Band Selection , 2011, IEEE Geoscience and Remote Sensing Letters.