Unsupervised Segmentation of Hyperspectral Images Using 3-D Convolutional Autoencoders

Hyperspectral image analysis has become an important topic widely researched by the remote sensing community. Classification and segmentation of such imagery help understand the underlying materials within a scanned scene since hyperspectral images convey detailed information captured in a number of spectral bands. Although deep learning has established the state-of-the-art in the field, it still remains challenging to train well-generalizing models due to the lack of ground-truth data. In this letter, we tackle this problem and propose an end-to-end approach to segment hyperspectral images in a fully unsupervised way. We introduce a new deep architecture which couples 3-D convolutional autoencoders with clustering. Our multifaceted experimental study—performed over the benchmark and real-life data—revealed that our approach delivers high-quality segmentation without any prior class labels.

[1]  Naoto Yokoya,et al.  Advanced Multi-Sensor Optical Remote Sensing for Urban Land Use and Land Cover Classification: Outcome of the 2018 IEEE GRSS Data Fusion Contest , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Amir Averbuch,et al.  A Diffusion Approach to Unsupervised Segmentation of Hyper-Spectral Images , 2017, IJCCI.

[4]  Jakub Nalepa,et al.  Transfer Learning for Segmenting Dimensionally Reduced Hyperspectral Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[5]  Sangwook Lee,et al.  Unsupervised segmentation for hyperspectral images using mean shift segmentation , 2010, Optical Engineering + Applications.

[6]  En Zhu,et al.  Deep Clustering with Convolutional Autoencoders , 2017, ICONIP.

[7]  Jie Liang,et al.  Spectral-spatial Feature Extraction for Hyperspectral Image Classification , 2016 .

[8]  Hamid Saeed Khan,et al.  Modern Trends in Hyperspectral Image Analysis: A Review , 2018, IEEE Access.

[9]  Jakub Nalepa,et al.  Training- and Test-Time Data Augmentation for Hyperspectral Image Segmentation , 2020, IEEE Geoscience and Remote Sensing Letters.

[10]  Xiao Xiang Zhu,et al.  Deep Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jakub Nalepa,et al.  Segmentation of Multispectral Data Simulated from Hyperspectral Imagery , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[12]  Mark J. Embrechts,et al.  On the Use of the Adjusted Rand Index as a Metric for Evaluating Supervised Classification , 2009, ICANN.

[13]  Sarp Ertürk,et al.  Unsupervised Segmentation of Hyperspectral Images Using Modified Phase Correlation , 2006, IEEE Geoscience and Remote Sensing Letters.

[14]  Jakub Nalepa,et al.  Validating Hyperspectral Image Segmentation , 2018, IEEE Geoscience and Remote Sensing Letters.

[15]  Xiuping Jia,et al.  Hyperspectral Image Classification Using Convolutional Neural Networks and Multiple Feature Learning , 2018, Remote. Sens..

[16]  Xiao Xiang Zhu,et al.  Unsupervised Spectral–Spatial Feature Learning via Deep Residual Conv–Deconv Network for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[18]  Pabitra Mitra,et al.  BASS Net: Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Qingshan Liu,et al.  Cascaded Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Yansheng Li,et al.  Unsupervised Spectral–Spatial Feature Learning With Stacked Sparse Autoencoder for Hyperspectral Imagery Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[22]  Taner Ince,et al.  Sparse Representation-Based Hyperspectral Image Classification Using Multiscale Superpixels and Guided Filter , 2019, IEEE Geoscience and Remote Sensing Letters.