Autoencoder and Adversarial-Learning-Based Semisupervised Background Estimation for Hyperspectral Anomaly Detection

Reliable detection of anomalies without any prior information is a critical yet challenging task in many applications, not least military and civilian fields. An intelligent anomaly detection system would use the material-specific spectral information in hyperspectral images (HSIs), thereby avoiding the loss of visually confusing objects. However, conventional hyperspectral anomaly detection methods are mainly achieved in an unsupervised way leading to limited performance due to lack of prior knowledge. In this article, we propose a novel autoencoder and adversarial-learning based semisupervised background estimation model (SBEM) that is trained only on the background spectral samples in order to accurately learn the background distribution. In particular, an unsupervised background searching method is firstly conducted on the original HSIs to search the background spectral samples. Our proposed SBEM consists of an encoder, a decoder, and a discriminator to thoroughly capture background distribution. Furthermore, jointly minimizing the reconstruction loss, spectral loss, and adversarial loss during training aids the model to learn the background distribution as required. Experiments on four real HSIs demonstrate that compared to the current state-of-the-art, the proposed framework yields higher detection capability and lower false alarm rate, which shows that it has a significant benefit in the tradeoff between detection accuracy and false alarm rate.

[1]  Shutao Li,et al.  Hyperspectral Anomaly Detection With Multiscale Attribute and Edge-Preserving Filters , 2018, IEEE Geoscience and Remote Sensing Letters.

[2]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[3]  Xiaolong Hui,et al.  A Novel and Efficient CVAE-GAN-Based Approach With Informative Manifold for Semi-Supervised Anomaly Detection , 2019, IEEE Access.

[4]  A. V. Chernov,et al.  Increasing the Quality and Performance of N-Dimensional Point Anomaly Detection in Traffic Using PCA and DBSCAN , 2018, 2018 26th Telecommunications Forum (TELFOR).

[5]  Aidong Men,et al.  A Hybrid Semi-Supervised Anomaly Detection Model for High-Dimensional Data , 2017, Comput. Intell. Neurosci..

[6]  Wei Li,et al.  Transferred Deep Learning for Anomaly Detection in Hyperspectral Imagery , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Yunsong Li,et al.  Structure Tensor and Guided Filtering-Based Algorithm for Hyperspectral Anomaly Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Qian Du,et al.  Collaborative Representation for Hyperspectral Anomaly Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Anand Singh Jalal,et al.  A Density Based Algorithm for Discovering Density Varied Clusters in Large Spatial Databases , 2010 .

[10]  Sarp Ertürk,et al.  Fuzzy Fusion of Change Vector Analysis and Spectral Angle Mapper for Hyperspectral Change Detection , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Rui Yu,et al.  A semi-supervised anomaly detection method for wind farm power data preprocessing , 2017, 2017 IEEE Power & Energy Society General Meeting.

[12]  Li Ma,et al.  Hyperspectral Anomaly Detection by the Use of Background Joint Sparse Representation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Ender Konukoglu,et al.  Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoders , 2018, ArXiv.

[14]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[15]  Nasser M. Nasrabadi,et al.  A comparative study of linear and nonlinear anomaly detectors for hyperspectral imagery , 2007, SPIE Defense + Commercial Sensing.

[16]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[17]  Baozhi Cheng,et al.  A stacked autoencoders-based adaptive subspace model for hyperspectral anomaly detection , 2019, Infrared Physics & Technology.

[18]  Navdeep Jaitly,et al.  Adversarial Autoencoders , 2015, ArXiv.

[19]  Antonio J. Plaza,et al.  Analysis and Optimizations of Global and Local Versions of the RX Algorithm for Anomaly Detection in Hyperspectral Data , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Erkan Bostanci,et al.  Anomaly Based Distributed Denial of Service Attack Detection and Prevention with Machine Learning , 2018, 2018 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT).

[21]  Lin Zhu,et al.  Generative Adversarial Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Hassan Ghassemian,et al.  Unsupervised Hyperspectral Target Detection Using Spectral Residual of Deep Autoencoder Networks , 2019, 2019 4th International Conference on Pattern Recognition and Image Analysis (IPRIA).

[23]  Weiying Xie,et al.  SRUN: Spectral Regularized Unsupervised Networks for Hyperspectral Target Detection , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Georgios B. Giannakis,et al.  Joint Community and Anomaly Tracking in Dynamic Networks , 2015, IEEE Transactions on Signal Processing.

[25]  Huiqian Du,et al.  Structure tensor and nonsubsampled shearlet transform based algorithm for CT and MRI image fusion , 2017, Neurocomputing.

[26]  Bernd Bischl,et al.  Robust Anomaly Detection in Images using Adversarial Autoencoders , 2019, ECML/PKDD.

[27]  Antonio J. Plaza,et al.  Anomaly Detection in Hyperspectral Images Based on Low-Rank and Sparse Representation , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Weiying Xie,et al.  Spectral Adversarial Feature Learning for Anomaly Detection in Hyperspectral Imagery , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Wei Liu,et al.  Deep Spectral Clustering Using Dual Autoencoder Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Heesung Kwon,et al.  Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Shutao Li,et al.  Hyperspectral Anomaly Detection With Kernel Isolation Forest , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Xiuping Jia,et al.  Spectral constraint adversarial autoencoders approach to feature representation in hyperspectral anomaly detection , 2019, Neural Networks.

[33]  Qian Du,et al.  A Randomized Subspace Learning Based Anomaly Detector for Hyperspectral Imagery , 2018, Remote. Sens..

[34]  Bo Du,et al.  A Low-Rank and Sparse Matrix Decomposition-Based Mahalanobis Distance Method for Hyperspectral Anomaly Detection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Bing Tu,et al.  Hyperspectral Imagery Noisy Label Detection by Spectral Angle Local Outlier Factor , 2018, IEEE Geoscience and Remote Sensing Letters.

[36]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[37]  Raghavendra Chalapathy University of Sydney,et al.  Deep Learning for Anomaly Detection: A Survey , 2019, ArXiv.

[38]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[39]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.