A Spectral-Spatial Features Integrated Network for Hyperspectral Detection of Marine Oil Spill

Marine oil spills are one of the most serious problems of marine environmental pollution. Hyperspectral remote sensing has been proven to be an effective tool for monitoring marine oil spills. To make full use of spectral and spatial features, this study proposes a spectral-spatial features integrated network (SSFIN) and applies it for hyperspectral detection of a marine oil spill. Specifically, 1-D and 2-D convolutional neural network (CNN) models have been employed for the extraction of the spectral and spatial features, respectively. During the stage of spatial feature extraction, three consecutive convolution layers are concatenated to achieve the fusion of multilevel spatial features. Next, the extracted spectral and spatial features are concatenated and fed to the fully connected layer so as to obtain the joint spectral-spatial features. In addition, L2 regularization is applied to the convolution layer to prevent overfitting, and dropout operation is employed to the full connection layer to improve the network performance. The effectiveness of the method proposed here has firstly been verified on the Pavia University dataset with competitive classification experimental results. Eventually, the experimental results upon oil spill datasets demonstrate the strong capacity of oil spill detection by this method, which can effectively distinguish thick oil film, thin oil film, and seawater.

[1]  Peng Chen,et al.  Extraction of Oil Spill Information Using Decision Tree Based Minimum Noise Fraction Transform , 2016, Journal of the Indian Society of Remote Sensing.

[2]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Chein-I Chang,et al.  An information-theoretic approach to spectral variability, similarity, and discrimination for hyperspectral image analysis , 2000, IEEE Trans. Inf. Theory.

[4]  Bo Du,et al.  Spectral–Spatial Unified Networks for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[6]  Qiang Zhang,et al.  Oil Film Classification Using Deep Learning-Based Hyperspectral Remote Sensing Technology , 2019, ISPRS Int. J. Geo Inf..

[7]  Wei Li,et al.  3-D Convolution-Recurrent Networks for Spectral-Spatial Classification of Hyperspectral Images , 2019, Remote. Sens..

[8]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[9]  Yi Ma,et al.  Characterization analysis and identification of common marine oil spill types using hyperspectral remote sensing , 2020 .

[10]  Ying Li,et al.  A Spectral Feature Based Convolutional Neural Network for Classification of Sea Surface Oil Spill , 2019, ISPRS Int. J. Geo Inf..

[11]  Eric W. Gill,et al.  A new fully convolutional neural network for semantic segmentation of polarimetric SAR imagery in complex land cover ecosystem , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  Raymond F. Kokaly,et al.  Spectroscopic remote sensing of the distribution and persistence of oil from the Deepwater Horizon spill in Barataria Bay marshes , 2013 .

[13]  Licheng Jiao,et al.  Fully Dense Multiscale Fusion Network for Hyperspectral Image Classification , 2019, Remote. Sens..

[14]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Zhengjia Zhang,et al.  Multi-Feature Based Ocean Oil Spill Detection for Polarimetric SAR Data Using Random Forest and the Self-Similarity Parameter , 2019, Remote. Sens..

[16]  Cathleen E. Jones,et al.  State of the art satellite and airborne marine oil spill remote sensing: Application to the BP Deepwater Horizon oil spill , 2012 .

[17]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Peng Liu,et al.  Ieee Journal of Selected Topics in Applied Earth Observations and Remote Sensing 1 Active Deep Learning for Classification of Hyperspectral Images , 2022 .

[19]  Qian Du,et al.  Hyperspectral Image Classification Using Deep Pixel-Pair Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[21]  Tao Xie,et al.  A Novel Marine Oil Spillage Identification Scheme Based on Convolution Neural Network Feature Extraction From Fully Polarimetric SAR Imagery , 2020, IEEE Access.

[22]  Jun Huang,et al.  Spectral-Spatial Attention Networks for Hyperspectral Image Classification , 2019, Remote. Sens..

[23]  Medhavy Thankappan,et al.  Assessing the effect of hydrocarbon oil type and thickness on a remote sensing signal: A sensitivity study based on the optical properties of two different oil types and the HYMAP and Quickbird sensors , 2009 .

[24]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[27]  Pengqiang Zhang,et al.  Deep Relation Network for Hyperspectral Image Few-Shot Classification , 2020, Remote. Sens..

[28]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[29]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[30]  Weiwei Song,et al.  Deep Hashing Neural Networks for Hyperspectral Image Feature Extraction , 2019, IEEE Geoscience and Remote Sensing Letters.

[31]  Lianru Gao,et al.  Hyperspectral Image Classification Based on a Shuffled Group Convolutional Neural Network with Transfer Learning , 2020, Remote. Sens..

[32]  Yong Xiao,et al.  CSA-MSO3DCNN: Multiscale Octave 3D CNN with Channel and Spatial Attention for Hyperspectral Image Classification , 2020, Remote. Sens..

[33]  José Cristóbal Riquelme Santos,et al.  A Framework for Evaluating Land Use and Land Cover Classification Using Convolutional Neural Networks , 2019, Remote. Sens..

[34]  Xinwen Cheng,et al.  Evaluation of the Ability of Spectral Indices of Hydrocarbons and Seawater for Identifying Oil Slicks Utilizing Hyperspectral Images , 2018, Remote. Sens..

[35]  Bin Zhang,et al.  Three-dimensional convolutional neural network model for tree species classification using airborne hyperspectral images , 2020, Remote Sensing of Environment.

[36]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[37]  B. Hörig,et al.  Hydrocarbon Index – an algorithm for hyperspectral detection of hydrocarbons , 2004 .

[38]  Sébastien Angélliaume,et al.  Hyperspectral and Radar Airborne Imagery over Controlled Release of Oil at Sea , 2017, Sensors.

[39]  Bidyut Baran Chaudhuri,et al.  HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[40]  Licheng Jiao,et al.  CNN-Based Multilayer Spatial–Spectral Feature Fusion and Sample Augmentation With Local and Nonlocal Constraints for Hyperspectral Image Classification , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Jonathan Cheung-Wai Chan,et al.  Learning and Transferring Deep Joint Spectral–Spatial Features for Hyperspectral Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[43]  Bryan A. Franz,et al.  Chlorophyll aalgorithms for oligotrophic oceans: A novel approach based on three‐band reflectance difference , 2012 .

[44]  Tao Chen,et al.  Subcategory-Aware Feature Selection and SVM Optimization for Automatic Aerial Image-Based Oil Spill Inspection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Carl E. Brown,et al.  A Review of Oil Spill Remote Sensing , 2017, Sensors.

[46]  Wei Wei,et al.  Deep Cube-Pair Network for Hyperspectral Imagery Classification , 2018, Remote. Sens..

[47]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Aizhu Zhang,et al.  Deep Fusion of Localized Spectral Features and Multi-scale Spatial Features for Effective Classification of Hyperspectral Images , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[49]  Zhiming Luo,et al.  Spectral–Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Zheng Zhang,et al.  A Developed Siamese CNN with 3D Adaptive Spatial-Spectral Pyramid Pooling for Hyperspectral Image Classification , 2020, Remote. Sens..

[51]  Tiit Kutser,et al.  Mapping lake CDOM by satellite remote sensing , 2005 .

[52]  Jason Levy,et al.  Advances in Remote Sensing for Oil Spill Disaster Management: State-of-the-Art Sensors Technology for Oil Spill Surveillance , 2008, Sensors.

[53]  Mei-Ping Song,et al.  [Study of prediction models for oil thickness based on spectral curve]. , 2013, Guang pu xue yu guang pu fen xi = Guang pu.

[54]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.