Marine Pollution Bulletin Increasing the Sentinel-2 potential for marine plastic litter monitoring through image fusion techniques

Sentinel-2 (S2) images have been used in several projects to detect large accumulations of marine litter and plastic targets. Their limited spatial resolution though hinders the detection of relatively small floating accumulations of marine debris. Thus, this study aims at overcoming this limit through the exploration of fusion with very high-resolution WorldView-2/3 (WV-2/3) images. Various state-of-the-art approaches (component substitution, spectral unmixing, deep learning) were applied on data collected in synchronized acquisitions of plastic targets of various sizes and materials in seawater. The fused images were evaluated for spectral and spatial distortions, as well as their ability to spectrally discriminate plastics from water. Several WV-2/3 band combinations were investigated and five litter indexes were applied. Results showed that: a) the VNIR combination is the optimal one, b) the smallest observable plastic target is 0.6×0.6 m 2 and c) SWIR bands are important for marine litter detection.

[1]  K. Topouzelis,et al.  Floating marine litter detection algorithms and techniques using optical remote sensing data: A review. , 2021, Marine pollution bulletin.

[2]  P. M. Salgado-Hernanz,et al.  Assessment of marine litter through remote sensing: recent approaches and future goals. , 2021, Marine pollution bulletin.

[3]  Yunhe Li,et al.  Super-Resolution of Sentinel-2 Images at 10m Resolution without Reference Images , 2021 .

[4]  Srikanta Sannigrahi,et al.  Development of Novel Classification Algorithms for Detection of Floating Plastic Debris in Coastal Waterbodies Using Multispectral Sentinel-2 Remote Sensing Imagery , 2021, Remote. Sens..

[5]  Maria Kremezi,et al.  Pansharpening PRISMA Data for Marine Plastic Litter Detection Using Plastic Indexes , 2021, IEEE Access.

[6]  J. Yu,et al.  A Novel Approach to Quantitative Evaluation of Outer Retinal Lesions Via a New Parameter “Integral” in Spectral Domain Optical Coherence Tomography , 2020, Translational vision science & technology.

[7]  Verónica Vilaplana,et al.  Super-Resolution of Sentinel-2 Imagery Using Generative Adversarial Networks , 2020, Remote. Sens..

[8]  Manuel Arias,et al.  Remote Sensing of Sea Surface Artificial Floating Plastic Targets with Sentinel-2 and Unmanned Aerial Systems (Plastic Litter Project 2019) , 2020, Remote. Sens..

[9]  Konstantinos Karantzalos,et al.  Remotely Sensing the Source and Transport of Marine Plastic Debris in Bay Islands of Honduras (Caribbean Sea) , 2020, Remote. Sens..

[10]  K. Topouzelis,et al.  Finding Plastic Patches in Coastal Waters using Optical Satellite Data , 2020, Scientific Reports.

[11]  S. Suh,et al.  Degradation Rates of Plastics in the Environment , 2020 .

[12]  Jie Hu,et al.  Sentinel-2 Sharpening via Parallel Residual Network , 2020, Remote. Sens..

[13]  B. Demir,et al.  An Approach To Super-Resolution Of Sentinel-2 Images Based On Generative Adversarial Networks , 2019, 2020 Mediterranean and Middle-East Geoscience and Remote Sensing Symposium (M2GARSS).

[14]  Giuseppe Scarpa,et al.  Fast Super-Resolution of 20 m Sentinel-2 Bands Using Convolutional Neural Networks , 2019, Remote. Sens..

[15]  Richard C. Thompson,et al.  Toward the Integrated Marine Debris Observing System , 2019, Front. Mar. Sci..

[16]  H. Plag,et al.  An introduction to the ‘Oceans and Society: Blue Planet’ initiative , 2019, Journal of Operational Oceanography.

[17]  Konstantinos N. Topouzelis,et al.  Detection of floating plastics from satellite and unmanned aerial systems (Plastic Litter Project 2018) , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[18]  Yang Xu,et al.  Super-Resolution of Sentinel-2 Images Based on Deep Channel-Attention Residual Network , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[19]  Maria Kremezi,et al.  Correcting the BRDF effects on Sentinel-2 ocean images , 2019, International Conference on Remote Sensing and Geoinformation of Environment.

[20]  A. Turra,et al.  Guidelines for the monitoring and assessment of plastic litter in the ocean , 2019 .

[21]  A. Dagnino,et al.  Plastic-associated harmful microalgal assemblages in marine environment. , 2019, Environmental pollution.

[22]  Stephen Marshall,et al.  Activation Functions: Comparison of trends in Practice and Research for Deep Learning , 2018, ArXiv.

[23]  T. Acuña-Ruz,et al.  Anthropogenic marine debris over beaches: Spectral characterization for remote sensing applications , 2018, Remote Sensing of Environment.

[24]  Lonneke Goddijn-Murphy,et al.  Proof of concept for a model of light reflectance of plastics floating on natural waters. , 2018, Marine pollution bulletin.

[25]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[26]  Johannes R. Sveinsson,et al.  Sentinel-2 Image Fusion Using a Deep Residual Network , 2018, Remote. Sens..

[27]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[28]  Abien Fred Agarap.  Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[29]  Konrad Schindler,et al.  Super-Resolution of Sentinel-2 Images: Learning a Globally Applicable Deep Neural Network , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  H. Dierssen,et al.  An airborne remote sensing case study of synthetic hydrocarbon detection using short wave infrared absorption features identified from marine-harvested macro- and microplastics , 2018 .

[31]  Davide Cozzolino,et al.  Target-Adaptive CNN-Based Pansharpening , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Konrad Schindler,et al.  Hyperspectral Super-Resolution with Spectral Unmixing Constraints , 2017, Remote. Sens..

[33]  Junfeng Yang,et al.  PanNet: A Deep Network Architecture for Pan-Sharpening , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Naoto Yokoya,et al.  Hyperspectral and Multispectral Data Fusion: A comparative review of the recent literature , 2017, IEEE Geoscience and Remote Sensing Magazine.

[36]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Chuanmin Hu,et al.  Mapping and quantifying Sargassum distribution and coverage in the Central West Atlantic using MODIS observations , 2016 .

[38]  Davide Cozzolino,et al.  Pansharpening by Convolutional Neural Networks , 2016, Remote. Sens..

[39]  Simon J. Godsill,et al.  Multiband Image Fusion Based on Spectral Unmixing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  P. Kershaw.  Marine plastic debris and microplastics – Global lessons and research to inspire action and guide policy change , 2016 .

[42]  Konrad Schindler,et al.  Hyperspectral Super-Resolution by Coupled Spectral Unmixing , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[43]  Chuanmin Hu,et al.  Spectral and spatial requirements of remote measurements of pelagic Sargassum macroalgae , 2015 .

[44]  Ajmal S. Mian,et al.  Bayesian sparse representation for hyperspectral image super resolution , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[46]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[47]  C. Wilcox,et al.  Plastic waste inputs from land into the ocean , 2015, Science.

[48]  Jean-Yves Tourneret,et al.  Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation , 2015, IEEE Transactions on Image Processing.

[49]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[50]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[52]  A. Hegde,et al.  A Review of Quality Metrics for Fused Image , 2015 .

[53]  Yahya Al-Hazmi,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2014, ICPP 2014.

[54]  Subhasis Chaudhuri,et al.  A novel approach to quantitative evaluation of hyperspectral image fusion techniques , 2013, Inf. Fusion.

[55]  P. Reinartz,et al.  HYPERSPECTRAL IMAGE RESOLUTION ENHANCEMENT BASED ON SPECTRAL UNMIXING AND INFORMATION FUSION , 2012 .

[56]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Bryan A. Franz,et al.  Chlorophyll aalgorithms for oligotrophic oceans: A novel approach based on three‐band reflectance difference , 2012 .

[58]  Naoto Yokoya,et al.  Coupled non-negative matrix factorization (CNMF) for hyperspectral and multispectral data fusion: Application to pasture classification , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[59]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[60]  Chia-Jung Lu,et al.  Development of a Novel , 2011 .

[61]  Olivier Berné,et al.  Non-negative matrix factorization pansharpening of hyperspectral data: An application to mid-infrared astronomy , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[62]  Li Fei-Fei,et al.  ImageNet: Constructing a large-scale image database , 2010 .

[63]  Chuanmin Hu.  A novel ocean color index to detect floating algae in the global oceans , 2009 .

[64]  José M. Bioucas-Dias,et al.  A variable splitting augmented Lagrangian approach to linear spectral unmixing , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[65]  C. Moore,et al.  Persistent organic pollutants carried by synthetic polymers in the ocean environment. , 2007, Marine pollution bulletin.

[66]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[67]  B. Hörig,et al.  Hydrocarbon Index – an algorithm for hyperspectral detection of hydrocarbons , 2004 .

[68]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[69]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .