A 2D Fully Convolutional Neural Network for Nearshore And Surf-Zone Bathymetry Inversion from Synthetic Imagery of Surf-Zone using the Model Celeris

Bathymetry has a first order impact on nearshore and surfzone hydrodynamics. Typical survey techniques are expensive and time-consuming, require specialized equipment, and are not feasible in a variety of situations (e.g. limited manpower and/or site access). However, the emergence of nearshore remote sensing platforms (e.g. Unmanned Aircraft Systems (UAS), towers, and satellites) from which high-resolution imagery of the sea-surface can be collected at frequent intervals, has created the potential for accurate bathymetric estimation from wave-inversion techniques without in-situ measurements. While a variety of physics-based algorithms have been applied to nearshore and surfzone bathymetric inversion problems, the commonly used approaches do not account for non-linear hydrodynamics that are prevalent during breaking waves. Models for estimating non-linear wave dynamics are slow and often require large amounts of computational power which make them unfeasible for rapid estimations of depth. Fully convolutional neural networks (FCNs) are a branch of artificial intelligence algorithms that have proven effective at computer vision tasks in semantic segmentation and regression problems. In this work, we consider the use of FCNs for inferring bathymetry from video-derived imagery. The FCN model presented shows the feasibility of using an AI system to perform bathymetric inversion on time-averaged images (timex) of realistic-looking, synthetically generated surfzone imagery from the hydrodynamic wave model Celeris (Tavakkol and Lynett 2017). Ongoing work includes extending the FCN to incorporate synthetic video frames as input as well as testing with actual tower and satellite imagery.

[1]  R. Holman,et al.  Data assimilation and bathymetric inversion in a two‐dimensional horizontal surf zone model , 2010 .

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Eric F Darve,et al.  Novel Data Assimilation Algorithm for Nearshore Bathymetry , 2019, Journal of Atmospheric and Oceanic Technology.

[4]  Atsushi Shimada,et al.  Two-step Transfer Learning for Semantic Plant Segmentation , 2018, ICPRAM.

[5]  Ronald Kemker,et al.  Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[6]  Robert A. Holman,et al.  Quantification of sand bar morphology: A video technique based on wave dissipation , 1989 .

[7]  Gregory W. Wilson,et al.  Surfzone State Estimation, with Applications to Quadcopter-Based Remote Sensing Data , 2018, Journal of Atmospheric and Oceanic Technology.

[8]  W. Rosenthal,et al.  Similarity of the wind wave spectrum in finite depth water: 1. Spectral form , 1985 .

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Katherine L. Brodie,et al.  Simultaneous Mapping of Coastal Topography and Bathymetry From a Lightweight Multicamera UAS , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Rafael Almar,et al.  Wave-derived coastal bathymetry from satellite video imagery: A showcase with Pleiades persistent mode , 2019, Remote Sensing of Environment.

[12]  Ap van Dongeren,et al.  Beach Wizard: Nearshore bathymetry estimation through assimilation of model computations and remote observations , 2008 .

[13]  Xiao Xiang Zhu,et al.  Semantic segmentation of slums in satellite images using transfer learning on fully convolutional neural networks , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[14]  R. Holman,et al.  A parametric model for barred equilibrium beach profiles , 2014 .

[15]  Suman Jana,et al.  DeepTest: Automated Testing of Deep-Neural-Network-Driven Autonomous Cars , 2017, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[16]  C. Obled,et al.  On the use of Empirical Orthogonal Function (EOF) analysis in the simulation of random fields , 1991 .

[17]  Nathaniel G. Plant,et al.  Short-term sandbar variability based on video imagery: Comparison between Time-Average and Time-Variance techniques , 2011 .

[18]  S. Elgar,et al.  Improving the time resolution of surfzone bathymetry using in situ altimeters , 2014, Ocean Dynamics.

[19]  R. Holman,et al.  A parametric model for barred equilibrium beach profiles: Two-dimensional implementation , 2016 .

[20]  Julien Michel,et al.  Remote Sensing Processing: From Multicore to GPU , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  S. Elgar,et al.  A surfzone morphological diffusivity estimated from the evolution of excavated holes , 2014 .

[22]  Michael K. Gaughan,et al.  AIRY WAVE THEORY AND BREAKER HEIGHT PREDICTION , 1972 .

[23]  Rafael Almar,et al.  Video-based depth inversion techniques, a method comparison with synthetic cases , 2018, Coastal Engineering.

[24]  Steven A Hughes,et al.  The TMA Shallow-Water Spectrum Description and Applications , 1984 .

[25]  Rafael Almar,et al.  Radon-Augmented Sentinel-2 Satellite Imagery to Derive Wave-Patterns and Regional Bathymetry , 2019, Remote. Sens..

[26]  R. Holman,et al.  Estimation of wave phase speed and nearshore bathymetry from video imagery , 2000 .

[27]  Jay Gao Bathymetric mapping by means of remote sensing : methods , accuracy and limitations , 2009 .

[28]  Nathaniel G. Plant,et al.  Ocean Wavenumber Estimation From Wave-Resolving Time Series Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[29]  J. A. Roelvink,et al.  Nearshore subtidal bathymetry from time-exposure video images , 2005 .

[30]  K. Holland,et al.  Remote Sensing Applications and Bathymetric Mapping in Coastal Environments , 2018, Advances in Coastal Hydraulics.

[31]  Huiming Tang,et al.  Pixel-wise regression using U-Net and its application on pansharpening , 2018, Neurocomputing.

[32]  R. Holman,et al.  The history and technical capabilities of Argus , 2007 .

[33]  Katherine L. Brodie,et al.  Surf Zone Characterization Using a Small Quadcopter: Technical Issues and Procedures , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[35]  R. Holman,et al.  Surf zone bathymetry and circulation predictions via data assimilation of remote sensing observations , 2014 .

[36]  Robert A. Holman,et al.  Littoral environmental reconnaissance using tactical imagery from unmanned aircraft systems , 2010, Defense + Commercial Sensing.

[37]  Hyeran Byun,et al.  Detecting Construction Equipment Using a Region-Based Fully Convolutional Network and Transfer Learning , 2018, J. Comput. Civ. Eng..

[38]  Nathaniel G. Plant,et al.  cBathy: A robust algorithm for estimating nearshore bathymetry , 2013 .

[39]  William A. Birkemeier,et al.  The Crab: A Unique Nearshore Surveying Vehicle , 1984 .

[40]  Ronald Kemker,et al.  Low-Shot Learning for the Semantic Segmentation of Remote Sensing Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[41]  P. Bruun Coast Erosion and the Development of Beach Profiles , 1954 .

[42]  A. Kurapov,et al.  Data Assimilation for Bathymetry Estimation at a Tidal Inlet , 2016 .

[43]  Ryosuke Shibasaki,et al.  A Stacked Fully Convolutional Networks with Feature Alignment Framework for Multi-Label Land-cover Segmentation , 2019, Remote. Sens..