On the Autonomous Inspection and Classification of Marine Growth on Subsea Structures

Marine growth challenges the structural integrity of offshore facilities due to increased hydro dynamical loads. As a consequence, marine growth cleaning on offshore structures has been performed for many years. While the industry has shifted from diver-assisted to cleaning driven by remotely operated vehicles, the process remains costly and ineffective. This paper explores the possibilities for introducing an increased level of automation for marine growth inspection and classification. Specific attention is given to sensor technologies and methods for constructing a 3D representation of the offshore structures in order to assess the thickness and composition of marine growth. While optical-based methods show positive potential further work is needed to investigate the robustness to flicking sunlight and turbidity issues experienced in areas close to the water surface. The review of classification methods reveals several promising approaches where deep learning is applied for the categorization of marine growth. The training relies on large databases of relevant images which are not currently available for marine growth on offshore structures. Further work is needed for investigating if virtual images can be used in combination with a reduced set of real images.

[1]  Jesper Liniger,et al.  On Marine Growth Removal on Offshore Structures , 2022, OCEANS 2022 - Chennai.

[2]  David Doubilet.  Light in the Sea , 2022, World Literature Today.

[3]  Fabio Menna,et al.  Underwater Survey for Oil and Gas Industry: A Review of Close Range Optical Methods , 2021, Remote. Sens..

[4]  Marco Reggiannini,et al.  The Use of Saliency in Underwater Computer Vision: A Review , 2020, Remote. Sens..

[5]  Hao Leng,et al.  Deformation Analysis of Large Diameter Monopiles of Offshore Wind Turbines under Scour , 2020, Applied Sciences.

[6]  Henrik Stiesdal,et al.  Technical Definition of the TetraSpar Demonstrator Floating Wind Turbine Foundation , 2020, Energies.

[7]  Zhaojun Liu,et al.  Underwater Hyperspectral Imaging Technology and Its Applications for Detecting and Mapping the Seafloor: A Review , 2020, Sensors.

[8]  Susan Wei,et al.  Automating the assessment of biofouling in images using expert agreement as a gold standard , 2020, Scientific Reports.

[9]  Francisco Herrera,et al.  Coral species identification with texture or structure images using a two-level classifier based on Convolutional Neural Networks , 2019, Knowl. Based Syst..

[10]  Mahesh K. Banavar,et al.  Time-of-Flight (ToF) Cameras for Underwater Situational Awareness , 2019, OCEANS 2019 MTS/IEEE SEATTLE.

[11]  Daoliang Li,et al.  Survey of underwater robot positioning navigation , 2019, Applied Ocean Research.

[12]  Panagiotis Agrafiotis,et al.  State of the art and applications in archaeological underwater 3D recording and mapping , 2018, Journal of Cultural Heritage.

[13]  Vikram Pakrashi,et al.  Semantic Segmentation of Underwater Imagery Using Deep Networks Trained on Synthetic Imagery , 2018, Journal of Marine Science and Engineering.

[14]  Jostein Thorstensen,et al.  Real-time super-resolved 3D in turbid water using a fast range-gated CMOS camera. , 2018, Applied optics.

[15]  Claire Hinton,et al.  Automated Image Analysis of Offshore Infrastructure Marine Biofouling , 2018 .

[16]  ASM Shihavuddin.  Coral reef dataset , 2017 .

[17]  Maode Ma,et al.  Intelligent Image Recognition System for Marine Fouling Using Softmax Transfer Learning and Deep Convolutional Neural Networks , 2017, Complex..

[18]  Joshua P. Lord.  Impact of seawater temperature on growth and recruitment of invasive fouling species at the global scale , 2017 .

[19]  Gabriele Ferri,et al.  Underwater optical and acoustic imaging: A time for fusion? a brief overview of the state-of-the-art , 2016, OCEANS 2016 MTS/IEEE Monterey.

[20]  Mark R. Pickering,et al.  3D Mapping for Visualization of Rigid Structures: A Review and Comparative Study , 2016, IEEE Sensors Journal.

[21]  Raeanne G. Miller,et al.  Marine Growth Mapping and Monitoring: Feasibility of Predictive Mapping of Marine Growth , 2016 .

[22]  Gabriel Oliver,et al.  Optical Sensors and Methods for Underwater 3D Reconstruction , 2015, Sensors.

[23]  Chris Roelfsema,et al.  Towards Automated Annotation of Benthic Survey Images: Variability of Human Experts and Operational Modes of Automation , 2015, PloS one.

[24]  Yvan Petillot,et al.  Structured light and stereo vision for underwater 3D reconstruction , 2015, OCEANS 2015 - Genova.

[25]  Jia Yu,et al.  3D color reconstruction based on underwater RGB laser line scanning system , 2014 .

[26]  Fabio Bruno,et al.  3D documentation and monitoring of the experimental cleaning operations in the underwater archaeological site of Baia (Italy) , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[27]  Mark Hardy,et al.  Autonomous inspection using an underwater 3D LiDAR , 2013, 2013 OCEANS - San Diego.

[28]  Chang-Wan Kim,et al.  Study on the marine growth effect on the dynamic response of offshore wind turbines , 2012 .

[29]  Stefan B. Williams,et al.  Colour-Consistent Structure-from-Motion Models using Underwater Imagery , 2012, Robotics: Science and Systems.

[30]  P. J. Sanz,et al.  An approach for semi-autonomous recovery of unknown objects in underwater environments , 2012, 2012 13th International Conference on Optimization of Electrical and Electronic Equipment (OPTIM).

[31]  Ben Upcroft,et al.  Towards automated and in-situ, near-real time 3-D reconstruction of coral reef environments , 2011, OCEANS'11 MTS/IEEE KONA.

[32]  Takashi Sakamaki,et al.  3D visual modeling of hydrothermal chimneys using a rotary laser scanning system , 2011, 2011 IEEE Symposium on Underwater Technology and Workshop on Scientific Use of Submarine Cables and Related Technologies.

[33]  X. Cufi,et al.  Calibration of optical camera coupled to acoustic multibeam for underwater 3D scene reconstruction , 2010, OCEANS'10 IEEE SYDNEY.

[34]  Shahriar Negahdaripour,et al.  Efficient three‐dimensional scene modeling and mosaicing , 2009, J. Field Robotics.

[35]  Shahriar Negahdaripour,et al.  Opti-Acoustic Stereo Imaging: On System Calibration and 3-D Target Reconstruction , 2009, IEEE Transactions on Image Processing.

[36]  Fraser Dalgleish,et al.  Improved LLS imaging performance in scattering-dominant waters , 2009, Defense + Commercial Sensing.

[37]  Stefan B. Williams,et al.  Efficient View-Based SLAM Using Visual Loop Closures , 2008, IEEE Transactions on Robotics.

[38]  H. Singh,et al.  Photogrammetric models for marine archaeology , 2006, OCEANS 2006.

[39]  S. Nayar,et al.  Structured light methods for underwater imaging: light stripe scanning and photometric stereo , 2005, Proceedings of OCEANS 2005 MTS/IEEE.

[40]  Wenxia Yan,et al.  Fouling of Offshore Structures in China-a Review , 2003, Biofouling.

[41]  J. Wolfram,et al.  Hydrodynamic Loading on Macro-Roughened Cylinders of Various Aspect Ratios , 1989 .

[42]  Mohammed Bennamoun,et al.  Deep Learning for Marine Species Recognition , 2019, Handbook of Deep Learning Applications.

[43]  Qiao Xi,et al.  Review of Underwater Machine Vision Technology and Its Applications , 2017 .

[44]  V. Pakrashi,et al.  The dynamic effects of marine growth on a tension moored floating wind turbine , 2016 .

[45]  K. D. Moore,et al.  Underwater Optical Imaging: Status and Prospects , 2001 .

[46]  V. Pakrashi,et al.  THE DYNAMIC EFFECTS OF MARINE GROWTH ON A POINT ABSORBING WAVE ENERGY CONVERTOR , 2022 .