MEASURING ARTIFICIAL REEFS USING A MULTI-CAMERA SYSTEM FOR UNMANNED UNDERWATER VEHICLES

Abstract. Artificial reefs provide an efficient way to improve marine life abundance in the oceans, including growth on the structure itself. Photogrammetric methods provide suitable tools to measure marine growth. This paper focusses on cubic reefs placed in Western Australia. The capturing platform featured a photogrammetric multi-sensor system for unmanned underwater vehicles attached to a low-cost vehicle BlueROV2. The multi-sensor system and its photogrammetric data captured was calibrated, adjusted and analyzed employing a structure-from-motion processing pipeline. Novel automated image masking techniques were developed and applied to the data to significantly reduce noise in the derived dense point clouds. Results show improvements of signal to noise ratio of more than 50 %, while maintaining a complete representation of the observed artificial reef.

[1]  Anne Jordt,et al.  Refractive Calibration of Underwater Cameras , 2012, ECCV.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[4]  Erica Nocerino,et al.  MULTI-CAMERA SYSTEM CALIBRATION OF A LOW-COST REMOTELY OPERATED VEHICLE FOR UNDERWATER CAVE EXPLORATION , 2018 .

[5]  Ryan M. Eustice,et al.  Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency , 2013, IEEE Transactions on Robotics.

[6]  Fangfang Liu,et al.  Semantic Segmentation of Underwater Images Based on Improved Deeplab , 2020, Journal of Marine Science and Engineering.

[7]  Long-Wen Chang,et al.  Fast defocus map estimation , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Anne-Gaëlle Allais,et al.  Evaluating the ecological status of cold-water coral habitats using non-invasive methods: An example from Cassidaigne canyon, northwestern Mediterranean Sea , 2019, Progress in Oceanography.

[9]  Daniel Cagara,et al.  Improving Underwater Obstacle Detection using Semantic Image Segmentation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[10]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[11]  James R. Tweedley,et al.  Reef vision: A citizen science program for monitoring the fish faunas of artificial reefs , 2018, Fisheries Research.

[12]  Lina J. Karam,et al.  Spatially-Varying Blur Detection Based on Multiscale Fused and Sorted Transform Coefficients of Gradient Magnitudes , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Mark H. Carr,et al.  Artificial Reefs: The Importance of Comparisons with Natural Reefs , 1997 .

[14]  Stefano Caselli,et al.  Investigation of Vision-Based Underwater Object Detection with Multiple Datasets , 2015 .

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  L. Neumann,et al.  a New Color Correction Method for Underwater Imaging , 2015 .

[17]  Hans-Gerd Maas,et al.  New developments in Multimedia Photogrammetry , 2001 .

[18]  Fabio Bruno,et al.  Guidelines for Underwater Image Enhancement Based on Benchmarking of Different Methods , 2018, Remote. Sens..

[19]  N. Conen,et al.  ON SCALE DEFINITION WITHIN CALIBRATION OF MULTI-CAMERA SYSTEMS IN MULTIMEDIA PHOTOGRAMMETRY , 2019 .

[20]  Wei Song,et al.  An Experimental-Based Review of Image Enhancement and Image Restoration Methods for Underwater Imaging , 2019, IEEE Access.

[21]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[22]  Mark Shortis,et al.  Calibration Techniques for Accurate Measurements by Underwater Camera Systems , 2015, Sensors.

[23]  Derya Akkaynak,et al.  Sea-Thru: A Method for Removing Water From Underwater Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Geert Verhoeven.  Focusing on out-of-focus : assessing defocus estimation algorithms for the benefit of automated image masking , 2018 .

[25]  Hans-Gerd Maas,et al.  On the Accuracy Potential in Underwater/Multimedia Photogrammetry , 2015, Sensors.

[26]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.