An underwater lighting and turbidity image repository for analysing the performance of image-based non-destructive techniques

Abstract Image processing-based methods, capable of detecting and quantifying cracks, surface defects or recovering 3D shape information are increasingly being recognised as a valuable tool for inspecting underwater structures. It is of great practical importance for inspectors to know the effectiveness of such techniques when applied in conditions. This paper considers an underwater environment characterised by poor visibility chiefly governed by the lighting and turbidity levels, along with a range of geometry and damage conditions of calibrated specimens. The paper addresses the relationship between underwater visibility and the performance of image-based methods through the development and calibration of a first open-source underwater lighting and turbidity image repository (ULTIR). ULTIR contains a large collection of images of submerged specimens that have been photographed under controlled lighting and turbidity levels featuring various forms of geometry and damage. ULTIR aims to facilitate inspectors when rationalising the use of image processing methods as part of an underwater inspection campaign and to enable researchers to efficiently evaluate the performance of image-based methods under realistic operating conditions. Stakeholders in underwater infrastructure can benefit through this first large, standardised, well-annotated, and freely available database of images and associated metadata.

[1]  J. R. Rudlin.  Reliability of inspection for fatigue cracks in offshore structures , 1996 .

[2]  Franck Schoefs,et al.  The αδ method for modelling expert judgement and combination of non-destructive testing tools in risk-based inspection context: application to marine structures , 2012 .

[3]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[4]  Vikram Pakrashi,et al.  Regionally Enhanced Multiphase Segmentation Technique for Damaged Surfaces , 2014, Comput. Aided Civ. Infrastructure Eng..

[5]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Sandro Barone,et al.  Experimentation of structured light and stereo vision for underwater 3D reconstruction , 2011 .

[7]  Vikram Pakrashi,et al.  Effects of Turbidity and Lighting on the Performance of an Image Processing based Damage Detection Technique , 2014 .

[8]  Franck Schoefs,et al.  Probabilistic modeling of inspection results for offshore structures , 2003 .

[9]  Ricardo Zaurin,et al.  Structural health monitoring using video stream, influence lines, and statistical analysis , 2011 .

[10]  R Frankbusby.  Underwater inspection/testing/ monitoring of offshore structures , 1979 .

[11]  Djamel Merad,et al.  Underwater image preprocessing for automated photogrammetry in high turbidity water: An application on the Arles-Rhone XIII roman wreck in the Rhodano river, France , 2012, 2012 18th International Conference on Virtual Systems and Multimedia.

[12]  Gerald J. Agin.  Computer Vision Systems for Industrial Inspection and Assembly , 1980, Computer.

[13]  Vikram Pakrashi,et al.  Texture Analysis Based Damage Detection of Ageing Infrastructural Elements , 2013, Comput. Aided Civ. Infrastructure Eng..

[14]  Gaurav S. Sukhatme,et al.  Multi-image stitching and scene reconstruction for evaluating defect evolution in structures , 2011 .

[15]  Rongxing Li,et al.  Digital underwater photogrammetric system for large scale underwater spatial information acquisition , 1997 .

[16]  Vikram Pakrashi,et al.  Acquisition and Analysis of Dynamic Responses of a Historic Pedestrian Bridge using Video Image Processing , 2015 .

[17]  S. Patsias,et al.  Damage Detection Using Optical Measurements and Wavelets , 2002 .

[18]  F. Cherqui,et al.  The consistency of visual sewer inspection data , 2013 .

[19]  Eduardo Júlio,et al.  Automatic concrete health monitoring: assessment and monitoring of concrete surfaces , 2014 .

[20]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[21]  Baris Baykant Alagöz.  Obtaining Depth Maps From Color Images By Region Based Stereo Matching Algorithms , 2008, ArXiv.

[22]  Tadeusz Uhl,et al.  Monitoring of a civil structure’s state based on noncontact measurements , 2013 .

[23]  Nam-Sik Kim,et al.  Vision-based monitoring system for evaluating cable tensile forces on a cable-stayed bridge , 2013 .

[24]  Werner Krattenthaler,et al.  Point correlation: a reduced-cost template matching technique , 1994, Proceedings of 1st International Conference on Image Processing.

[25]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[26]  Sayan Dey,et al.  Crack detection in concrete surfaces using image processing, fuzzy logic, and neural networks , 2012, 2012 IEEE Fifth International Conference on Advanced Computational Intelligence (ICACI).

[27]  Vikram Pakrashi,et al.  ROC dependent event isolation method for image processing based assessment of corroded harbour structures , 2010 .

[28]  Fabio Bruno,et al.  A Comparative Analysis between Active and Passive Techniques for Underwater 3D Reconstruction of Close-Range Objects , 2013, Sensors.

[29]  Vikram Pakrashi,et al.  A Comparison of Image Based 3D Recovery Methods for Underwater Inspections , 2014 .

[30]  Franck Schoefs,et al.  Quantitative evaluation of contactless impact echo for non-destructive assessment of void detection within tendon ducts , 2012 .

[31]  Brendan O'Flynn,et al.  DEPLOY: a long term deployment of a water quality sensor monitoring system , 2012 .

[32]  Dan M. Frangopol,et al.  Updating Bridge Reliability Based on Bridge Management Systems Visual Inspection Results , 2003 .

[33]  P.K. Ho,et al.  Stereo-motion that complements stereo and motion analyses , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Hamzah Arof,et al.  Discontinuities detection in welded joints based on inverse surface thresholding , 2011 .

[35]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[36]  R A Kirsch,et al.  Computer determination of the constituent structure of biological images. , 1971, Computers and biomedical research, an international journal.

[37]  Mohsen A. Issa,et al.  Behavior of masonry-infilled nonductile reinforced concrete frames , 2002 .

[38]  Carlo Tomasi,et al.  A Pixel Dissimilarity Measure That Is Insensitive to Image Sampling , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  R. B. Testa,et al.  Modal Analysis for Damage Detection in Structures , 1991 .

[40]  Franck Schoefs,et al.  Marine Growth Colonization Process in Guinea Gulf: Data Analysis , 2007 .

[41]  Shivprakash Iyer,et al.  Segmentation of Pipe Images for Crack Detection in Buried Sewers , 2006, Comput. Aided Civ. Infrastructure Eng..

[42]  M. R. Anderson.  NONDESTRUCTIVE TESTING OF OFFSHORE STRUCTURES , 1987 .

[43]  Gaurav S. Sukhatme,et al.  A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures , 2009 .

[44]  Yozo Fujino,et al.  Concrete Crack Detection by Multiple Sequential Image Filtering , 2012, Comput. Aided Civ. Infrastructure Eng..

[45]  James A. Sherwood,et al.  Damage detection and full surface characterization of a wind turbine blade using three-dimensional digital image correlation , 2013 .

[46]  Manjriker Gunaratne,et al.  Neural Network for Rapid Depth Evaluation of Shallow Cracks in Asphalt Pavements , 2004 .

[47]  D. S. Forsyth,et al.  The role of enhanced visual inspections in the new strategy for corrosion management , 2000 .

[48]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[49]  Salvatore Salamone,et al.  Multifractal analysis of crack patterns in reinforced concrete shear walls , 2016 .

[50]  Vikram Pakrashi,et al.  Evaluation of Camera Calibration Techniques for Quantifying Deterioration , 2016 .

[51]  E. J. Ramos.  UNDERWATER INSPECTION - THE STATE OF ART , 1992 .

[52]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[53]  A. A. Graham.  Siltation of stone-surface periphyton in rivers by clay-sized particles from low concentrations in suspention , 1990, Hydrobiologia.

[54]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Yun Yong Kim,et al.  Automated image processing technique for detecting and analysing concrete surface cracks , 2013 .

[56]  Paul Fieguth,et al.  Automated detection of cracks in buried concrete pipe images , 2006 .

[57]  E. Malis,et al.  3D Reconstruction of Natural Underwater Scenes Using the Stereovision System IRIS , 2007, OCEANS 2007 - Europe.

[58]  D. Aggelis,et al.  Improved crack monitoring in structural concrete by combined acoustic emission and digital image correlation techniques , 2016 .