A Geometry-Based Method for the Spatio-Temporal Detection of Cracks in 4D-Reconstructions

We present a novel geometry-based approach for the detection of small-scale cracks in a temporal series of 3D-reconstructions of concrete objects such as pillars and beams of bridges and other infrastructure. The detection algorithm relies on a geometry-derived coloration of the 3D surfaces for computing the optical flow between time steps. Our filtering technique identifies cracks based on motion discontinuities in the local crack neighborhood. This approach avoids using the material color which is likely to change over time due to weathering and other environmental influences. In addition, we detect and exclude regions with significant local changes in geometry over time e.g. due to vegetation. We verified our method with reconstructions of a horizontal concrete beam under increasing vertical load at the center. For this case, where the main crack direction is known and a precise registration of the beam geometries over time exists, this approach produces accurate crack detection regardless of substantial color variations and is also able to mask out regions with simulated growth of vegetation over time.

[1]  Hongguang Li,et al.  Pixel-Wise Crack Detection Using Deep Local Pattern Predictor for Robot Application , 2018, Sensors.

[2]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[3]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[4]  Shuji Hashimoto,et al.  Fast crack detection method for large-size concrete surface images using percolation-based image processing , 2010, Machine Vision and Applications.

[5]  Subhajit Chaudhury,et al.  Spatial-Temporal Motion Field Analysis for Pixelwise Crack Detection on Concrete Surfaces , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[6]  Samuli Laine,et al.  Efficient Sparse Voxel Octrees , 2011, IEEE Trans. Vis. Comput. Graph..

[7]  Peter Cawley,et al.  Feasibility of digital image correlation for detection of cracks at fastener holes , 2009 .

[8]  Stéphane Roux,et al.  Fatigue microcrack detection with digital image correlation , 2011 .

[9]  Francois Barthelat,et al.  A Novel “Subset Splitting” Procedure for Digital Image Correlation on Discontinuous Displacement Fields , 2010 .

[10]  Yozo Fujino,et al.  Concrete Crack Detection by Multiple Sequential Image Filtering , 2012, Comput. Aided Civ. Infrastructure Eng..

[11]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[14]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[15]  Tamy Boubekeur,et al.  Detection of Geometric Temporal Changes in Point Clouds , 2016, Comput. Graph. Forum.

[16]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[17]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[18]  Federico Tombari,et al.  Unique shape context for 3d data description , 2010, 3DOR '10.

[19]  Shuji Hashimoto,et al.  Image‐Based Crack Detection for Real Concrete Surfaces , 2008 .

[20]  Guido Morgenthal,et al.  Framework for automated UAS-based structural condition assessment of bridges , 2019, Automation in Construction.

[21]  Renato Pajarola,et al.  An efficient multi-resolution framework for high quality interactive rendering of massive point clouds using multi-way kd-trees , 2012, The Visual Computer.

[22]  Luís A. Alexandre.  3D Descriptors for Object and Category Recognition: a Comparative Evaluation , 2012 .

[23]  Anand K. Gramopadhye,et al.  A survey of automation-enabled human-in-the-loop systems for infrastructure visual inspection , 2019, Automation in Construction.

[24]  Ning Wang,et al.  An improved algorithm for image crack detection based on percolation model , 2015 .

[25]  Hugh Alan Bruck,et al.  Digital image correlation using Newton-Raphson method of partial differential correction , 1989 .

[26]  Pascal Frossard,et al.  Graph-Based Compression of Dynamic 3D Point Cloud Sequences , 2015, IEEE Transactions on Image Processing.