Surface Scratch Detection of Monolithic Glass Panel Using Deep Learning Techniques

Glass has been widely used in the construction sector with various kinds of applications in recent decades. However, the surface scratches generated from manufacturing process and service stage such as windborne debris impacts may lead to a strength degradation of glass material. The microscopic cracks propagation from such scratches may hence trigger glass facture unexpectedly and yield serious safety problems. In order to detect the glass damage due to such scratches, traditional manual inspection techniques have many limitations. The latest development of deep learning technology has rendered the possibility to automate such damage detection process. However, most detection methods use bounding box to roughly locate the damage in grid-cell level. To precisely describe the location of scratches, a pixel-level instance segmentation Mask R-CNN model is proposed. A total number of 1032 images with scratches are collected by a microscopic camera system to build the training and validation dataset, in which the scratches are annotated manually in pixel level. Data augmentation is adopted to improve the diversity of the dataset. During the training process, transfer learning strategy is applied to obtain the feature parameters for reducing the computation cost. Test is then performed in new architectural glass panels to evaluate the performance of the model. Test results demonstrate that the proposed trained network is satisfactory, achieving a mean average precision of 96.5% and the detection missing rate of 1.9%.

[1]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[2]  Yang Yang,et al.  Instance-level recognition and quantification for concrete surface bughole based on deep learning , 2019, Automation in Construction.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Dimos Polyzois,et al.  Deep learning-based automatic volumetric damage quantification using depth camera , 2019, Automation in Construction.

[5]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[7]  F. Petit,et al.  Multiple scratch tests and surface-related fatigue properties of monolithic ceramics and soda lime glass , 2009 .

[8]  Wei Wang,et al.  Computer vision-based concrete crack detection using U-net fully convolutional networks , 2019, Automation in Construction.

[9]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[10]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[11]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[12]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[13]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[14]  Xiaochun Luo,et al.  Automatic Pixel‐Level Crack Detection and Measurement Using Fully Convolutional Network , 2018, Comput. Aided Civ. Infrastructure Eng..

[15]  J. Schneider,et al.  Characterisation of the scratch resistance of annealed and tempered architectural glass , 2012 .

[16]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[17]  ChaYoung-Jin,et al.  Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks , 2017 .

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[20]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Chul Min Yeum,et al.  Vision‐Based Automated Crack Detection for Bridge Inspection , 2015, Comput. Aided Civ. Infrastructure Eng..

[22]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).