A Deep-Learning-based 3D Defect Quantitative Inspection System in CC Products Surface

To create an intelligent surface region of interests (ROI) 3D quantitative inspection strategy a reality in the continuous casting (CC) production line, an improved 3D laser image scanning system (3D-LDS) was established based on binocular imaging and deep-learning techniques. In 3D-LDS, firstly, to meet the requirements of the industrial application, the CCD laser image scanning method was optimized in high-temperature experiments and secondly, we proposed a novel region proposal method based on 3D ROI initial depth location for effectively suppressing redundant candidate bounding boxes generated by pseudo-defects in a real-time inspection process. Thirdly, a novel two-step defects inspection strategy was presented by devising a fusion deep CNN model which combined fully connected networks (for defects classification/recognition) and fully convolutional networks (for defects delineation). The 3D-LDS’ dichotomous inspection method of defects classification and delineation processes are helpful in understanding and addressing challenges for defects inspection in CC product surfaces. The applicability of the presented methods is mainly tied to the surface quality inspection for slab, strip and billet products.

[1]  Chenguang Bai,et al.  Simulation study on radiative imaging of pulverised coal combustion in blast furnace raceway , 2011 .

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Experimental study of surface defects in continuous casting using developed laser scanning system , 2011 .

[4]  Ke Xu,et al.  Surface Detection of Continuous Casting Slabs Based on Curvelet Transform and Kernel Locality Preserving Projections , 2013 .

[5]  Guillermo Sapiro,et al.  Continuous Dice Coefficient: a Method for Evaluating Probabilistic Segmentations , 2018, bioRxiv.

[6]  L. Wen,et al.  Surface defects inspection method in hot slab continuous casting process , 2011 .

[7]  Qijie Zhao,et al.  Toward intelligent manufacturing: label characters marking and recognition method for steel products with machine vision , 2014, Advances in Manufacturing.

[8]  Xu Ke,et al.  Surface defect recognition for moderately thick plates based on a SIFT operator , 2018 .

[9]  Kincho H. Law,et al.  Automatic localization of casting defects with convolutional neural networks , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[10]  J. A. Spim,et al.  Mathematical modeling and optimization strategies (genetic algorithm and knowledge base) applied to the continuous casting of steel , 2003 .

[11]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[12]  Xu Ke,et al.  Surface defect classification of steels with a new semi-supervised learning method , 2019, Optics and Lasers in Engineering.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Daniel Jiwoong Im,et al.  An empirical analysis of the optimization of deep network loss surfaces , 2016, 1612.04010.

[15]  Imre KISS,et al.  ASSESSMENT OF SURFACE DEFECTS IN THE CONTINUOUSLY CAST STEEL , 2011 .

[16]  Ke Xu,et al.  Feature extraction based on contourlet transform and its application to surface inspection of metals , 2012 .

[17]  Yu Xue,et al.  Text classification based on deep belief network and softmax regression , 2016, Neural Computing and Applications.

[18]  Min Young Kim,et al.  Deep learning based 3D defect detection system using photometric stereo illumination , 2019, 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[19]  Yi Zhang,et al.  Defect inspection in hot slab surface: multi-source CCD imaging based fuzzy-rough sets method , 2016, Optical Engineering + Applications.

[20]  Ke Xu.  3D Detection Technique of Surface Defects for Steel Rails Based on Linear Lasers , 2010 .

[21]  Gang Li,et al.  Inspection of Aircraft Engine Components Using Induction Thermography , 2018, 2018 IEEE Canadian Conference on Electrical & Computer Engineering (CCECE).

[22]  Ge Zhang,et al.  Approaches for improvement of the X-ray image defect detection of automobile casting aluminum parts based on deep learning , 2019, NDT & E International.

[23]  Chih-Yang Lin,et al.  Vision-based Detection of Steel Billet Surface Defects via Fusion of Multiple Image Features , 2014, ICS.

[24]  Yu He,et al.  PGA-Net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection , 2020, IEEE Transactions on Industrial Informatics.

[25]  Dominik Sankowski,et al.  Computer vision system for high temperature measurements of surface properties , 2008, Machine Vision and Applications.

[26]  Dengfu Chen,et al.  Experimental study on quantitative surface defect depth detection based on laser scanning technology in continuous casting , 2011 .

[27]  Huiqian Wang,et al.  Defect detection in slab surface: a novel dual Charge-coupled Device imaging-based fuzzy connectedness strategy. , 2014, The Review of scientific instruments.

[28]  Ismael Serrano,et al.  A Robust and Fast Deep Learning-Based Method for Defect Classification in Steel Surfaces , 2018, 2018 International Conference on Intelligent Systems (IS).

[29]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[30]  Jan-Peter Muller,et al.  Crack Detection in "As-Cast" Steel Using Laser Triangulation and Machine Learning , 2016, 2016 13th Conference on Computer and Robot Vision (CRV).

[31]  Dongmin Seo,et al.  A review of recent progress in lens-free imaging and sensing. , 2017, Biosensors & bioelectronics.

[32]  Ming-Fang Weng,et al.  Fast image stitching for continuous casting steel billet images , 2016, 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

[33]  Brian G. Thomas,et al.  Review on Modeling and Simulation of Continuous Casting , 2018 .

[34]  Yunhui Yan,et al.  A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects , 2013 .

[35]  Qinggang Meng,et al.  An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features , 2020, IEEE Transactions on Instrumentation and Measurement.

[36]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[37]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.