Defect detection of hot rolled steels with a new object detection framework called classification priority network

Abstract The defect detection is extremely crucial to analyze the surface quality of steel products, it not only affects the subsequent production, but also affects the corrosion and wear resistance of the end products. However, the low classification and detection rates of the conventional algorithms cannot satisfy the demands of some steel production lines, such as hot rolled plates. To improve the accuracy of defect inspection, we present a new object detection framework, classification priority network (CPN), and a new classification network, multi-group convolutional neural network (MG-CNN), to inspect the defects of steel surface. In CPN, the image is first classified by MG-CNN, which trains different groups of convolution kernels separately to extract the feature map groups of different types defects. Then, according to the classification result, the feature map groups that may contain defects is separately input into another neural network, which is build based on yolo, to regress the bounding boxes of the corresponding defects. Extensive experiments are carried out on samples from different steel production lines indicate that the proposed method had yielded best performances compared with prior methods used in defect inspection. The average detection rates of surface defects in hot rolled plates and strips are higher than 94%, and the classification rates of in above production lines are above 96%.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Sahib Khan,et al.  Ant Colony Optimization (ACO) based Data Hiding in Image Complex Region , 2018 .

[4]  B. Suvdaa,et al.  Steel Surface Defects Detection and Classification Using SIFT and Voting Strategy , 2012 .

[5]  Sang Woo Kim,et al.  Automatic detection of cracks in raw steel block using Gabor filter optimized by univariate dynamic encoding algorithm for searches (uDEAS) , 2009 .

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[8]  Xiaodong Cui,et al.  Data Augmentation for Deep Neural Network Acoustic Modeling , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[9]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[10]  Ke Xu,et al.  Application of RNAMlet to surface defect identification of steels , 2018, Optics and Lasers in Engineering.

[11]  V. Sugumaran,et al.  Machine learning approach for automated visual inspection of machine components , 2011, Expert Syst. Appl..

[12]  Ke Xu,et al.  An Algorithm for Surface Defect Identification of Steel Plates Based on Genetic Algorithm and Extreme Learning Machine , 2017 .

[13]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Ke Xu,et al.  Application of Shearlet transform to classification of surface defects for metals , 2015, Image Vis. Comput..

[16]  Anders Landström,et al.  Morphology-Based Crack Detection for Steel Slabs , 2012, IEEE Journal of Selected Topics in Signal Processing.

[17]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[19]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[20]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).