Application of Multi-Scale Feature Fusion and Deep Learning in Detection of Steel Strip Surface Defect

Surface defect detection forms an integral part of steel quality control. There are many challenges in defect detection. Firstly, the sample size of steel strip is small which is leading to the over-fitting and low detection rate. Secondly, there are many tiny and slender defects on the surface of steel strip, and most of them have less information available for detection. In this paper, firstly, we augment the NEU dataset of six kinds of typical surface defects on hot-rolled steel strip to increase detection rate. Then, we improve Faster R-CNN and FPN networks and adopt multi-scale feature fusion to encourage the reusing of low-level features. Finally, we conducted detection experiments to evaluate the effect of data augmentation and multi-scale feature fusion. The result shows that the mAP of our network reached 98.26% and our algorithms achieved higher detection accuracy and located the position of defects more accurately, especially enhanced the detection effect of tiny and slender defects.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Jie Zhao,et al.  Steel surface defects recognition based on multi-label classifier with hyper-sphere support vector machine , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[3]  Rixian Liu,et al.  Surface Defect Detection Based on Deep Convolutional Siamese Networks and Defect Saliency , 2019 .

[4]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Qinggang Meng,et al.  An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features , 2020, IEEE Transactions on Instrumentation and Measurement.

[6]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[7]  Reinhold Huber-Mörk,et al.  Convolutional Neural Networks for Steel Surface Defect Detection from Photometric Stereo Images , 2014, ISVC.

[8]  Yixin Yin,et al.  Real-time Detection of Steel Strip Surface Defects Based on Improved YOLO Detection Network , 2018 .

[9]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Yi Lu Murphey,et al.  An intelligent real-time vision system for surface defect detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Michel Couprie,et al.  Some links between min-cuts, optimal spanning forests and watersheds , 2007, ISMM.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Menglong Yan,et al.  Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks , 2018, Remote. Sens..

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Weicun Zhang,et al.  Real-Time Classification of Steel Strip Surface Defects Based on Deep CNNs , 2019 .

[16]  Dusmanta Kumar Mohanta,et al.  Review of vision-based steel surface inspection systems , 2014, EURASIP Journal on Image and Video Processing.

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Mahmoud Fakhr,et al.  Steel Plates Faults Diagnosis with Data Mining Models , 2012 .