A new graph-based semi-supervised method for surface defect classification

Abstract Vision-based defect classification is an important technology to control the quality of product in manufacturing system. As it is very hard to obtain enough labeled samples for model training in the real-world production, the semi-supervised learning which learns from both labeled and unlabeled samples is more suitable for this task. However, the intra-class variations and the inter-class similarities of surface defect, named as the poor class separation, may cause the semi-supervised methods to perform poorly with small labeled samples. While graph-based methods, such as graph convolution network (GCN), can solve the problem well. Therefore, this paper proposes a new graph-based semi-supervised method, named as multiple micrographs graph convolutional network (MMGCN), for surface defect classification. Firstly, MMGCN performs graph convolution by constructing multiple micrographs instead of a large graph, and labels unlabeled samples by propagating label information from labeled samples to unlabeled samples in the micrographs to obtain multiple labels. Weighting the labels can obtain the final label, which can solve the limitations of computation complexity and practicality of original GCN. Secondly, MMGCN divides unlabeled dataset into multiple batches and sets an accuracy threshold. When the model accuracy reaches the threshold, the unlabeled datasets are labeled in batches. A famous case has been used to evaluate the performance of the proposed method. The experimental results demonstrate that the proposed MMGCN can achieve better computation complexity and practicality than GCN. And for accuracy, MMGCN can also obtain the best performance and the best class separation in the comparison with other semi-supervised surface defect classification methods.

[1]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[2]  Youping Chen,et al.  Classification of surface defects on steel sheet using convolutional neural networks , 2017 .

[3]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[4]  Yunhui Yan,et al.  A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects , 2013 .

[5]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[6]  Xu Ke,et al.  Surface defect classification of steels with a new semi-supervised learning method , 2019, Optics and Lasers in Engineering.

[7]  Xinyu Li,et al.  A semi-supervised convolutional neural network-based method for steel surface defect recognition , 2020, Robotics Comput. Integr. Manuf..

[8]  Yilong Yin,et al.  Learning the Set Graphs: Image-Set Classification Using Sparse Graph Convolutional Networks , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[9]  Jianzhu Wang,et al.  Online Rail Surface Inspection Utilizing Spatial Consistency and Continuity , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Kay Chen Tan,et al.  A Generic Deep-Learning-Based Approach for Automated Surface Inspection , 2018, IEEE Transactions on Cybernetics.

[11]  Yundong Li,et al.  Deformable Patterned Fabric Defect Detection With Fisher Criterion-Based Deep Learning , 2017, IEEE Transactions on Automation Science and Engineering.

[12]  Celso André R. de Sousa,et al.  An overview on the Gaussian Fields and Harmonic Functions method for semi-supervised learning , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[13]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[14]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[15]  Jürgen Schmidhuber,et al.  Steel defect classification with Max-Pooling Convolutional Neural Networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[16]  Diego Carou,et al.  Residual stresses evaluation in precision milling of hardened steel based on the deflection-electrochemical etching technique , 2017 .

[17]  Hua Yang,et al.  An Unsupervised-Learning-Based Approach for Automated Defect Inspection on Textured Surfaces , 2018, IEEE Transactions on Instrumentation and Measurement.

[18]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[19]  M. Matuszewski,et al.  Using artificial intelligence models for the prediction of surface wear based on surface isotropy levels , 2018, Robotics and Computer-Integrated Manufacturing.

[20]  Joan Bruna,et al.  Few-Shot Learning with Graph Neural Networks , 2017, ICLR.

[21]  Hantao Yao,et al.  Adaptive Feature Fusion via Graph Neural Network for Person Re-identification , 2019, ACM Multimedia.

[22]  Yuxiao Hu,et al.  Learning a Spatially Smooth Subspace for Face Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Pieter Abbeel,et al.  A Simple Neural Attentive Meta-Learner , 2017, ICLR.

[25]  Di He,et al.  Design of multi-scale receptive field convolutional neural network for surface inspection of hot rolled steels , 2019, Image Vis. Comput..

[26]  Xi Vincent Wang,et al.  A Multilevel Information Fusion-Based Deep Learning Method for Vision-Based Defect Recognition , 2020, IEEE Transactions on Instrumentation and Measurement.

[27]  Qimai Li,et al.  Attributed Graph Learning with 2-D Graph Convolution , 2019, ArXiv.

[28]  Yigang He,et al.  A cost-effective and automatic surface defect inspection system for hot-rolled flat steel , 2016 .

[29]  Yu He,et al.  Semi-supervised defect classification of steel surface based on multi-training and generative adversarial network , 2019, Optics and Lasers in Engineering.

[30]  Artem Komarichev,et al.  Deep Semi-Supervised Learning , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[31]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[32]  Lei Yang,et al.  Learning to Cluster Faces on an Affinity Graph , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Bo Wang,et al.  Deep Co-Training for Semi-Supervised Image Recognition , 2018, ECCV.

[34]  Xinyu Li,et al.  A zero-shot learning method for fault diagnosis under unknown working loads , 2019, Journal of Intelligent Manufacturing.

[35]  Stephen T. Newman,et al.  Influence of cutting environments on surface integrity and power consumption of austenitic stainless steel , 2015 .