Unified detection method of aluminium profile surface defects: Common and rare defect categories

Abstract It is difficult to achieve automatic visual detection of aluminium profile surface defects (APSD) owing to their various categories, irregular shapes, random distribution, and unbalanced samples. Utilising the attention mechanism, the unified detection method attempts to address these challenges for both common and rare defects. We formulate our method as a variant of few-shot learning to recognise the common and rare defect categories. First, a category representation network is applied to extract common category feature maps (CCMs). Second, an attention module is proposed to generate the proposal feature maps (PMs) of each rare category. Third, rare category feature maps (RCMs) are transformed from the CCMs under the guidance of the PMs. Finally, the scores of each category are obtained through the spatial pooling of both CCMs and RCMs. Experimental results on our constructed dataset show that our method is effective and outperforms the state-of-the-art methods.

[1]  Zhe L. Lin,et al.  Top-Down Neural Attention by Excitation Backprop , 2016, International Journal of Computer Vision.

[2]  Grantham Pang,et al.  Fabric inspection based on the Elo rating method , 2016, Pattern Recognit..

[3]  Michael Ying Yang,et al.  A deep-learning-based approach for fast and robust steel surface defects classification , 2019, Optics and Lasers in Engineering.

[4]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[5]  N. H. C. Yung,et al.  Automated fabric defect detection - A review , 2011, Image Vis. Comput..

[6]  Xin-Bin Luo,et al.  A real-time algorithm for aluminum surface defect extraction on non-uniform image from CCD camera , 2014, 2014 International Conference on Machine Learning and Cybernetics.

[7]  Huchuan Lu,et al.  Multi-Source Weak Supervision for Saliency Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Hugo Larochelle,et al.  Optimization as a Model for Few-Shot Learning , 2016, ICLR.

[9]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[10]  Hyunjung Shim,et al.  Attention-Based Dropout Layer for Weakly Supervised Object Localization , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Xu Ke,et al.  Surface defect classification of steels with a new semi-supervised learning method , 2019, Optics and Lasers in Engineering.

[12]  Xing Guang Qi,et al.  Research on Key Technology of Cold-Rolled Aluminum Plate Surface Defect Detection System , 2013 .

[13]  Lei Zhang,et al.  G2DeNet: Global Gaussian Distribution Embedding Network and Its Application to Visual Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Cristian Sminchisescu,et al.  Semantic Segmentation with Second-Order Pooling , 2012, ECCV.

[15]  Feihong Yu,et al.  Automatic inspection system of surface defects on optical IR-CUT filter based on machine vision , 2014 .

[16]  Xin-Bin Luo,et al.  A real-time parallel combination segmentation method for aluminum surface defect images , 2015, 2015 International Conference on Machine Learning and Cybernetics (ICMLC).

[17]  Cewu Lu,et al.  Deep LAC: Deep localization, alignment and classification for fine-grained recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Cristian Sminchisescu,et al.  Matrix Backpropagation for Deep Networks with Structured Layers , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Yu He,et al.  Semi-supervised defect classification of steel surface based on multi-training and generative adversarial network , 2019, Optics and Lasers in Engineering.

[20]  Matthieu Cord,et al.  WELDON: Weakly Supervised Learning of Deep Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Qinggang Meng,et al.  An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features , 2020, IEEE Transactions on Instrumentation and Measurement.