A weak supervision machine vision detection method based on artificial defect simulation

Abstract During a practical detection process, insufficient defect data, unbalanced defect types and the high cost of defect labeling can present problems. Therefore, it often takes considerable time and labor to collect actual samples to improve the accuracy of defect classification and recognition. In this paper, we propose a weak supervision machine vision detection method based on artificial defect simulation. First, four typical mobile phone screen defects – scratches, floaters, light stains and severe stains – are simulated by the proposed synthesis algorithms, and an artificial defect database is created. Next, the artificial dataset is applied to a deep learning recognition algorithm, and an initial model is trained. Then, the collected actual defects are augmented due to the insufficient training quantity. The augmented actual defects are then applied as the training data, and the initial model is retrained by fine tuning. Finally, the well-retrained model is used for defect recognition. The experimental results demonstrate that satisfactory performance is achieved with the proposed detection method.

[1]  Shashi Phoha,et al.  Application of supervised machine learning for defect detection during metallic powder bed fusion additive manufacturing using high resolution imaging. , 2018 .

[2]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[3]  Alexandr A. Kalinin,et al.  Albumentations: fast and flexible image augmentations , 2018, Inf..

[4]  Matthias Haselmann,et al.  Supervised Machine Learning Based Surface Inspection by Synthetizing Artificial Defects , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[5]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[6]  Yunhui Yan,et al.  A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects , 2013 .

[7]  Tae-Hyoung Park,et al.  SMT defect classification by feature extraction region optimization and machine learning , 2018, The International Journal of Advanced Manufacturing Technology.

[8]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[9]  Jianmin Gao,et al.  Weld defect classification based on texture features and principal component analysis , 2016 .

[10]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[11]  Szu-Hao Huang,et al.  Automated visual inspection in the semiconductor industry: A survey , 2015, Comput. Ind..

[12]  Wen Zhang,et al.  A review on weed detection using ground-based machine vision and image processing techniques , 2019, Comput. Electron. Agric..

[13]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[14]  Alejandro F. Frangi,et al.  Simulation and Synthesis in Medical Imaging , 2018, IEEE Trans. Medical Imaging.

[15]  Arun Ross,et al.  Synthesis of iris images using Markov Random Fields , 2005, 2005 13th European Signal Processing Conference.

[16]  Joachim M. Buhmann,et al.  Wheel Defect Detection With Machine Learning , 2018, IEEE Transactions on Intelligent Transportation Systems.

[17]  Yibin Huang,et al.  Surface defect saliency of magnetic tile , 2018, The Visual Computer.

[18]  Michał Grochowski,et al.  Data augmentation for improving deep learning in image classification problem , 2018, 2018 International Interdisciplinary PhD Workshop (IIPhDW).

[19]  Jiebo Luo,et al.  Online Similarity Learning for Big Data with Overfitting , 2018, IEEE Transactions on Big Data.

[20]  L. Deng,et al.  The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web] , 2012, IEEE Signal Processing Magazine.

[21]  Carlo Alberto Avizzano,et al.  A Smart Monitoring System for Automatic Welding Defect Detection , 2019, IEEE Transactions on Industrial Electronics.

[22]  Bin Yang,et al.  Automated Detection of Solar Cell Defects with Deep Learning , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[23]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[24]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[25]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.