Defect detection in vehicle mirror nonplanar surfaces with multi-scale atrous single-shot detect mechanism

Surface quality inspection is important for vehicle rearview mirrors. Surface quality defects, such as bubbles, particles, cracks, and scratches, may appear during the production process. Traditionally, manual inspection is time-consuming, laborious, low in accuracy, and costly. In recent years, object detectors based on deep learning have been used for defect detection [such as single shot detectors (SSDs)], and object detectors mostly detect the details of small objects at a shallow level. However, the lack of shallow semantic information will lead to inaccuracy. The deep layer has more semantic information, but the deep layer cannot be detected due to the effect of the complete convolutional layer in the convolutional neural network. In this article, we propose an enhanced SSD method to detect micro-defects on the nonplanar surface of vehicle rearview mirrors. We call it the multi-scale atrous single-shot detector (MSASSD). Specifically, we first replace the maximum pool depth layer with an unconscious convolutional layer to expand the receiving field without reducing the size of the input image. Then, we link the shallow layer to the deep layer through the fusion block to form new and rich fusion features for object detection. Finally, we use multi-scale features (including deep features and fusion features) to predict defects. The results show that our MSASSD method can improve the average accuracy of defect detection (about 1.2% compared with the SSD method), while the detection speed is equivalent (low about two frames per second compared to the SSD method).

[1]  Glenn Fung,et al.  Multicategory Proximal Support Vector Machine Classifiers , 2005, Machine Learning.

[2]  Niblack Thresholding,et al.  IMAGE SEGMENTATION BY USING THRESHOLDING TECHNIQUES FOR MEDICAL IMAGES , 2016 .

[3]  Kay Chen Tan,et al.  A Generic Deep-Learning-Based Approach for Automated Surface Inspection , 2018, IEEE Transactions on Cybernetics.

[4]  De Xu,et al.  Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks , 2018, Applied Sciences.

[5]  Qipeng Chen,et al.  Research on a Surface Defect Detection Algorithm Based on MobileNet-SSD , 2018, Applied Sciences.

[6]  De Xu,et al.  Weak scratch detection and defect classification methods for a large-aperture optical element , 2017 .

[7]  Kun Liu,et al.  Solar cell surface defect inspection based on multispectral convolutional neural network , 2018, Journal of Intelligent Manufacturing.

[8]  Zhong Wang,et al.  Research on surface defect detection of ceramic ball based on fringe reflection , 2017 .

[9]  Joachim M. Buhmann,et al.  Wheel Defect Detection With Machine Learning , 2018, IEEE Transactions on Intelligent Transportation Systems.

[10]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[11]  Hong-Dar Lin,et al.  Tiny surface defect inspection of electronic passive components using discrete cosine transform decomposition and cumulative sum techniques , 2008, Image Vis. Comput..

[12]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Abdelhamid Khabbazi,et al.  Applied multiresolution analysis to infrared images for defects detection in materials , 2017 .

[14]  Jian Gao,et al.  Automatic surface defect detection for mobile phone screen glass based on machine vision , 2017, Appl. Soft Comput..

[15]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[16]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[17]  Monika Sharma,et al.  Automatic texture defect detection using Gaussian mixture entropy modeling , 2017, Neurocomputing.

[18]  Hae Yong Kim,et al.  Beans quality inspection using correlation-based granulometry , 2015, Eng. Appl. Artif. Intell..

[19]  Yundong Li,et al.  Deformable Patterned Fabric Defect Detection With Fisher Criterion-Based Deep Learning , 2017, IEEE Transactions on Automation Science and Engineering.

[20]  Reinhold Ludwig,et al.  An Optical Surface Inspection and Automatic Classification Technique Using the Rotated Wavelet Transform , 2018, IEEE Transactions on Instrumentation and Measurement.

[21]  Yi-Gang Cen,et al.  Defect inspection for TFT-LCD images based on the low-rank matrix reconstruction , 2015, Neurocomputing.

[22]  Jiangtao Xi,et al.  Defect detection and classification of galvanized stamping parts based on fully convolution neural network , 2018, International Conference on Graphic and Image Processing.

[23]  Ari Ide-Ektessabi,et al.  A Contrast Adjustment Thresholding Method for Surface Defect Detection Based on Mesoscopy , 2015, IEEE Transactions on Industrial Informatics.