TaylorMade VDD: Domain-adaptive Visual Defect Detector for High-mix Low-volume Production of Non-convex Cylindrical Metal Objects

Visual defect detection (VDD) for high-mix lowvolume production of non-convex metal objects, such as high-pressure cylindrical piping joint parts (VDDHPPPs), is challenging because subtle difference in domain (e.g., metal objects, imaging device, viewpoints, lighting) significantly affects the specular reflection characteristics of individual metal object types. In this paper, we address this issue by introducing a tailor-made VDD framework that can be automatically adapted to a new domain. Specifically, we formulate this adaptation task as the problem of network architecture search (NAS) on a deep object-detection network, in which the network architecture is searched via reinforcement learning. We demonstrate the effectiveness of the proposed framework using the VDD-HPPPs task as a factory case study. Experimental results show that the proposed method achieved higher burr detection accuracy compared with the baseline method for data with different training/test domains for the nonconvex HPPPs, which are particularly affected by domain shifts.

[1]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xianghua Xie,et al.  A Review of Recent Advances in Surface Defect Detection using Texture analysis Techniques , 2008 .

[3]  Jieping Ye,et al.  Object Detection in 20 Years: A Survey , 2019, Proceedings of the IEEE.

[4]  Ke Zhang,et al.  Detection Method Based on Automatic Visual Shape Clustering for Pin-Missing Defect in Transmission Lines , 2020, IEEE Transactions on Instrumentation and Measurement.

[5]  Dusmanta Kumar Mohanta,et al.  Review of vision-based steel surface inspection systems , 2014, EURASIP Journal on Image and Video Processing.

[6]  Irem Y. Tumer,et al.  A SURVEY OF AIRCRAFT ENGINE HEALTH MONITORING SYSTEMS , 1999 .

[7]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[8]  Shuyuan Yang,et al.  A Survey of Deep Learning-Based Object Detection , 2019, IEEE Access.

[9]  Ajay Kumar,et al.  Computer-Vision-Based Fabric Defect Detection: A Survey , 2008, IEEE Transactions on Industrial Electronics.

[10]  Yichuang Sun,et al.  Automated Visual Defect Detection for Flat Steel Surface: A Survey , 2020, IEEE Transactions on Instrumentation and Measurement.

[11]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[12]  Frank Hutter,et al.  Neural Architecture Search: A Survey , 2018, J. Mach. Learn. Res..

[13]  Charles A. Harlow,et al.  Automated Visual Inspection: A Survey , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Szu-Hao Huang,et al.  Automated visual inspection in the semiconductor industry: A survey , 2015, Comput. Ind..

[15]  Liang-Tien Chia,et al.  Convolutional networks for voting-based anomaly classification in metal surface inspection , 2017, 2017 IEEE International Conference on Industrial Technology (ICIT).

[16]  Anil K. Jain,et al.  A Survey of Automated Visual Inspection , 1995, Comput. Vis. Image Underst..

[17]  Quoc V. Le,et al.  NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[19]  Stefano Roccella,et al.  Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY , 2020, Sensors.