Large-Complex-Surface Defect Detection by Hybrid Gradient Threshold Segmentation and Image Registration

Machine vision-based object detection techniques have been widely used in product inspection, defect detection, and dimension measurement. These techniques have largely improved the efficiency of industrial production and increased the level of production autonomy. However, demands on advance hardware design and image processing algorithms are needed for the quality inspection of a large-complex-surface. In order to solve this problem, a hybrid surface defect detection method is developed. An image of the product surface is first divided into two areas: background with similar features and special pattern area, such as product trademarks. For the background area, defects have significant differences in gray intensity from the normal area. Fault detection is conducted using a gradient threshold segmentation method that can limit segmentation errors arising from uneven illuminations. For the special pattern area, image registration and image difference are adopted to detect defects, which are adaptive to irregular image contents with discontinuous shapes and appearances. Experimental results indicate that the proposed method achieves about 1.21 times and 2.94 times higher accuracy, in F-measure, for large-complex-surface defect detection than the traditional methods of gradient threshold segmentation and template matching, respectively. The proposed image processing technique can be applied in product quality inspections.

[1]  Weisi Lin,et al.  Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum , 2014, IEEE Transactions on Industrial Informatics.

[2]  Baohua Zhang,et al.  Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review , 2014 .

[3]  João Manuel R S Tavares,et al.  Medical image registration: a review , 2014, Computer methods in biomechanics and biomedical engineering.

[4]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Zhongxiao Peng,et al.  Oxidation wear monitoring based on the color extraction of on-line wear debris , 2015 .

[6]  Ali Buldu,et al.  A thermal-based defect classification method in textile fabrics with K-nearest neighbor algorithm , 2016 .

[7]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[8]  Oscar Castillo,et al.  An improved sobel edge detection method based on generalized type-2 fuzzy logic , 2014, Soft Computing.

[9]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[10]  Q. Peng,et al.  An improved Otsu method using the weighted object variance for defect detection , 2015 .

[11]  Abdul Rahman Ramli,et al.  Vertical-Edge-Based Car-License-Plate Detection Method , 2013, IEEE Transactions on Vehicular Technology.

[12]  Yan Zhang,et al.  Defect detection for tire laser shearography image using curvelet transform based edge detector , 2013 .

[13]  Chern-Sheng Lin,et al.  Development of optical automatic positioning and wafer defect detection system , 2016 .

[15]  Tonghai Wu,et al.  Motion-Blurred Particle Image Restoration for On-Line Wear Monitoring , 2015, Sensors.

[16]  Z. Hocenski,et al.  Improved Canny Edge Detector in Ceramic Tiles Defect Detection , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[17]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[18]  Bernard C. Jiang,et al.  Machine Vision-Based Defect Detection in IC Images Using the Partial Information Correlation Coefficient , 2013, IEEE Transactions on Semiconductor Manufacturing.

[19]  Jian Gao,et al.  Automatic surface defect detection for mobile phone screen glass based on machine vision , 2017, Appl. Soft Comput..

[20]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[21]  Janice M. Dulieu-Barton,et al.  Identification of kissing defects in adhesive bonds using infrared thermography , 2016 .

[22]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[23]  Jinyoung Kim,et al.  Template-based defect detection of a brazed heat exchanger using an x-ray image , 2013 .

[24]  Neeraj Seth,et al.  X-ray imaging methods for internal quality evaluation of agricultural produce , 2011, Journal of Food Science and Technology.

[25]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[26]  Lan-Rong Dung,et al.  Implementation of RANSAC Algorithm for Feature-Based Image Registration , 2013 .

[27]  Kazim Yildiz,et al.  A novel thermal-based fabric defect detection technique , 2015 .

[28]  D. Tegolo,et al.  Improving Harris corner selection strategy , 2011 .

[29]  Davud Asemani,et al.  Surface defect detection in tiling Industries using digital image processing methods: analysis and evaluation. , 2014, ISA transactions.

[30]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[31]  Ying Tian,et al.  Steel Surface Defect Detection Using a New Haar–Weibull-Variance Model in Unsupervised Manner , 2017, IEEE Transactions on Instrumentation and Measurement.

[32]  Jiang Honghai,et al.  Detection of surface crack defects on ferrite magnetic tile , 2014 .

[33]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[34]  Savvas A. Chatzichristofis,et al.  Image moment invariants as local features for content based image retrieval using the Bag-of-Visual-Words model , 2015, Pattern Recognit. Lett..

[35]  Liang Gong,et al.  Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier , 2015 .