An Industrial Micro-Defect Diagnosis System via Intelligent Segmentation Region

In the field of machine vision defect detection for a micro workpiece, it is very important to make the neural network realize the integrity of the mask in analyte segmentation regions. In the process of the recognition of small workpieces, fatal defects are always contained in borderline areas that are difficult to demarcate. The non-maximum suppression (NMS) of intersection over union (IOU) will lose crucial texture information especially in the clutter and occlusion detection areas. In this paper, simple linear iterative clustering (SLIC) is used to augment the mask as well as calibrate the score of the mask. We propose an SLIC head of object instance segmentation in proposal regions (Mask R-CNN) containing a network block to learn the quality of the predict masks. It is found that parallel K-means in the limited region mechanism in the SLIC head improved the confidence of the mask score, in the context of our workpiece. A continuous fine-tune mechanism was utilized to continuously improve the model robustness in a large-scale production line. We established a detection system, which included an optical fiber locator, telecentric lens system, matrix stereoscopic light, a rotating platform, and a neural network with an SLIC head. The accuracy of defect detection is effectively improved for micro workpieces with clutter and borderline areas.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[3]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  De Xu,et al.  Measurement and Defect Detection of the Weld Bead Based on Online Vision Inspection , 2010, IEEE Transactions on Instrumentation and Measurement.

[5]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Shuxiao Li,et al.  Bearing defect inspection based on machine vision , 2012 .

[7]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse Model , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  B D Satoto,et al.  Integration K-Means Clustering Method and Elbow Method For Identification of The Best Customer Profile Cluster , 2018, IOP Conference Series: Materials Science and Engineering.

[10]  Nicola Ivan Giannoccaro,et al.  An Outdoor Navigation System for Blind Pedestrians Using GPS and Tactile-Foot Feedback , 2018 .

[11]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[12]  Allison M. Okamura,et al.  Three-Dimensional Skin Deformation as Force Substitution: Wearable Device Design and Performance During Haptic Exploration of Virtual Environments , 2017, IEEE Transactions on Haptics.

[13]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[15]  Yilmaz Kaya,et al.  Application of artificial neural network for automatic detection of butterfly species using color and texture features , 2013, The Visual Computer.

[16]  Li Yang,et al.  A parallel k‐means clustering algorithm based on redundance elimination and extreme points optimization employing MapReduce , 2017, Concurr. Comput. Pract. Exp..

[17]  Allison M. Okamura,et al.  Facilitating Human-Mobile Robot Communication via Haptic Feedback and Gesture Teleoperation , 2018, ACM Transactions on Human-Robot Interaction.

[18]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[19]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[21]  Anuar Ahmad,et al.  A new approach for surface water change detection: Integration of pixel level image fusion and image classification techniques , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[22]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Kiyoshi Tomimatsu,et al.  A Heuristic Model of Vibrotactile Haptic Feedbacks Elicitation Based on Empirical Review , 2014, HCI.

[25]  I. Bloch,et al.  Automatic knee meniscus tear detection and orientation classification with Mask-RCNN. , 2019, Diagnostic and interventional imaging.

[26]  Tseng-Lung Huang,et al.  A model of acceptance of augmented-reality interactive technology: the moderating role of cognitive innovativeness , 2014, Electronic Commerce Research.

[27]  Xinying Xu,et al.  High precision image segmentation algorithm using SLIC and neighborhood rough set , 2018, Multimedia Tools and Applications.

[28]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jeong-Mook Lim,et al.  An audio-haptic feedbacks for enhancing user experience in mobile devices , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[30]  Fan Wu,et al.  Defect detection method for complex surface based on human visual characteristics and feature extracting , 2019, International Symposium on Precision Engineering Measurement and Instrumentation.

[31]  Lei Zhang,et al.  Fine-Tuning Convolutional Neural Networks for Biomedical Image Analysis: Actively and Incrementally , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Vipin Tyagi,et al.  A Review of ROI Image Retrieval Techniques , 2014, FICTA.

[34]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[35]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Yu-Wing Tai,et al.  Salient Region Detection via High-Dimensional Color Transform and Local Spatial Support , 2014, IEEE Transactions on Image Processing.

[37]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Yongchao Gong,et al.  Mask Scoring R-CNN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Adam Glowacz,et al.  Recognition of aRmatuRe cuRRent of Dc geneRatoR DepenDing on RotoR speeD using fft, msaf-1 anD LDa Rozpoznawanie sygnałów pR ąDu twoRnika geneR atoRa pRąDu stałego w zaLeżności oD pRęDkości obR otowej wiRnika z zastosowaniem fft, msaf-1 i LDa* , 2015 .

[40]  Lai-Man Po,et al.  Dynamic ROI based on K-means for remote photoplethysmography , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Yan Liu,et al.  The Research on VR-Based of Technology Generating Equipment and Interaction Equipment , 2017 .

[42]  Chun-Yan Han,et al.  Improved SLIC imagine segmentation algorithm based on K-means , 2017, Cluster Computing.

[43]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Yves Vanlandewijck,et al.  Cluster analysis of novel isometric strength measures produces a valid and evidence-based classification structure for wheelchair track racing , 2017, British Journal of Sports Medicine.