Steel Wire Rope Surface Defect Detection Based on Segmentation Template and Spatiotemporal Gray Sample Set

Machine-vision-based defect detection, instead of manual visual inspection, is becoming increasingly popular. In practice, images of the upper surface of cableway load sealing steel wire ropes are seriously affected by complex environments, including factors such as lubricants, adhering dust, natural light, reflections from metal or oil stains, and lack of defect samples. This makes it difficult to directly use traditional threshold-segmentation-based or supervised machine-learning-based defect detection methods for wire rope strand segmentation and fracture defect detection. In this study, we proposed a segmentation-template-based rope strand segmentation method with high detection accuracy, insensitivity to light, and insensitivity to oil stain interference. The method used the structural characteristics of steel wire rope to create a steel wire rope segmentation template, the best coincidence position of the steel wire rope segmentation template on the real-time edge image was obtained through multiple translations, and the steel wire rope strands were segmented. Aiming at the problem of steel wire rope fracture defect detection, inspired by the idea of dynamic background modeling, a steel wire rope surface defect detection method based on a steel wire rope segmentation template and a timely spatial gray sample set was proposed. The spatiotemporal gray sample set of each pixel in the image was designed by using the gray similarity of the same position in the time domain and the gray similarity of pixel neighborhood in the space domain, the dynamic gray background of wire rope surface image was constructed to realize the detection of wire rope surface defects. The method proposed in this paper was tested on the image set of Z-type double-layer load sealing steel wire rope of mine ropeway, and compared with the classic dynamic background modeling methods such as VIBE, KNN, and MOG2. The results show that the purposed method is more accurate, more effective, and has strong adaptability to complex environments.

[1]  Filippo Molinari,et al.  A Vision-Based Technique for Lay Length Measurement of Metallic Wire Ropes , 2009, IEEE Transactions on Instrumentation and Measurement.

[2]  Ping Zhou,et al.  Automatic Detection of Industrial Wire Rope Surface Damage Using Deep Learning-Based Visual Perception Technology , 2021, IEEE Transactions on Instrumentation and Measurement.

[3]  Weihua Gui,et al.  Siamese Time Series and Difference Networks for Performance Monitoring in the Froth Flotation Process , 2021, IEEE Transactions on Industrial Informatics.

[4]  Young-Soo Park,et al.  An efficient image-based damage detection for cable surface in cable-stayed bridges , 2013 .

[5]  Joachim Denzler,et al.  Enhanced anomaly detection in wire ropes by combining structure and appearance , 2013, Pattern Recognit. Lett..

[6]  Jinping Liu,et al.  Illumination-Invariant Flotation Froth Color Measuring via Wasserstein Distance-Based CycleGAN With Structure-Preserving Constraint , 2020, IEEE Transactions on Cybernetics.

[7]  Zhenzhi He,et al.  A Hybrid Data-Driven Method for Wire Rope Surface Defect Detection , 2020, IEEE Sensors Journal.

[8]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[9]  Hu Zhang,et al.  A Similarity-Based Burst Bubble Recognition Using Weighted Normalized Cross Correlation and Chamfer Distance , 2020, IEEE Transactions on Industrial Informatics.

[10]  Joachim Denzler,et al.  HMM-Based Defect Localization in Wire Ropes - A New Approach to Unusual Subsequence Recognition , 2009, DAGM-Symposium.

[11]  Ferdinand van der Heijden,et al.  Recursive unsupervised learning of finite mixture models , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Wei Li,et al.  A novel texture-based damage detection method for wire ropes , 2019 .

[13]  Thierry Bouwmans,et al.  Background Modeling and Foreground Detection for Video Surveillance , 2014 .

[14]  Zhaohui Tang,et al.  Feature Reconstruction-Regression Network: A Light-Weight Deep Neural Network for Performance Monitoring in the Froth Flotation , 2020, IEEE Transactions on Industrial Informatics.

[15]  Jinping Liu,et al.  Learning Local Gabor Pattern-Based Discriminative Dictionary of Froth Images for Flotation Process Working Condition Monitoring , 2021, IEEE Transactions on Industrial Informatics.

[16]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[17]  Marc Van Droogenbroeck,et al.  ViBe: A Disruptive Method for Background Subtraction , 2014 .

[18]  Jin Zhang,et al.  Convolutional Autoencoder-Based Flaw Detection for Steel Wire Ropes , 2020, Sensors.

[19]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[20]  Mao Le Detection of external defects in steel wire rope based on image processing technology , 2007 .

[21]  He Zhenzhi,et al.  Surface defect detection for wire ropes based on deep convolutional neural network , 2019, 2019 14th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[22]  Jinping Liu,et al.  FoGDbED: Fractional-order Gaussian derivatives-based edge-relevant structure detection using Caputo-Fabrizio definition , 2020, Digit. Signal Process..

[23]  Lintao Zheng,et al.  Research on wire rope wear detection based on computer vision , 2020 .

[24]  Hu Zhang,et al.  Long short-term memory-based grade monitoring in froth flotation using a froth video sequence , 2021 .

[25]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Yongliang Guo,et al.  Surface damage detection for steel wire ropes using deep learning and computer vision techniques , 2020 .

[27]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[28]  Kai Kang,et al.  Detection of External Defects in Steel Wire Rope Based on Image Processing , 2013 .