DefGAN: Defect Detection GANs With Latent Space Pitting for High-Speed Railway Insulator

As a key component of the high-speed railway catenary, the insulator plays an important role in supporting the catenary and maintaining the insulation between the catenary and earth. Regular inspection using computer vision technology is an effective way to detect insulator defects and improve the catenary operation safety. However, achieving full automation of insulator defects detection is still a difficult task due to the defective sample scarcity and subtle defect features. To overcome the problem, this article proposes defect detection GANs (DefGANs) that consist of a denoising autoencoder, a discriminator, and a classifier to detect defects, which can generate defective samples from pitted latent representations, thereby improving the reliability of defect detection classifier. The proposed DefGAN can pit the latent representations of normal samples to generate defective samples. Our proposal mainly consists of two stages. In the first stage, we use cascaded deep segmentation networks (CDSNets) to extract the insulator from the catenary images. Then, the insulator area is sampled into small patches. In the second stage, the patches are fed into the proposed DefGAN to detect defects. Moreover, the defect score is determined by the anomaly probability of the classifier and reconstruction error of the denoising autoencoder. The effectiveness of our work is measured across the catenary data sets.

[1]  Georg Langs,et al.  Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery , 2017, IPMI.

[2]  Muhammad Abdul Haseeb,et al.  DisNet: A novel method for distance estimation from monocular camera , 2018 .

[3]  Georg Langs,et al.  f‐AnoGAN: Fast unsupervised anomaly detection with generative adversarial networks , 2019, Medical Image Anal..

[4]  Muhammad Abdul Haseeb,et al.  Multi-DisNet: Machine Learning-Based Object Distance Estimation from Multiple Cameras , 2019, ICVS.

[5]  Hao Jiang,et al.  Insulator Detection in Aerial Images for Transmission Line Inspection Using Single Shot Multibox Detector , 2019, IEEE Access.

[6]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[7]  Shibin Gao,et al.  Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning , 2019, IEEE Transactions on Instrumentation and Measurement.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Hwee Kuan Lee,et al.  Fence GAN: Towards Better Anomaly Detection , 2019, 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI).

[10]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[11]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[12]  Ramesh Nallapati,et al.  OCGAN: One-Class Novelty Detection Using GANs With Constrained Latent Representations , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Carsten Steger,et al.  Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders , 2018, VISIGRAPP.

[14]  Mehmet Karaköse,et al.  A New Experimental Approach Using Image Processing-Based Tracking for an Efficient Fault Diagnosis in Pantograph–Catenary Systems , 2017, IEEE Transactions on Industrial Informatics.

[15]  Long Chen,et al.  Automatic Fastener Classification and Defect Detection in Vision-Based Railway Inspection Systems , 2014, IEEE Transactions on Instrumentation and Measurement.

[16]  Svetha Venkatesh,et al.  Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[17]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[18]  Hao Yuan,et al.  A Deep Convolutional Neural Network for Detection of Rail Surface Defect , 2019, 2019 IEEE Vehicle Power and Propulsion Conference (VPPC).

[19]  Zhigang Liu,et al.  An Automated Defect Detection Approach for Catenary Rod-Insulator Textured Surfaces Using Unsupervised Learning , 2020, IEEE Transactions on Instrumentation and Measurement.

[20]  Chuan Sheng Foo,et al.  Efficient GAN-Based Anomaly Detection , 2018, ArXiv.

[21]  Yang Lyu,et al.  A Generic Anomaly Detection of Catenary Support Components Based on Generative Adversarial Networks , 2020, IEEE Transactions on Instrumentation and Measurement.

[22]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Raghavendra Chalapathy University of Sydney,et al.  Deep Learning for Anomaly Detection: A Survey , 2019, ArXiv.

[25]  Muhammad Abdul Haseeb,et al.  Long-range obstacle detection from a monocular camera , 2018 .

[26]  Shibin Gao,et al.  A Robust Pantograph–Catenary Interaction Condition Monitoring Method Based on Deep Convolutional Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[27]  Sreeram Kannan,et al.  ClusterGAN : Latent Space Clustering in Generative Adversarial Networks , 2018, AAAI.

[28]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Kai Liu,et al.  Location and fault detection of catenary support components based on deep learning , 2018, 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[30]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.