Location and fault detection of catenary support components based on deep learning

Catenary support components (CSCs) are the most important devices that support the overhead line and messenger of catenary system in electric railway. The faults of CSCs can result in the poor state of catenary system, and directly influence the normal operation of trains. In order to efficiently locate and identify the faults of CSCs, the deep learning algorithms are tried to process the captured images of CSCs in this paper. First at all, a dataset of CSCs that contains 50k labeled instances with 12 categories is built. Second, some traditional location methods of CSCs are introduced, and four recent representative deep learning networks, namely Faster RCNN (VGG16 and ResNet101), YOLOv2 and SSD, are applied to locate 12 categories CSCs, simultaneously and separately. In order to find more suitable algorithms of deep learning, their location performances are compared and evaluated. For the location of single category of CSCs, these algorithms show good performance. However, the models that are adopted to simultaneously locate all categories have a poor location performance on small-scale components of CSCs. Third, aiming at the fault detection of CSCs, some common methods are presented and compared, and the deep learning algorithms are tried to detect the faults of CSCs. Finally, the issues of deep learning for location and fault detection of CSCs, especially for the simultaneous location of CSCs are proposed and discussed, and further prospects are given.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[3]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[5]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Yang Hong-mei A Fast Fuzzy Matching Method of Fault Detection for Rod Insulators of High-speed Railways , 2013 .

[8]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[9]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  Han Ye Insulator Fault Detection Based on Curvelet Coefficients Morphology and Zonal Energy Method , 2013 .

[16]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[18]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[19]  Zhigang Liu,et al.  A High-Precision Loose Strands Diagnosis Approach for Isoelectric Line in High-Speed Railway , 2018, IEEE Transactions on Industrial Informatics.

[20]  Y Han Fracture Detection of Ear Pieces of Catenary Support Devices of High-speed Railway Based on SIFT Feature Matching , 2014 .

[21]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[22]  Rama Chellappa,et al.  Deep Multitask Learning for Railway Track Inspection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[23]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.