A Multilevel Feature and Structure Prior Information-Based Positioning Approach for Catenary Support Components

The work state of catenary support components (CSCs) is essential for trains’ powering safety under high-speed operation. However, because of the difficulty of positioning the CSCs whose sizes are much different, some detection methods based on classical deep learning technologies only position one specific component, and the others that can position all categories CSCs have poor performance. A new position method for 12 categories of CSCs called CSC structure inference net (CSCSIN) is proposed in this article. This method is composed of three sections, including the feature extraction with a multilevel feature, feature inference with structure prior information, regression, and classification. In the feature extraction section, to extract small-scale CSCs’ features, a modified VGG16, which is used to generate a legible feature map based on the fusion of low and high layers’ features, is proposed, and multiscales anchors for RoIs prediction are applied to suit multiscale CSCs. In the feature inference section, considering application scenarios and fixed position relationship between CSCs, the scene visual feature and position information between targets are used to iteratively update each target state in structure inference net, and the final state of each target is used for its classification in regression and classification section. Based on the modification in the feature extraction section and the combination of relevant information of CSCs, CSCSIN is efficient and sensitive to all 12 CSCs whose scales are much different. The experimental results demonstrate that the position precision of CSCSIN is superior to other classical models and relevant methods.

[1]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[2]  Ye Han,et al.  A CNN-Based Defect Inspection Method for Catenary Split Pins in High-Speed Railway , 2019, IEEE Transactions on Instrumentation and Measurement.

[3]  Zhang Jian,et al.  Study on influence of contact wire design parameters on contact characteristics of Pantograph-Catenary , 2013, 2013 IEEE International Conference on Intelligent Rail Transportation Proceedings.

[4]  Yang Hong-mei,et al.  Overview of Non-contact Image Detection Technology for Pantograph-catenary Monitoring , 2013 .

[5]  Kai Liu,et al.  Deep learning-based visual ensemble method for high-speed railway catenary clevis fracture detection , 2020, Neurocomputing.

[6]  Zhigang Liu,et al.  A High-Precision Loose Strands Diagnosis Approach for Isoelectric Line in High-Speed Railway , 2018, IEEE Transactions on Industrial Informatics.

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Kai Liu,et al.  Location and fault detection of catenary support components based on deep learning , 2018, 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[9]  Shibin Gao,et al.  Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning , 2019, IEEE Transactions on Instrumentation and Measurement.

[10]  Erbo Shang,et al.  A Multi-feature Fusion-based Deep Learning for Insulator Image Identification and Fault Detection , 2020, 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC).

[11]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[12]  Rama Chellappa,et al.  Robust Fastener Detection for Autonomous Visual Railway Track Inspection , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[13]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Kai Liu,et al.  A High-Precision Positioning Approach for Catenary Support Components With Multiscale Difference , 2020, IEEE Transactions on Instrumentation and Measurement.

[15]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[16]  Dah-Jye Lee,et al.  High-speed railway rod-insulator detection using segment clustering and deformable part models , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[17]  Zhigang Liu,et al.  Unified Deep Learning Architecture for the Detection of All Catenary Support Components , 2020, IEEE Access.

[18]  Zhigang Liu,et al.  Automatic recognition for catenary insulators of high-speed railway based on contourlet transform and Chan–Vese model , 2016 .

[19]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[20]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[21]  Liu Liu,et al.  Automated Visual Inspection System for Bogie Block Key Under Complex Freight Train Environment , 2016, IEEE Transactions on Instrumentation and Measurement.

[22]  Yang Lyu,et al.  A Generic Anomaly Detection of Catenary Support Components Based on Generative Adversarial Networks , 2020, IEEE Transactions on Instrumentation and Measurement.

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.