On-line Detection of Pantograph Offset Based on Deep Learning

A safe train operation relies on the well-contact of pantograph and the power grid above, therefore identifying the state of pantograph plays an vital role. Among all of the malfunctions, pantograph offset is a strong reflection of the state. We have proposed a new approach to reconstructing the three-dimensional (3D) information of the bow by substituting the offset with connection of left and right horns. To locate the region of pantograph horn, we refer to an efficient deep learning method, named Single Shot MultiBox Detector (SSD). In the located area, region growing or wiener filtering is applied to extract connected components and enhance the prospects. For processed images, grayscale morphological gradients is adopted to obtain image edges, on which Harris corner detection can provide dozens of potential corner-points. These points containing one correct horn point needs selection by assuming the lowest one is the best, only when the background noise is as low as possible. After attaining the two-dimensional (2D) image coordinates of the horns, binocular stereo vision method makes contribution to reconstructing 3D coordinates. Using the 3D coordinate line of the left and right horns to represent the pantograph offset can easily reflect the degree of deviation by comparing it with the initial location of pantograph. Our approach is of great significance to prevent malfunction, which are about to arise later, such as horn loss or deflection, spark of pantograph and catenary system contact-point. The detection of the pantograph offset provides a strong guarantee for maintaining railway traffic safety.

[1]  Yen Che Chang,et al.  Seeded Region Growing Based on Extension for Multispectral MR Images Classification , 2014 .

[2]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[3]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  Liu Liu,et al.  Automated Visual Inspection System for Bogie Block Key Under Complex Freight Train Environment , 2016, IEEE Transactions on Instrumentation and Measurement.

[6]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Whoi-Yul Kim,et al.  Automated Inspection System for Rolling Stock Brake Shoes , 2011, IEEE Transactions on Instrumentation and Measurement.

[9]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  P. M. Keen Monitoring overhead line equipment , 1998 .