High-speed railway catenary components detection using the cascaded convolutional neural networks

With the massive construction of the China high-speed railway, it is of a great significance to propose an automatic approach to inspect the defects of the catenary support devices. Based on the obtained high resolution images, the detection and extraction of the components on the catenary support devices are the vital steps prior to their defect report. Inspired by the existing object detection Faster R-CNN framework, a cascaded convolutional neural network (CNN) architecture is built to successively detect the various components and the tiny fasteners in the complex catenary support device structures. Meanwhile, some missing states of the fasteners on the cantilever joints are directly reported via our proposed architecture. Experiments on the Wuhan-Guangzhou high-speed railway dataset demonstrate a practical performance of the component detection with good adaptation and robustness in complex environments, feasible to accurately inspect the extremely tiny defects on the various catenary components.

[1]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[5]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[8]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[12]  Rama Chellappa,et al.  Deep Multitask Learning for Railway Track Inspection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[13]  Long Chen,et al.  Automatic Fastener Classification and Defect Detection in Vision-Based Railway Inspection Systems , 2014, IEEE Transactions on Instrumentation and Measurement.

[14]  Charles V. Stewart,et al.  Detecting plains and Grevy's Zebras in the realworld , 2016, 2016 IEEE Winter Applications of Computer Vision Workshops (WACVW).

[15]  Bart De Schutter,et al.  Deep convolutional neural networks for detection of rail surface defects , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[16]  Rama Chellappa,et al.  Material classification and semantic segmentation of railway track images with deep convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[17]  Mehmet Karaköse,et al.  A New Experimental Approach Using Image Processing-Based Tracking for an Efficient Fault Diagnosis in Pantograph–Catenary Systems , 2017, IEEE Transactions on Industrial Informatics.

[18]  Dah-Jye Lee,et al.  High-speed railway rod-insulator detection using segment clustering and deformable part models , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[19]  Jian Sun,et al.  Joint Cascade Face Detection and Alignment , 2014, ECCV.

[20]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Bing Li,et al.  Bootstrapping deep feature hierarchy for pornographic image recognition , 2016, 2016 IEEE International Conference on Image Processing (ICIP).