Real-Time Detection of Railway Track Component via One-Stage Deep Learning Networks

Railway inspection has always been a critical task to guarantee the safety of the railway transportation. The development of deep learning technologies brings new breakthroughs in the accuracy and speed of image-based railway inspection application. In this work, a series of one-stage deep learning approaches, which are fast and accurate at the same time, are proposed to inspect the key components of railway track including rail, bolt, and clip. The inspection results show that the enhanced model, the second version of you only look once (YOLOv2), presents the best component detection performance with 93% mean average precision (mAP) at 35 image per second (IPS), whereas the feature pyramid network (FPN) based model provides a smaller mAP and much longer inference time. Besides, the detection performances of more deep learning approaches are evaluated under varying input sizes, where larger input size usually improves the detection accuracy but results in a longer inference time. Overall, the YOLO series models could achieve faster speed under the same detection accuracy.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Rubel Biswas,et al.  Automatic detection of defective rail anchors , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[7]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Nicola Ancona,et al.  Filter-based feature selection for rail defect detection , 2004, Machine Vision and Applications.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Shubin Li,et al.  Detection of rail surface defects based on CNN image recognition and classification , 2018, 2018 20th International Conference on Advanced Communication Technology (ICACT).

[12]  Jun-Wei Hsieh,et al.  Enriching Variety of Layer-Wise Learning Information by Gradient Combination , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[13]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Qingyong Li,et al.  A Real-Time Visual Inspection System for Discrete Surface Defects of Rail Heads , 2012, IEEE Transactions on Instrumentation and Measurement.

[15]  Rama Chellappa,et al.  Robust Fastener Detection for Autonomous Visual Railway Track Inspection , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[16]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[18]  Juan Li,et al.  Automatic Railway Traffic Object Detection System Using Feature Fusion Refine Neural Network under Shunting Mode , 2018, Sensors.

[19]  Zhengqiang Jiang,et al.  Multiple Pedestrian Tracking From Monocular Videos in an Interacting Multiple Model Framework , 2018, IEEE Transactions on Image Processing.

[20]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ying Li,et al.  Rail Component Detection, Optimization, and Assessment for Automatic Rail Track Inspection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[22]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  S. Arivazhagan,et al.  RAILWAY TRACK DERAILMENT INSPECTION SYSTEM USING SEGMENTATION BASED FRACTAL TEXTURE ANALYSIS , 2015 .

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[28]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Zhiguo Jiang,et al.  Broken Railway Fastener Detection Based on Adaboost Algorithm , 2010, 2010 International Conference on Optoelectronics and Image Processing.

[30]  Liu Li,et al.  Rail Surface Defect Detection Method Based on YOLOv3 Deep Learning Networks , 2018, 2018 Chinese Automation Congress (CAC).

[31]  Fuqiang Zhou,et al.  Vision-based fault inspection of small mechanical components for train safety , 2016 .

[32]  Ilkay Ulusoy,et al.  Railway Fastener Inspection by Real-Time Machine Vision , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.