High-speed Railway Fastener Detection and Localization Method based on convolutional neural network

Railway transportation is the artery of China's national economy and plays an important role in the development of today's society. Due to the late start of China's railway security inspection technology, the current railway security inspection tasks mainly rely on manual inspection, but the manual inspection efficiency is low, and a lot of manpower and material resources are needed. In this paper, we establish a steel rail fastener detection image dataset, which contains 4,000 rail fastener pictures about 4 types. We use the regional suggestion network to generate the region of interest, extracts the features using the convolutional neural network, and fuses the classifier into the detection network. With online hard sample mining to improve the accuracy of the model, we optimize the Faster RCNN detection framework by reducing the number of regions of interest. Finally, the model accuracy reaches 99% and the speed reaches 35FPS in the deployment environment of TITAN X GPU.

[1]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[2]  Song Han,et al.  Deep compression and EIE: Efficient inference engine on compressed deep neural network , 2016, 2016 IEEE Hot Chips 28 Symposium (HCS).

[3]  Lin Lei,et al.  Vehicle Detection in Aerial Images Based on Region Convolutional Neural Networks and Hard Negative Example Mining , 2017, Sensors.

[4]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Richard M Myers,et al.  Genomic patterns of homozygosity in worldwide human populations. , 2012, American journal of human genetics.

[6]  Andrew W. Fitzgibbon,et al.  Efficient Object Category Recognition Using Classemes , 2010, ECCV.

[7]  Zhiguo Jiang,et al.  Broken Railway Fastener Detection Based on Adaboost Algorithm , 2010, 2010 International Conference on Optoelectronics and Image Processing.

[8]  Long Chen,et al.  Automatic Fastener Classification and Defect Detection in Vision-Based Railway Inspection Systems , 2014, IEEE Transactions on Instrumentation and Measurement.

[9]  M. Singh,et al.  Autonomous Rail Track Inspection using Vision Based System , 2006, 2006 IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety.

[10]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[11]  Ettore Stella,et al.  A GPU-based vision system for real time detection of fastening elements in railway inspection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[12]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Li Li,et al.  Integrating the Symmetry Image and Improved Sparse Representation for Railway Fastener Classification and Defect Recognition , 2015 .

[14]  Jun Chu,et al.  Object Detection Based on Multi-Layer Convolution Feature Fusion and Online Hard Example Mining , 2018, IEEE Access.

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Abhinav Gupta,et al.  Training Region-Based Object Detectors with Online Hard Example Mining , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  A. Distante,et al.  Visual recognition of missing fastening elements for railroad maintenance , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[18]  Abdenour Hadid,et al.  Efficient Detection of Occlusion prior to Robust Face Recognition , 2014, TheScientificWorldJournal.

[19]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[20]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Suman Saha,et al.  Online Real-Time Multiple Spatiotemporal Action Localisation and Prediction , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Ying Li,et al.  Component-based track inspection using machine-vision technology , 2011, ICMR '11.

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Hui Zhao,et al.  An Efficient Direction Field-Based Method for the Detection of Fasteners on High-Speed Railways , 2011, Sensors.

[26]  Hiroshi Mamitsuka,et al.  Boosted Network Classifiers for Local Feature Selection , 2012, IEEE Transactions on Neural Networks and Learning Systems.