MYOLOv3-Tiny: A new convolutional neural network architecture for real-time detection of track fasteners

Abstract Real-time detection of fasteners is of great significance for improving the inspection efficiency of railway tracks. However, the task is also challenging due to the limited memory and processing capacity of the embedded maintenance systems. To address these challenges, in this paper, we propose a new detection network architecture called MYOLOv3-Tiny, in which the depthwise and pointwise convolution are used to reduce the computational complexity of the network, and the linear bottleneck structure with inverted residual is employed to design the backbone network for efficiently extracting the fasteners’ features. The MYOLOv3-Tiny is trained and tested on the high-resolution track fastener data collected from the Ring Test Field of National Railway Test Center of China. The extensive experiments show the proposed MYOLOv3-Tiny achieves higher detection precision, lower computational complexity and memory consumption, and faster detection speed compared to state-of-the-art methods. Specifically, its detection precision reaches 99.32% after introducing visually coherent image mixup enhancement technology, and the memory consumption is reduced by 43% compared to the YOLOv3-Tiny network with a high detection speed guarantee. Hence, the proposed MYOLOv3-Tiny has the potential to lay a foundation for the real-time detection of railway track fasteners and to be applied to large-scale fastener detection devices.

[1]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Rama Chellappa,et al.  Deep Multitask Learning for Railway Track Inspection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[3]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Long Chen,et al.  Automatic Fastener Classification and Defect Detection in Vision-Based Railway Inspection Systems , 2014, IEEE Transactions on Instrumentation and Measurement.

[5]  Ettore Stella,et al.  A FPGA-based architecture for automatic hexagonal bolts detection in railway maintenance , 2005, Seventh International Workshop on Computer Architecture for Machine Perception (CAMP'05).

[6]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[7]  Ba Tuan Le,et al.  A Target Detection Model Based on Improved Tiny-Yolov3 Under the Environment of Mining Truck , 2019, IEEE Access.

[8]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Liming Li,et al.  Railway track gauge inspection method based on computer vision , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[10]  M. Singh,et al.  Autonomous Rail Track Inspection using Vision Based System , 2006, 2006 IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety.

[11]  Jie Zhang,et al.  Online defect recognition of narrow overlap weld based on two-stage recognition model combining continuous wavelet transform and convolutional neural network , 2019, Comput. Ind..

[12]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[13]  Rama Chellappa,et al.  Material classification and semantic segmentation of railway track images with deep convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[14]  Zhi Zhang,et al.  Bag of Freebies for Training Object Detection Neural Networks , 2019, ArXiv.

[15]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[16]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[17]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[18]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[20]  Ying Li,et al.  Rail Component Detection, Optimization, and Assessment for Automatic Rail Track Inspection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[21]  Yujie Li,et al.  Railway track fastener defect detection based on image processing and deep learning techniques: A comparative study , 2019, Eng. Appl. Artif. Intell..

[22]  Mei Tian,et al.  Learning Visual Similarity for Inspecting Defective Railway Fasteners , 2019, IEEE Sensors Journal.

[23]  Keke Zhang,et al.  YOLOv3-Lite: A Lightweight Crack Detection Network for Aircraft Structure Based on Depthwise Separable Convolutions , 2019, Applied Sciences.

[24]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Ettore Stella,et al.  A GPU-based vision system for real time detection of fastening elements in railway inspection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[27]  Tao Tang,et al.  A Bayesian network model for prediction of weather-related failures in railway turnout systems , 2017, Expert Syst. Appl..

[28]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Guang Wang,et al.  Gap Measurement of Point Machine Using Adaptive Wavelet Threshold and Mathematical Morphology , 2016, Sensors.

[30]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[31]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[32]  Nicola Ancona,et al.  Visual recognition of hexagonal headed bolts by comparing ICA to wavelets , 2003, Proceedings of the 2003 IEEE International Symposium on Intelligent Control.