An adaptive fault diagnosis approach using pipeline implementation for railway inspection

Railway tracks must be periodically inspected. This study proposes a new approach for eliminating two major disadvantages experienced during rail inspection applications performed via computer vision. The first is the blurring effect on images, resulting from physical vibration during movement on the rail lines. This effect significantly reduces the high accuracy rate expected from anomaly inspection algorithms. The second disadvantage is the need to operate in real time. This study presents a new three-stage computer vision method approach that eliminates both disadvantages. First, a three-stage pipeline architecture is implemented and IMU-assisted blur detection is performed on images taken from the left and right rail lines. Next, a convolutional neural network is used for learning. In the third test stage, anomaly detection and classification training are conducted. By performing the implementation with parallel programming on graphic processing units, a highly accurate, cost-effective computer vision rail inspection, based on image processing and capable of operating in real time, is successfully carried out.

[1]  Siwei Luo,et al.  Deblurring Gaussian-blur images: A preprocessing for rail head surface defect detection , 2011, Proceedings of 2011 IEEE International Conference on Service Operations, Logistics and Informatics.

[2]  Martin Lauer,et al.  Track detection in 3D laser scanning data of railway infrastructure , 2015, 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[3]  Zhangdui Zhong,et al.  Rail Inspection Meets Big Data: Methods and Trends , 2015, 2015 18th International Conference on Network-Based Information Systems.

[4]  Ilkay Ulusoy,et al.  Railway Fastener Inspection by Real-Time Machine Vision , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Bernd Scholz-Reiter,et al.  Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection , 2016 .

[6]  Qingyong Li,et al.  A Real-Time Visual Inspection System for Discrete Surface Defects of Rail Heads , 2012, IEEE Transactions on Instrumentation and Measurement.

[7]  Mehmet Karakose,et al.  Learning Based Experimental Approach For Condition Monitoring Using Laser Cameras In Railway Tracks , 2016 .

[8]  Sebastian O. H. Madgwick,et al.  An efficient orientation filter for inertial and inertial / magnetic sensor arrays , 2010 .

[9]  Aswin C. Sankaranarayanan,et al.  BlurBurst : Removing Blur Due to Camera Shake using Multiple Images , 2013 .

[10]  Bart De Schutter,et al.  Deep convolutional neural networks for detection of rail surface defects , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[11]  Reinhold Huber-Mörk,et al.  Statistical Rail Surface Classification Based on 2D and 21/2D Image Analysis , 2010, ACIVS.

[12]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[13]  Guangjun Zhang,et al.  Simple and fast rail wear measurement method based on structured light , 2011 .

[14]  Jan Flusser,et al.  Projection Operators and Moment Invariants to Image Blurring , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[16]  Rama Chellappa,et al.  Deep Multitask Learning for Railway Track Inspection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[17]  M Karakose,et al.  The intelligent fault diagnosis frameworks based on fuzzy integral , 2010, SPEEDAM 2010.

[18]  Ming J. Zuo,et al.  Fault detection method for railway wheel flat using an adaptive multiscale morphological filter , 2017 .

[19]  Mehmet Karaköse,et al.  IMU based adaptive blur removal approach using image processing for railway inspection , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).