FaultNet: Faulty Rail-Valves Detection using Deep Learning and Computer Vision

Regular inspection of rail valves and engines is an important task to ensure safety and efficiency of railway networks around the globe. Over the past decade, computer vision and pattern recognition based techniques have gained traction for such inspection and defect detection tasks. An automated end-to-end trained system can potentially provide a low-cost, high throughput, and cheap alternative to manual visual inspection of these components. However, such systems require huge amount of defective images for networks to understand complex defects. In this paper, a multi-phase deep learning based technique is proposed to perform accurate fault detection of rail-valves. Our approach uses a two-step method to perform high precision image segmentation of rail-valves resulting in pixel-wise accurate segmentation. Thereafter, a computer vision technique is used to identify faulty valves. We demonstrate that the proposed approach results in improved detection performance when compared to current state-of-the-art techniques used in fault detection.

[1]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Bernd Scholz-Reiter,et al.  Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection , 2016 .

[4]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  M Ph Papaelias,et al.  A review on non-destructive evaluation of rails: State-of-the-art and future development , 2008 .

[6]  Nicola Ancona,et al.  Filter-based feature selection for rail defect detection , 2004 .

[7]  Ali Tajaddini,et al.  A Machine Vision System for Automated Joint Bar Inspection From a Moving Rail Vehicle , 2007 .

[8]  Patrice Aknin,et al.  On-line rail defect diagnosis with differential eddy current probes and specific detection processing , 2003 .

[9]  Luo Siwei,et al.  Real-time rail head surface defect detection: A geometrical approach , 2009, 2009 IEEE International Symposium on Industrial Electronics.

[10]  Wang Jie,et al.  TrackNet - A Deep Learning Based Fault Detection for Railway Track Inspection , 2018, 2018 International Conference on Intelligent Rail Transportation (ICIRT).

[11]  Duc Thanh Nguyen,et al.  JSIS3D: Joint Semantic-Instance Segmentation of 3D Point Clouds With Multi-Task Pointwise Networks and Multi-Value Conditional Random Fields , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Minh N. Do,et al.  Locating 3D Object Proposals: A Depth-Based Online Approach , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[14]  Robin Clark,et al.  Rail flaw detection: overview and needs for future developments , 2004 .

[15]  Minh N. Do,et al.  Tracking objects using 3D object proposals , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[16]  Bart De Schutter,et al.  Deep convolutional neural networks for detection of rail surface defects , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[17]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[19]  Rama Chellappa,et al.  Material classification and semantic segmentation of railway track images with deep convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[20]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[21]  R. Clark,et al.  Ultrasonic characterisation of defects in rails , 2002 .

[22]  Rachel S. Edwards,et al.  Characterisation of defects in the railhead using ultrasonic surface waves , 2006 .

[23]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Ying Li,et al.  Rail Component Detection, Optimization, and Assessment for Automatic Rail Track Inspection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[25]  Minh N. Do,et al.  Dense 3D Reconstruction for Visual Tunnel Inspection using Unmanned Aerial Vehicle , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[26]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[28]  Chuan Sheng Foo,et al.  Efficient GAN-Based Anomaly Detection , 2018, ArXiv.

[29]  Ettore Stella,et al.  A GPU-based vision system for real time detection of fastening elements in railway inspection , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Rama Chellappa,et al.  Deep Multitask Learning for Railway Track Inspection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[32]  T. Heckel,et al.  Advantage of a combined ultrasonic and eddy current examination for railway inspection trains , 2007 .

[33]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Minh N. Do,et al.  Feature-less Stitching of Cylindrical Tunnel , 2018, 2018 IEEE/ACIS 17th International Conference on Computer and Information Science (ICIS).

[35]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Yi Wang,et al.  Intelligent predictive maintenance for fault diagnosis and prognosis in machine centers: Industry 4.0 scenario , 2017 .