A Unified Framework for Fault Detection of Freight Train Images Under Complex Environment

This paper proposes a novel unified framework for fault detection of the freight train images based on convolutional neural network (CNN) under complex environment. Firstly, the multi region proposal networks (MRPN) with a set of prior bounding boxes are introduced to achieve high quality fault proposal generation. And then, we apply a linear non-maximum suppression method to retain the most suitable anchor while removing redundant boxes. Finally, a powerful multi-level region-of-interest (ROI) pooling is proposed for proposal classification and accurate detection. The experimental results indicate that the proposed method can achieve high performance on four typical fault benchmarks, substantially outperforming the state-of-the-art methods.

[1]  Jinyang Li,et al.  Real-time monitoring of brake shoe keys in freight cars , 2015, Frontiers of Information Technology & Electronic Engineering.

[2]  Lianwen Jin,et al.  DeepText: A new approach for text proposal generation and text detection in natural images , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[4]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Liu Liu,et al.  Automated Visual Inspection System for Bogie Block Key Under Complex Freight Train Environment , 2016, IEEE Transactions on Instrumentation and Measurement.

[8]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Baochang Zhang,et al.  Weighted Margin Sparse Embedded classifier for brake cylinder detection , 2013, Neurocomputing.

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Rong Zou,et al.  Automated visual inspection of angle cocks during train operation , 2014 .

[12]  He Gao,et al.  Dust collector localization in trouble of moving freight car detection system , 2013, Journal of Zhejiang University SCIENCE C.

[13]  Fuchun Sun,et al.  HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Junhua Sun,et al.  Automatic multi-fault recognition in TFDS based on convolutional neural network , 2017, Neurocomputing.

[17]  Whoi-Yul Kim,et al.  Automated Inspection System for Rolling Stock Brake Shoes , 2011, IEEE Transactions on Instrumentation and Measurement.

[18]  Fuqiang Zhou,et al.  Automated status inspection of fastening bolts on freight trains using a machine vision approach , 2016 .

[19]  Guo Nan,et al.  A real-time visual inspection method of fastening bolts in freight car operation , 2015, Applied Optics and Photonics China.

[20]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[22]  Chuan Wang,et al.  Video Object Co-Segmentation via Subspace Clustering and Quadratic Pseudo-Boolean Optimization in an MRF Framework , 2014, IEEE Transactions on Multimedia.

[23]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[24]  Zhenzhong Wei,et al.  Automatic online vision-based inspection system of coupler yoke for freight trains , 2016, J. Electronic Imaging.

[25]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[26]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[27]  Meng Wang,et al.  Object Detection and Tracking Under Occlusion for Object-Level RGB-D Video Segmentation , 2018, IEEE Transactions on Multimedia.