Automatic Fault Detection of Multiple Targets in Railway Maintenance Based on Time-Scale Normalization

Automatic fault inspection, aiming at either a single target or an object of a position predictive in the image, is a common paradigm in railway maintenance. However, the fault detection of multiple targets with unknown initial locations is rarely conducted. In this paper, an automatic fault detection system for multiple targets based on time-scale normalization is proposed with the use of high-quality linear camera. For location of the multiple targets in the image sequences, it is important to make sure that the target and standard images are exactly aligned. To deal with this problem, the image distortion, caused by the velocity fluctuation of the moving train or the discordant movement between the linear scan camera and the train, must be corrected according to the size of the standard image. The scale-invariant feature transformation points based on Sobel gradient are first extracted and matched accurately with the geometric constraint. Then, the matched images are divided into subblocks in horizontal direction. The feature points in each subblock are quantized to a typical feature point. Finally, the time-scale normalization is used to achieve the accurate alignment for the target images. In the procedure of fault inspection, an image subtraction approach is presented for locating the positions of the potential fault regions. According to the priori knowledge, the type of the possible fault regions can be finally confirmed, and the customized high-level image understanding knowledge is used to identify the status of multiple targets. The practical application in detecting the abnormalities of China Railway High-Speed parts demonstrates that the proposed method exhibits an excellent performance in monitoring multiple targets with unknown positions in the high-speed railway.

[1]  Narendra Ahuja,et al.  Automated Visual Inspection of Railroad Tracks , 2013, IEEE Transactions on Intelligent Transportation Systems.

[2]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[3]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[4]  C.-C. Huang,et al.  Noncontact measurement using line-scan cameras: Analysis of positioning error , 1989 .

[5]  Werner von Seelen,et al.  Image processing and behavior planning for intelligent vehicles , 2003, IEEE Trans. Ind. Electron..

[6]  Robert G. Abbott,et al.  Multiple target tracking with lazy background subtraction and connected components analysis , 2009, Machine Vision and Applications.

[7]  Nadia Baaziz,et al.  Automatic Fabric Defect Detection Using Learning-Based Local Textural Distributions in the Contourlet Domain , 2018, IEEE Transactions on Automation Science and Engineering.

[8]  Han-Shue Tan,et al.  Development and validation of an automated steering control system for bus revenue service , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[9]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Amandeep Kaur,et al.  Detection and classification of Printed circuit board defects using image subtraction method , 2014, 2014 Recent Advances in Engineering and Computational Sciences (RAECS).

[11]  E. Stella,et al.  Visual recognition of fastening bolts for railroad maintenance , 2004, Pattern Recognit. Lett..

[12]  Irwin Edward Sobel,et al.  Camera Models and Machine Perception , 1970 .

[13]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[14]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[15]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Wen-Hsiang Tsai,et al.  Viewing corridors as right parallelepipeds for vision-based vehicle localization , 1999, IEEE Trans. Ind. Electron..

[17]  O. Chum,et al.  ENHANCING RANSAC BY GENERALIZED MODEL OPTIMIZATION Onďrej Chum, Jǐ , 2003 .

[18]  Ajay Kumar,et al.  Computer-Vision-Based Fabric Defect Detection: A Survey , 2008, IEEE Transactions on Industrial Electronics.

[19]  Liu Liu,et al.  Automated Visual Inspection System for Bogie Block Key Under Complex Freight Train Environment , 2016, IEEE Transactions on Instrumentation and Measurement.

[20]  Yanyu Lu,et al.  Moving object recognition under simulated prosthetic vision using background-subtraction-based image processing strategies , 2014, Inf. Sci..

[21]  Whoi-Yul Kim,et al.  Automated Inspection System for Rolling Stock Brake Shoes , 2011, IEEE Transactions on Instrumentation and Measurement.

[22]  Alberto Broggi,et al.  An evolutionary approach to visual sensing for vehicle navigation , 2003, IEEE Trans. Ind. Electron..

[23]  Qingyong Li,et al.  A Real-Time Visual Inspection System for Discrete Surface Defects of Rail Heads , 2012, IEEE Transactions on Instrumentation and Measurement.

[24]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[25]  Jigyendra Sen Yadav,et al.  Video object extraction and its tracking using background subtraction in complex environments , 2016 .

[26]  Qi Tian,et al.  SIFT match verification by geometric coding for large-scale partial-duplicate web image search , 2013, TOMCCAP.

[27]  De Xu,et al.  A Novel and Effective Surface Flaw Inspection Instrument for Large-Aperture Optical Elements , 2015, IEEE Transactions on Instrumentation and Measurement.

[28]  Chung-Feng Jeffrey Kuo,et al.  Automated inspection of micro-defect recognition system for color filter , 2015 .

[29]  Qian Huang,et al.  Improving Automatic Detection of Defects in Castings by Applying Wavelet Technique , 2006, IEEE Transactions on Industrial Electronics.

[30]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[31]  Jie Jiang,et al.  Automatic Registration Method for Optical Remote Sensing Images with Large Background Variations Using Line Segments , 2016, Remote. Sens..

[32]  Che-Seung Cho,et al.  Development of real-time vision-based fabric inspection system , 2005, IEEE Transactions on Industrial Electronics.

[33]  Hui Zhao,et al.  Vision method of inspecting missing fastening components in high-speed railway. , 2011, Applied optics.

[34]  Radu Horaud,et al.  On single-scanline camera calibration , 1993, IEEE Trans. Robotics Autom..

[35]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[36]  Jieping Ye,et al.  Multifeature, Sparse-Based Approach for Defects Detection and Classification in Semiconductor Units , 2018, IEEE Transactions on Automation Science and Engineering.

[37]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[38]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[39]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[40]  Shiliang Zhang,et al.  Edge-SIFT: Discriminative Binary Descriptor for Scalable Partial-Duplicate Mobile Search , 2013, IEEE Transactions on Image Processing.

[41]  Long Chen,et al.  Automatic Fastener Classification and Defect Detection in Vision-Based Railway Inspection Systems , 2014, IEEE Transactions on Instrumentation and Measurement.

[42]  Zhen Liu,et al.  Automatic visual inspection of a missing split pin in the China railway high-speed. , 2016, Applied optics.