Automatic Visual Detection System of Railway Surface Defects With Curvature Filter and Improved Gaussian Mixture Model

Rails are among the most important components of railway transportation, and real-time defects detection of the railway is an important and challenging task because of intensity inhomogeneity, low contrast, and noise. This paper presents an automatic railway visual detection system (RVDS) for surface defects and focuses on several key issues of RVDS. First, in view of challenges such as complex condition and orbital reflectance inequality, we put forward a region-of-interest detection region extraction algorithm by vertical projection and gray contrast algorithm. In addition, a curvature filter equipped with implicit computing and surface preserving power is studied to eliminate noise and keep only the details. Then, an improved fast and robust Gaussian mixture model based on Markov random field is established for accurate and rapid surface defect segmentation. Additionally, an expectation–maximization algorithm is applied to optimize the parameters. The experimental results demonstrate that the proposed method performs well with both noisy and railway images, which enables identification and segmentation of the defects from rail surface, achieving detection performance with 92% precision and 88.8% recall rate on average, and is robust compared with the related well-established approaches.

[1]  Qingyong Li,et al.  A Visual Detection System for Rail Surface Defects , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  H.A. Toliyat,et al.  Rail defect diagnosis using wavelet packet decomposition , 2002, Conference Record of the 2002 IEEE Industry Applications Conference. 37th IAS Annual Meeting (Cat. No.02CH37344).

[3]  Stan Z. Li Markov Random Field Modeling in Image Analysis , 2009, Advances in Pattern Recognition.

[4]  Robin Clark,et al.  Rail flaw detection: overview and needs for future developments , 2004 .

[5]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[6]  Di Guo,et al.  Extreme Kernel Sparse Learning for Tactile Object Recognition , 2017, IEEE Transactions on Cybernetics.

[7]  A. R. Jac Fredo,et al.  Segmentation and analysis of damages in composite images using multi-level threshold methods and geometrical features , 2017 .

[8]  Andrew Ball,et al.  Adaptive noise cancelling and time-frequency techniques for rail surface defect detection , 2015 .

[9]  Qingyong Li,et al.  A Real-Time Visual Inspection System for Discrete Surface Defects of Rail Heads , 2012, IEEE Transactions on Instrumentation and Measurement.

[10]  Yaonan Wang,et al.  Surface defect detection for high-speed rails using an inverse P-M diffusion model , 2016 .

[11]  Narendra Ahuja,et al.  Automated Visual Inspection of Railroad Tracks , 2013, IEEE Transactions on Intelligent Transportation Systems.

[12]  Bart De Schutter,et al.  Deep convolutional neural networks for detection of rail surface defects , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[13]  Yuanhao Gong,et al.  Bernstein filter: A new solver for mean curvature regularized models , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Thomas J. Hebert,et al.  Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm , 1998, IEEE Trans. Image Process..

[15]  Mehmet Karaköse,et al.  Rail defect detection with real time image processing technique , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[16]  Sheikh Tania,et al.  A Comparative Study of Various Image Filtering Techniques for Removing Various Noisy Pixels in Aerial Image , 2016 .

[17]  Alessandro Sabato,et al.  Feasibility of digital image correlation for railroad tie inspection and ballast support assessment , 2017 .

[18]  Rama Chellappa,et al.  Deep Multitask Learning for Railway Track Inspection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[19]  Long Chen,et al.  Automatic Fastener Classification and Defect Detection in Vision-Based Railway Inspection Systems , 2014, IEEE Transactions on Instrumentation and Measurement.

[20]  T. Heckel,et al.  Advantage of a combined ultrasonic and eddy current examination for railway inspection trains , 2007 .

[21]  Xingming Sun,et al.  Effective and Efficient Global Context Verification for Image Copy Detection , 2017, IEEE Transactions on Information Forensics and Security.

[22]  Siwei Luo,et al.  Deblurring Gaussian-blur images: A preprocessing for rail head surface defect detection , 2011, Proceedings of 2011 IEEE International Conference on Service Operations, Logistics and Informatics.

[23]  Q. M. Jonathan Wu,et al.  Fast and Robust Spatially Constrained Gaussian Mixture Model for Image Segmentation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  De Xu,et al.  A Novel and Effective Surface Flaw Inspection Instrument for Large-Aperture Optical Elements , 2015, IEEE Transactions on Instrumentation and Measurement.

[25]  Nikolas P. Galatsanos,et al.  A spatially constrained mixture model for image segmentation , 2005, IEEE Transactions on Neural Networks.

[26]  Yuanhao Gong,et al.  Spectrally regularized surfaces , 2015 .

[27]  Vincenzo Piuri,et al.  Composite real-time image processing for railways track profile measurement , 2000, IEEE Trans. Instrum. Meas..

[28]  Yi Shen,et al.  Non-destructive photoacoustic detecting method for high-speed rail surface defects , 2014, 2014 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[29]  Hengshan Hu,et al.  An improved AE detection method of rail defect based on multi-level ANC with VSS-LMS , 2018 .

[30]  Nicola Ancona,et al.  Filter-based feature selection for rail defect detection , 2004 .

[31]  Nikolas P. Galatsanos,et al.  A Class-Adaptive Spatially Variant Mixture Model for Image Segmentation , 2007, IEEE Transactions on Image Processing.

[32]  Yimin Yang,et al.  Fusion-based foreground enhancement for background subtraction using multivariate multi-model Gaussian distribution , 2018, Inf. Sci..

[33]  Zainul Abdin Jaffery,et al.  Maximally Stable Extremal Region Marking-Based Railway Track Surface Defect Sensing , 2016, IEEE Sensors Journal.

[34]  Rama Chellappa,et al.  Robust Fastener Detection for Autonomous Visual Railway Track Inspection , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[35]  W. Marsden I and J , 2012 .

[36]  Shiguo Lian,et al.  Forensics feature analysis in quaternion wavelet domain for distinguishing photographic images and computer graphics , 2017, Multimedia Tools and Applications.

[37]  Ilkay Ulusoy,et al.  Railway Fastener Inspection by Real-Time Machine Vision , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[38]  Joseph W. Palese,et al.  RISK BASED ULTRASONIC RAIL TEST SCHEDULING ON BURLINGTON NORTHERN SANTA FE , 2000 .

[39]  Zexuan Ji,et al.  A spatially constrained generative asymmetric Gaussian mixture model for image segmentation , 2016, J. Vis. Commun. Image Represent..

[40]  Wai Lok Woo,et al.  Quantitative Surface Crack Evaluation Based on Eddy Current Pulsed Thermography , 2017, IEEE Sensors Journal.

[41]  Nii Attoh-Okine,et al.  Big Data and Differential Privacy: Analysis Strategies for Railway Track Engineering , 2017 .

[42]  Ivo F. Sbalzarini,et al.  Curvature Filters Efficiently Reduce Certain Variational Energies , 2017, IEEE Transactions on Image Processing.

[43]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[44]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[45]  Huchuan Lu,et al.  Medical Image Fusion and Denoising with Alternating Sequential Filter and Adaptive Fractional Order Total Variation , 2017, IEEE Transactions on Instrumentation and Measurement.

[46]  Ying Li,et al.  Rail Component Detection, Optimization, and Assessment for Automatic Rail Track Inspection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[47]  S L Grassie,et al.  Squats and squat-type defects in rails: the understanding to date , 2012 .

[48]  Valery Naranjo,et al.  Axlebox accelerations: Their acquisition and time–frequency characterisation for railway track monitoring purposes , 2016 .

[49]  S. L. Grassie,et al.  Rail defects: an overview , 2003 .

[50]  David M. J. Tax,et al.  Semi-supervised rail defect detection from imbalanced image data , 2016 .

[51]  Ettore Stella,et al.  A Real-Time Visual Inspection System for Railway Maintenance: Automatic Hexagonal-Headed Bolts Detection , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[52]  Qingquan Li,et al.  An efficient and reliable coarse-to-fine approach for asphalt pavement crack detection , 2017, Image Vis. Comput..

[53]  E. Stella,et al.  Visual recognition of fastening bolts for railroad maintenance , 2004, Pattern Recognit. Lett..