Train bogie part recognition with multi-object multi-template matching adaptive algorithm

Abstract Automation of train rolling stock monitoring system by recognizing the bogie parts is a process of identifying defects in the train undercarriage moving at >30 Kmph. Recognizing the parts of a moving train using computer vision models based on color and texture with deformable curve segmentation models is a challenging and computationally intensive. A multi object multi-template model is proposed to solve this problem in a computationally less intensive process. A multi object multi template library with 26 objects in 40 bogie frames was created based on statistical parameters of the bogie part in the center of the frame through template extraction model. Fifty templates were designed from 250 frames of the first bogie movement through the camera plane. Maximum normalized cross correlation coefficient calculated on each frame with a 26 – by – 40 template matrices identifies the bogie parts in the frame in a single computation. High speed recording of the train bogies at 240 fps establishes the datasets for experimentation having 2 trains with 20 coaches each capturing 15,000 frames per train. The correct recognition accuracy is 91% with a false recognition rate of 15%.

[1]  Sarah Sharples,et al.  Expert knowledge elicitation to generate human factors guidance for future European Rail Traffic Management System (ERTMS) train driving models , 2017 .

[2]  Hui Ding,et al.  Scale-free network model for template matching based on kernel histogram , 2014 .

[3]  Alessandro Sabato,et al.  Feasibility of digital image correlation for railroad tie inspection and ballast support assessment , 2017 .

[4]  Robert C. Qiu,et al.  Kernel Feature Template Matching for Spectrum Sensing , 2014, IEEE Transactions on Vehicular Technology.

[5]  Ling Lin,et al.  A Continuously Adaptive Template Matching Algorithm for Human Tracking , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[6]  Uwe D. Hanebeck,et al.  Template matching using fast normalized cross correlation , 2001, SPIE Defense + Commercial Sensing.

[7]  Larry S. Davis,et al.  Shape-Based Human Detection and Segmentation via Hierarchical Part-Template Matching , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Christopher B. Jones,et al.  Automatic semantic and geometric enrichment of CityGML building models using HoG-based template matching , 2017 .

[9]  P. V. V. Kishore,et al.  Performance of active contour models in train rolling stock part segmentation on high-speed video data , 2017 .

[10]  Hanchuan Peng,et al.  Document Image Recognition Based on Template Matching of Component Block Projections , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Yong Qin,et al.  Research on Framework and Key Technologies of Urban Rail Intelligent Transportation System , 2016 .

[12]  Whoi-Yul Kim,et al.  Automated Inspection System for Rolling Stock Brake Shoes , 2011, IEEE Transactions on Instrumentation and Measurement.

[13]  Tao Tang,et al.  Efficient dual-association resource allocation model of train-ground communication system based on TD-LTE in urban rail transit , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[14]  Yacov Hel-Or,et al.  Matching by Tone Mapping: Photometric Invariant Template Matching , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Konrad Wegener,et al.  A new grinding strategy to improve the acoustic properties of railway tracks , 2018 .

[16]  Tao Tang,et al.  A Safety Management and Signaling System Integration Method for Communication-Based Train Control System , 2017 .

[17]  Guanjun Bao,et al.  Multi-template matching algorithm for cucumber recognition in natural environment , 2016, Comput. Electron. Agric..

[18]  Satish Chandra,et al.  Railway Engineering , 2008 .

[19]  Ch. Raghava Prasad,et al.  Computer Vision Based Train Rolling Stock Examination , 2010 .

[20]  Sundaravalli Narayanaswami Urban transportation: innovations in infrastructure planning and development , 2017 .

[21]  Yu Zhang,et al.  The application of WTP in 3-D reconstruction of train wheel surface and tread defect , 2017 .

[22]  Mohd Shafry Mohd Rahim,et al.  Enhancement of template-based method for overlapping rubber tree leaf identification , 2016, Comput. Electron. Agric..

[23]  Rajesh Patel,et al.  Effective Extraction of Visual Event-Related Pattern by Combining Template Matching With Ensemble Empirical Mode Decomposition , 2017, IEEE Sensors Journal.

[24]  Roger M. Goodall,et al.  Track and Vehicle Condition Monitoring during Normal Operation Using Reduced Sensor Sets , 2006 .

[25]  Arif Mahmood,et al.  Correlation-Coefficient-Based Fast Template Matching Through Partial Elimination , 2012, IEEE Transactions on Image Processing.

[26]  Slawomir Judek,et al.  3D machine vision system for inspection of contact strips in railway vehicle current collectors , 2014, 2014 International Conference on Applied Electronics.

[27]  Vladimir Bougay KNOEMA-A Knowledge Platform , 2014 .

[28]  P. V. V. Kishore,et al.  Train rolling stock segmentation with morphological differential gradient active contours , 2015, 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[29]  P. V. V. Kishore,et al.  Train Rolling Stock Intelligent Monitoring with Computer Vision , 2017 .

[30]  N. L. Kazanskiy,et al.  Integrated design technology for computer vision systems in railway transportation , 2015, Pattern Recognition and Image Analysis.