Moving camera background-subtraction for obstacle detection on railway tracks

We propose a method for detecting obstacles by comparing input and reference train frontal view camera images. In the field of obstacle detection, most methods employ a machine learning approach, so they can only detect pre-trained classes, such as pedestrian, bicycle, etc. This means that obstacles of unknown classes cannot be detected. To overcome this problem, we propose a background subtraction method that can be applied to moving cameras. First, the proposed method computes frame-by-frame correspondences between the current and the reference (database) image sequences. Then, obstacles are detected by applying image subtraction to corresponding frames. To confirm the effectiveness of the proposed method, we conducted an experiment using several image sequences captured on an experimental track. Its results showed that the proposed method could detect various obstacles accurately and effectively.

[1]  Hiroshi Murase,et al.  Subtraction-Based Forward Obstacle Detection Using Illumination Insensitive Feature for Driving-Support , 2012, ECCV Workshops.

[2]  Cordelia Schmid,et al.  DeepFlow: Large Displacement Optical Flow with Deep Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Takeo Kanade,et al.  Background Subtraction for Freely Moving Cameras , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Ahmed M. Elgammal,et al.  Online Moving Camera Background Subtraction , 2012, ECCV.

[5]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[6]  M. Okutomi,et al.  Obstacle detection using millimeter-wave radar and its visualization on image sequence , 2004, ICPR 2004.

[7]  Bogdan Tomoyuki Nassu,et al.  A Vision-Based Approach for Rail Extraction and its Application in a Camera Pan–Tilt Control System , 2012, IEEE Transactions on Intelligent Transportation Systems.

[8]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  F. Ahmed,et al.  An obstacle detection system for automated trains , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[11]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  S. Mockel,et al.  Multi-sensor obstacle detection on railway tracks , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[13]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Yaser Sheikh,et al.  Visual monitoring of railroad grade crossing , 2004, SPIE Defense + Commercial Sensing.

[15]  Yutaka Satoh,et al.  Robust event detection by radial reach filter (RRF) , 2002, Object recognition supported by user interaction for service robots.

[16]  Cristiano Premebida,et al.  Exploiting LIDAR-based features on pedestrian detection in urban scenarios , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.