On-road Obstacle Detection by Comparing Present and Past In-vehicle Camera Images

We propose a method for detecting general obstacles on a road by subtracting present and past in-vehicle camera images. Compared to the existing learningbased methods that could detect only specific obstacles, the proposed method based on image-subtraction could detect any kind of obstacles. To achieve this, the proposed method first realizes a frame-by-frame correspondence between the present and the past in-vehicle camera image sequences, then performs a road surface registration between the corresponded frames. Obstacles are detected by using the difference of the road surface regions. To demonstrate the effectiveness of the proposed method, experiments were conducted using several image sequences captured by an actual in-vehicle camera. The experimental results showed that the proposed method could detect general obstacles accurately at a distance enough to safely avoid them.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Hiroshi Murase,et al.  Change detection in streetscapes from GPS coordinated omni-directional image sequences , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Kenji Nishida,et al.  Boosting with cross-validation based feature selection for pedestrian detection , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[5]  Feng Liu,et al.  IMMPDA vehicle tracking system using asynchronous sensor fusion of radar and vision , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[6]  Hironobu Fujiyoshi,et al.  Object detection by joint features based on two-stage boosting , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[7]  C. Hilario,et al.  Self-calibration of an On-Board Stereo-vision System for Driver Assistance Systems , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[8]  Jan Boehm Multi-image fusion for occlusion-free faÇade texturing , 2004 .