Obstacles Extraction from a Video Taken by a Moving Camera

In automatic collision avoidance systems, the ability to detect obstacles is important. This paper proposes a method of automatic obstacles detection employing a camera mounted on a vehicle. Although various methods of obstacles detection have already been reported, they normally detect moving objects such as pedestrians and bicycles. In this paper, a method is proposed for detecting obstacles on a road, even if they are moving or static, by the use of background modeling and road region classification. Background modeling is often used to detect moving objects when a camera is static. In this paper, we apply it to a moving camera case in order to obtain foreground images. Then we calculate the camera motion parameters using the correspondence of feature points between two consecutive images and detect the road region using motion compensation. In this road region, we carry out regional classification. We can delete all objects which are not obstacles in the foreground images based on the result of the regional classification. In the performed experiments, it is shown that the proposed method is able to extract the shape of both static and moving obstacles in a frontal view from a car.

[1]  Michael Lützeler,et al.  ROAD RECOGNITION WITH MARVEYE , 1998 .

[2]  Patrick Bouthemy,et al.  Motion-based obstacle detection and tracking for car driving assistance , 2002, Object recognition supported by user interaction for service robots.

[3]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  C. Demonceaux,et al.  Robust obstacle detection with monocular vision based on motion analysis , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[5]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[8]  Andreas Kuehnle Symmetry-based vehicle location for AHS , 1997, Other Conferences.

[9]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  W. Kruger,et al.  Real-time estimation and tracking of optical flow vectors for obstacle detection , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[11]  Didier Aubert,et al.  Robust and Fast Stereovision Based Road Obstacles Detection for Driving Safety Assistance , 2002, MVA.

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  Massimo Bertozzi,et al.  Shape-based pedestrian detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[14]  Soraia Raupp Musse,et al.  Background Subtraction and Shadow Detection in Grayscale Video Sequences , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).