Obstacle detection and classification fusing radar and vision

This paper presents a system whose aim is to detect and classify road obstacles, like pedestrians and vehicles, by fusing data coming from different sensors: a camera, a radar, and an inertial sensor. The camera is mainly used to refine the vehiclespsila boundaries detected by the radar and to discard those who might be false positives; at the same time, a symmetry based pedestrian detection algorithm is executed, and its results are merged with a set of regions of interest, provided by a Motion Stereo technique.

[1]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[2]  C. Vestri,et al.  3D parking assistant system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[3]  Sergiu Nedevschi,et al.  On-line calibration method for stereovision systems used in vehicle applications , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[4]  Michael Rose,et al.  Stereo-based preprocessing for human shape localization in unstructured environments , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[5]  P. C. Antonello,et al.  Multi-resolution vehicle detection using artificial vision , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[6]  Dean A. Pomerleau,et al.  Overtaking vehicle detection using implicit optical flow , 1999 .

[7]  Massimo Bertozzi,et al.  Shape-based pedestrian detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[8]  R. Alix,et al.  Flat world homography for non-flat world on-road obstacle detection , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[9]  Michel Dhome,et al.  Real Time Localization and 3D Reconstruction , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Alberto Broggi,et al.  Vehicle and Guard Rail Detection Using Radar and Vision Data Fusion , 2007, IEEE Transactions on Intelligent Transportation Systems.

[11]  Alberto Broggi,et al.  The Single Frame Stereo Vision System for Reliable Obstacle Detection Used during the 2005 DARPA Grand Challenge on TerraMax , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[12]  M. Clabian,et al.  Single camera lane detection and tracking , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[13]  Pietro Cerri,et al.  Radar-vision fusion for vehicle detection , 2006 .

[14]  David Nistér,et al.  Frame Decimation for Structure and Motion , 2000, SMILE.

[15]  Takeo Kato,et al.  An obstacle detection method by fusion of radar and motion stereo , 2002, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).