Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner

We propose a new cooperative fusion approach between stereovision and laser scanner in order to take advantage of the best features and cope with the drawbacks of these two sensors to perform robust, accurate and real time-detection of multi-obstacles in the automotive context. The proposed system is able to estimate the position and the height, width and depth of generic obstacles at video frame rate (25 frames per second). The vehicle pitch, estimated by stereovision, is used to filter laser scanner raw data. Objects out of the road are removed using road lane information computed by stereovision. Various fusion schemes are proposed and one is experimented. Results of experiments in real driving situations (multi-pedestrians and multi-vehicles detection) are presented and stress the benefits of our approach.

[1]  Yaakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Applications and Advances , 1992 .

[2]  Yaakov Bar-Shalom,et al.  Multitarget/Multisensor Tracking: Applications and Advances -- Volume III , 2000 .

[3]  Uwe Franke,et al.  Real-time stereo vision for urban traffic scene understanding , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[4]  LIVIC-INRETS Lcpc.  IN-VEHICLE OBSTACLES DETECTION AND CHARACTERIZATION BY STEREOVISION , 2003 .

[5]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[6]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[7]  Didier Aubert,et al.  Robust and Fast Stereovision Based Road Obstacles Detection for Driving Safety Assistance , 2002, MVA.

[8]  T. Williamson.  A high-performance stereo vision system for obstacle detection , 1998 .

[9]  Atsuto Maki,et al.  Stereo without depth search and metric calibration , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  Jean-Philippe Tarel,et al.  On the design of a single lane-markings detectors regardless the on-board camera's position , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[11]  Allen R. Hanson,et al.  Qualitative obstacle detection , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  D. Gruyer,et al.  Data association with believe theory , 2000, Proceedings of the Third International Conference on Information Fusion.

[13]  Véronique Berge-Cherfaoui,et al.  Multi-objects association in perception of dynamical situation , 1999, UAI.

[14]  Rongben Wang,et al.  A vision-based road edge detection algorithm , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[15]  Jitendra Malik,et al.  Binocular Stereopsis and Lane Marker Flow for Vehicle Navigation: Lateral and Longitudinal Control , 1994 .

[16]  C. Laurgeau,et al.  Vehicle yaw, pitch, roll and 3D lane shape recovery by vision , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[17]  Masatoshi Okutomi,et al.  Extraction of road region using stereo images , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  AubertDidier,et al.  Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner , 2005 .

[19]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[20]  Jean-Philippe Tarel,et al.  Combined dynamic tracking and recognition of curves with application to road detection , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).