Sensor Data Fusion for Road Obstacle Detection: A Validation Framework

Obstacle detection is an essential task for autonomous robots. In particular, in the context of Intelligent Transportation Systems (ITS), vehicles (cars, trucks, buses, etc.) can be considered as robots; the development of Advance Driving Assistance Systems (ADAS), such as collision mitigation, collision avoidance, pre-crash or Automatic Cruise Control, requires that reliable road obstacle detection systems are available. To perform obstacle detection, various approaches have been proposed, depending on the sensor involved: telemeters like radar (Skutek et al., 2003) or laser scanner (Labayrade et al., 2005; Mendes et al., 2004), cooperative detection systems (Griffiths et al., 2001; Von Arnim et al., 2007), or vision systems. In this particular field, monocular vision generally exploits the detection of specific features like edges, symmetry (Bertozzi et al., 2000), color (Betke & Nguyen, 1998) (Yamaguchi et al., 2006) or even saliency maps (Michalke et al., 2007). Anyway, most monocular approaches suppose recognition of specific objects, like vehicles or pedestrians, and are therefore not generic. Stereovision is particularly suitable for obstacle detection (Bertozzi & Broggi, 1998; Labayrade et al., 2002; Nedevschi et al., 2004; Williamson, 1998), because it provides a tri-dimensional representation of the road scene. A critical point about obstacle detection for the aimed automotive applications is reliability: the detection rate must be high, while the false detection rate must remain extremely low. So far, experiments and assessments of already developed systems show that using a single sensor is not enough to meet these requirements: due to the high complexity of road scenes, no single sensor system can currently reach the expected 100% detection rate with no false positives. Thus, multi-sensor approaches and fusion of data from various sensors must be considered, in order to improve the performances. Various fusion strategies can be imagined, such as merging heterogeneous data from various sensors (Steux et al., 2002). More specifically, many authors proposed cooperation between an active sensor and a vision system, for instance a radar with mono-vision (Sugimoto et al., 2004), a laser scanner with a camera (Kaempchen et al., 2005), a stereovision rig (Labayrade et al., 2005), etc. Cooperation between mono and stereovision has also been investigated (Toulminet et al., 2006). 16

[1]  C. Laurgeau,et al.  Fade: a vehicle detection and tracking system featuring monocular color vision and radar data fusion , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[2]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[3]  T. Williamson A high-performance stereo vision system for obstacle detection , 1998 .

[4]  Y. Ninomiya,et al.  Moving Obstacle Detection using Monocular Vision , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[5]  Geoffrey Egnal,et al.  Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Ravindra K. Ahuja,et al.  Network Flows: Theory, Algorithms, and Applications , 1993 .

[7]  Véronique Berge-Cherfaoui,et al.  Matching and decision for vehicle tracking in road situation , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[8]  M. Okutomi,et al.  Obstacle detection using millimeter-wave radar and its visualization on image sequence , 2004, ICPR 2004.

[9]  Sergiu Nedevschi,et al.  Stereovision Approach for Obstacle Detection on Non-Planar Roads , 2004, ICINCO.

[10]  D. Gruyer,et al.  Data association with believe theory , 2000, Proceedings of the Third International Conference on Information Fusion.

[11]  G. Wanielik,et al.  A precrash system based on radar for automotive applications , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[12]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[13]  Mathias Perrollaz,et al.  A Three Resolution Framework for Reliable Road Obstacle Detection Using Stereovision , 2007, MVA.

[14]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[15]  Dominique Gruyer,et al.  Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner , 2005, Auton. Robots.

[16]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[17]  Charles E. Thorpe,et al.  Sensor-friendly vehicle and roadway systems , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[18]  Jannik Fritsch,et al.  Towards a Human-like Vision System for R esource-Constrained Intelligent Cars , 2007 .

[19]  D. Aubert,et al.  A collision mitigation system using laser scanner and stereovision fusion and its assessment , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[20]  M. Buehler,et al.  Feature-level fusion for free-form object tracking using laserscanner and video , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[21]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Véronique Berge-Cherfaoui,et al.  Multi-objects association in perception of dynamical situation , 1999, UAI.

[23]  Philippe Smets,et al.  Classification Using Belief Functions: Relationship Between Case-Based and Model-Based Approaches , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[25]  Margrit Betke,et al.  HIGHWAY SCENE ANALYSIS FROM A MOVING VEHICLE UNDER REDUCED VISIBILITY CONDITIONS , 1998 .

[26]  Walter Stechele,et al.  Stereo Vision based Vehicle Detection , 2010, VISAPP.

[27]  L.C. Bento,et al.  Multi-target detection and tracking with a laser scanner , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[28]  A. von Arnim,et al.  Vehicle Identification Using Near Infrared Vision and Applications to Cooperative Perception , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[29]  Massimo Bertozzi,et al.  Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis , 2006, IEEE Transactions on Image Processing.