TerraMax Vision at the Urban Challenge 2007

This paper presents the TerraMax vision systems used during the 2007 DARPA Urban Challenge. First, a description of the different vision systems is provided, focusing on their hardware configuration, calibration method, and tasks. Then, each component is described in detail, focusing on the algorithms and sensor fusion opportunities: obstacle detection, road marking detection, and vehicle detection. The conclusions summarize the lesson learned from the developing of the passive sensing suite and its successful fielding in the Urban Challenge.

[1]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[2]  Alberto Broggi,et al.  Obstacle Detection with Stereo Vision for Off-Road Vehicle Navigation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Alberto Broggi,et al.  StereoBox: A Robust and Efficient Solution for Automotive Short-Range Obstacle Detection , 2007, EURASIP J. Embed. Syst..

[4]  R. Danescu,et al.  Increased Accuracy Stereo Approach for 3D Lane Detection , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[5]  Nan Wang,et al.  Rear Vehicle Detection and Tracking for Lane Change Assist , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[6]  Ulrich Kressel,et al.  Tracking non-rigid, moving objects based on color cluster flow , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Yan Zhang,et al.  Robust Moving Object Detection at Distance in the Visible Spectrum and Beyond Using A Moving Camera , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[8]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[9]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Paolo Grisleri,et al.  Off-Road Path and Obstacle Detection Using Decision Networks and Stereo Vision , 2007, IEEE Transactions on Intelligent Transportation Systems.

[11]  Petros Maragos,et al.  Region-based optical flow estimation , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[13]  Frans C. A. Groen,et al.  Vehicle detection with a mobile camera: spotting midrange, distant, and passing cars , 2005, IEEE Robotics & Automation Magazine.

[14]  W. Ritter,et al.  Obstacle detection based on color blob flow , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[15]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[16]  Alberto Broggi,et al.  The Single Frame Stereo Vision System for Reliable Obstacle Detection Used during the 2005 DARPA Grand Challenge on TerraMax , 2006, 2006 IEEE Intelligent Transportation Systems Conference.