Real-Time Front Vehicle Detection Algorithm for an Asynchronous Binocular System

This paper describes a multi-resolution stereovision system for detecting the front-vehicle in advanced safety vehicles (ASVs). The two asynchronous CMOS cameras in the proposed system are mounted on a platform that can be easily clamped to the rearview mirror of a vehicle for detecting vehicles ahead. The asynchronous binocular platform provides a small low-cost obstacle detection system for practical ASVs that is easy to set up. The system uses a stereovision vehicle detection algorithm for real-time matching because the exposure times of the CMOS cameras are not synchronous. The algorithm uses a line segment matching module to match the extreme points of the horizontal and vertical edge segments at different resolutions to decrease the search area and computing complexity. As the distance of each matched segment can be calculated from the disparity value, each vehicle can be detected by clustering the segments that have similar distances in a searching and distance estimation module. The system was evaluated using static and dynamic analyses. Experimental results show that the proposed system can robustly and accurately detect the front-vehicles in real time under different illumination and road conditions.

[1]  Kunsoo Huh,et al.  A stereo vision-based obstacle detection system in vehicles , 2008 .

[2]  Klaus Dietmayer,et al.  Lane detection and street type classification using laser range images , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[3]  I. Morita,et al.  Design method for an automotive laser radar system and future prospects for laser radar , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[4]  Alfred O. Hero,et al.  Detection of curved road edges in radar images via deformable templates , 1997, Proceedings of International Conference on Image Processing.

[5]  Amnon Shashua,et al.  A robust method for computing vehicle ego-motion , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[6]  Nicolas Hautière,et al.  Real-time disparity contrast combination for onboard estimation of the visibility distance , 2006, IEEE Transactions on Intelligent Transportation Systems.

[7]  Kenji Suzuki,et al.  Fast connected-component labeling based on sequential local operations in the course of forward raster scan followed by backward raster scan , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[9]  Masayoshi Shono,et al.  76 GHz Millimeter Wave Automobile Radar using Single Chip MMIC , 2004 .

[10]  Shuzhi Sam Ge,et al.  IMMPDAF Approach for Road-Boundary Tracking , 2007, IEEE Transactions on Vehicular Technology.

[11]  K. Yamada,et al.  Preceding vehicle and road lanes recognition methods for RCAS using vision system , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[12]  R. Mobus,et al.  Multi-target multi-object tracking, sensor fusion of radar and infrared , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[13]  Massimo Bertozzi,et al.  Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis , 2006, IEEE Transactions on Image Processing.

[14]  Sridhar Lakshmanan,et al.  An algorithm for detecting roads and obstacles in radar images , 2001, IEEE Trans. Veh. Technol..

[15]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[16]  Tatsuya Suzuki,et al.  Measurement of vehicle motion and orientation using optical flow , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[17]  Sridhar Lakshmanan,et al.  A Deformable Template Approach to Detecting Straight Edges in Radar Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Alberto Broggi,et al.  Stereo vision-based feature extraction for vehicle detection , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[19]  Paolo Grisleri,et al.  Off-Road Path and Obstacle Detection Using Decision Networks and Stereo Vision , 2007, IEEE Transactions on Intelligent Transportation Systems.

[20]  Narayan Srinivasa Vision-based vehicle detection and tracking method for forward collision warning in automobiles , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[21]  A. Shashua,et al.  Pedestrian detection for driving assistance systems: single-frame classification and system level performance , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[22]  Alberto Broggi,et al.  Vehicle and Guard Rail Detection Using Radar and Vision Data Fusion , 2007, IEEE Transactions on Intelligent Transportation Systems.

[23]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[24]  Didier Aubert,et al.  A single framework for vehicle roll, pitch, yaw estimation and obstacles detection by stereovision , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[25]  Eigo Segawa,et al.  Preceding Vehicle Detection Using Stereo Images and Non-Scanning Millimeter-Wave Radar , 2005, MVA.

[26]  Dominique Gruyer,et al.  Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner , 2005, Auton. Robots.

[27]  Alfred O. Hero,et al.  Simultaneous detection of lane and pavement boundaries using model-based multisensor fusion , 2000, IEEE Trans. Intell. Transp. Syst..

[28]  Anil K. Jain,et al.  Detecting straight edges in millimeter-wave images , 1995, Proceedings., International Conference on Image Processing.