Increasing driving safety with a multiple vehicle detection and tracking system using ongoing vehicle shadow information

This paper proposes a vehicle detection and tracking system based on processing monochrome images captured by a single camera. The work has mainly been focused on detecting and tracking vehicles in daylight conditions, viewed from inside a vehicle. Unlike previous work, this approach uses vehicle shadow clues and vehicle edge information to obtain cost effective and fast estimation. The proposed method includes road area finding which has been implemented by a lane detection algorithm to avoid false detections of vehicles caused by the distraction of background objects. Assuming that lanes are successfully detected, vehicle presence inside the road area is hypothesized by using “shadow” as a cue. Hypothesized vehicle locations are verified using vertical edges. After extracting vehicles, the algorithm effectively tracks them using a Kalman filter based tracking algorithm. A vehicle has been instrumented with various sensors for the experiments. Several sequences from real traffic situations have been tested, obtaining highly accurate multiple vehicle detections. Tracking information is used to estimate time-to-collision (TTC) and warn the driver for a possible collision.

[1]  Nan Wang,et al.  Rear Vehicle Detection and Tracking for Lane Change Assist , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[2]  U. Franke,et al.  Monocular Video serves RADAR-based Emergency Braking , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[3]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.

[4]  Andreas Kuehnle,et al.  Symmetry-based recognition of vehicle rears , 1991, Pattern Recognit. Lett..

[5]  L. Davis,et al.  Real-time multiple vehicle detection and tracking from a moving vehicle , 2000, Machine Vision and Applications.

[6]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Volkan Sezer,et al.  Framework for development of driver adaptive warning and assistance systems that will be triggered by a driver inattention monitor , 2010 .

[8]  Youngjoon Han,et al.  Vehicle Detection Method using Haar-like Feature on Real Time System , 2009 .

[9]  O. Mano,et al.  Forward collision warning with a single camera , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[10]  Amnon Shashua,et al.  A Computer Vision System on a Chip: a case study from the automotive domain , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[11]  Ki Yong Lee,et al.  Vehicle detection by edge-based candidate generation and appearance-based classification , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[12]  B.K.P. Horn,et al.  Time to Contact Relative to a Planar Surface , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[13]  T. Parks Signal processing: Discrete spectral analysis, detection, and estimation , 1976, Proceedings of the IEEE.