Tracking and Pairing Vehicle Headlight in Night Scenes

Traffic surveillance is an important topic in computer vision and intelligent transportation systems and has intensively been studied in the past decades. However, most of the state-of-the-art methods concentrate on daytime traffic monitoring. In this paper, we propose a nighttime traffic surveillance system, which consists of headlight detection, headlight tracking and pairing, and camera calibration and vehicle speed estimation. First, a vehicle headlight is detected using a reflection intensity map and a reflection suppressed map based on the analysis of the light attenuation model. Second, the headlight is tracked and paired by utilizing a simple yet effective bidirectional reasoning algorithm. Finally, the trajectories of the vehicle's headlight are employed to calibrate the surveillance camera and estimate the vehicle's speed. Experimental results on typical sequences show that the proposed method can robustly detect, track, and pair the vehicle headlight in night scenes. Extensive quantitative evaluations and related comparisons demonstrate that the proposed method outperforms state-of-the-art methods.

[1]  Wei-Yun Yau,et al.  An automatic drowning detection surveillance system for challenging outdoor pool environments , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Ying Liu,et al.  An HMM/MRF-based stochastic framework for robust vehicle tracking , 2004, IEEE Transactions on Intelligent Transportation Systems.

[3]  N. H. C. Yung,et al.  A Method for Vehicle Count in the Presence of Multiple-Vehicle Occlusions in Traffic Images , 2007, IEEE Transactions on Intelligent Transportation Systems.

[4]  Zhanyi Hu,et al.  Camera calibration and 3D reconstruction from a single view based on scene constraints , 2005, Image Vis. Comput..

[5]  Rita Cucchiara,et al.  Vehicle Detection under Day and Night Illumination , 1999, IIA/SOCO.

[6]  Bing-Fei Wu,et al.  Nighttime Vehicle Detection for Driver Assistance and Autonomous Vehicles , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Edward Jones,et al.  Rear-Lamp Vehicle Detection and Tracking in Low-Exposure Color Video for Night Conditions , 2010, IEEE Transactions on Intelligent Transportation Systems.

[8]  Paola Mello,et al.  Image analysis and rule-based reasoning for a traffic monitoring system , 2000, IEEE Trans. Intell. Transp. Syst..

[9]  Wei Zhang,et al.  Multilevel Framework to Detect and Handle Vehicle Occlusion , 2008, IEEE Transactions on Intelligent Transportation Systems.

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.

[12]  Zhanyi Hu,et al.  Single view metrology from scene constraints , 2005, Image Vis. Comput..

[13]  Yupin Luo,et al.  Real-Time Pedestrian Detection and Tracking at Nighttime for Driver-Assistance Systems , 2009, IEEE Transactions on Intelligent Transportation Systems.

[14]  Marco Diani,et al.  Analysis of Multiresolution-Based Fusion Strategies for a Dual Infrared System , 2009, IEEE Transactions on Intelligent Transportation Systems.

[15]  Hiroshi Hattori,et al.  Development of night-vision system , 2002, IEEE Trans. Intell. Transp. Syst..

[16]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[17]  Kostia Robert Night-Time Traffic Surveillance: A Robust Framework for Multi-vehicle Detection, Classification and Tracking , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[18]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[19]  Ming-Yang Chern,et al.  The lane recognition and vehicle detection at night for a camera-assisted car on highway , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[20]  Jun Cai,et al.  Video-Based Automatic Incident Detection for Smart Roads: The Outdoor Environmental Challenges Regarding False Alarms , 2008, IEEE Transactions on Intelligent Transportation Systems.

[21]  M. Bouguer Traité d'optique sur la gradation de la lumiere : ouvrage posthume ... et publié par M. l'Abbé de la Caille ... pour servir de suite aux Memoires de l'Académie royale des sciences , 1974 .

[22]  Wei Zhang,et al.  Moving vehicles segmentation based on Bayesian framework for Gaussian motion model , 2006, Pattern Recognit. Lett..

[23]  Xia Liu,et al.  Pedestrian detection and tracking with night vision , 2005, IEEE Transactions on Intelligent Transportation Systems.

[24]  Andres Huertas,et al.  Daytime Water Detection by Fusing Multiple Cues for Autonomous Off-Road Navigation , 2006 .

[25]  I. Cabani,et al.  Color-based detection of vehicle lights , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[26]  Chin-Hsing Chen,et al.  Vehicle Detection and Counting by Using Headlight Information in the Dark Environment , 2007, Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007).

[27]  Mohan M. Trivedi,et al.  Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video , 2008, IEEE Transactions on Intelligent Transportation Systems.

[28]  Guanghui Wang,et al.  Vehicle Headlights Detection Using Markov Random Fields , 2009, ACCV.

[29]  Stephanie Hold,et al.  Vehicle recognition and TTC estimation at night based on spotlight pairing , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[30]  Weihong Wang,et al.  A Two-Layer Night-Time Vehicle Detector , 2009, 2009 Digital Image Computing: Techniques and Applications.

[31]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.