Robust Vehicle Surveillance in Night Traffic Videos Using an Azimuthally Blur Technique

Vehicle surveillance in complex dark traffic scenes has been a key research topic, as the background is dramatically altered due to the reflections from headlights on normal, snowy, and rainy roads. Under dark conditions, a vehicle's headlights and rear lights are used for foreground extraction. The presented algorithm provides several steps, including the detection, pairing, and tracking of headlights and rear lights. First, the headlights are automatically extracted by a novel approach called azimuthally blur, which uses the exponentially attenuating nature of reflected light. This approach is robust on highly reflective scenes because it makes the headlights orthogonal to the reflections. The headlights are then paired by partitioning the image into subgroups such that in each group, the headlights remain equidistant. The optimized tracker based on the maximum a posteriori (MAP) probability estimator is employed for further analysis such as speed estimation. This whole scheme is computationally inexpensive and can be deployed in application-specific integrated circuits. The proposed approach has outperformed state-of-the-art methods in challenging unlit traffic scenes.

[1]  Paola Mello,et al.  Image analysis and rule-based reasoning for a traffic monitoring system , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[2]  Wei Zhang,et al.  Multilevel Framework to Detect and Handle Vehicle Occlusion , 2008, IEEE Transactions on Intelligent Transportation Systems.

[3]  Kostia Robert Night-Time Traffic Surveillance: A Robust Framework for Multi-vehicle Detection, Classification and Tracking , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[4]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.

[5]  Hiroshi Hattori,et al.  Development of night-vision system , 2002, IEEE Trans. Intell. Transp. Syst..

[6]  Edward Jones,et al.  Rear-Lamp Vehicle Detection and Tracking in Low-Exposure Color Video for Night Conditions , 2010, IEEE Transactions on Intelligent Transportation Systems.

[7]  Marco Diani,et al.  Analysis of Multiresolution-Based Fusion Strategies for a Dual Infrared System , 2009, IEEE Transactions on Intelligent Transportation Systems.

[8]  Ming-Yang Chern,et al.  The lane recognition and vehicle detection at night for a camera-assisted car on highway , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[10]  Wei Zhang,et al.  Tracking and Pairing Vehicle Headlight in Night Scenes , 2012, IEEE Transactions on Intelligent Transportation Systems.

[12]  I. Cabani,et al.  Color-based detection of vehicle lights , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[13]  Chin-Hsing Chen,et al.  Vehicle Detection and Counting by Using Headlight Information in the Dark Environment , 2007, Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007).

[14]  Bing-Fei Wu,et al.  Nighttime Vehicle Detection for Driver Assistance and Autonomous Vehicles , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Xia Liu,et al.  Pedestrian detection and tracking with night vision , 2005, IEEE Transactions on Intelligent Transportation Systems.

[16]  Weihong Wang,et al.  A Two-Layer Night-Time Vehicle Detector , 2009, 2009 Digital Image Computing: Techniques and Applications.

[17]  Rita Cucchiara,et al.  Vehicle Detection under Day and Night Illumination , 1999, IIA/SOCO.

[18]  N. Otsu A threshold selection method from gray level histograms , 1979 .