Intelligent Highway Traffic Surveillance With Self-Diagnosis Abilities

In this paper, we propose a self-diagnosing intelligent highway surveillance system and design effective solutions for both daytime and nighttime traffic surveillance. For daytime surveillance, vehicles are detected via background modeling. For nighttime videos, headlights of vehicles need to be located and paired for vehicle detection. An algorithm based on likelihood computation is developed to pair the headlights of vehicles at night. Moreover, to balance between the robustness and abundance of acquired information, the proposed system adapts different strategies under different traffic conditions. Performing tracking would be preferred when traffic is smooth. However, under congestion conditions, it is better to obtain traffic parameters by estimation. We utilize a time-varying adaptive system state transition matrix in Kalman filter for better prediction in a traffic surveillance scene when performing tracking. We also propose a mechanism for estimating the traffic flow parameter via regression analysis. The experimental results have shown that the self-diagnosis ability and the modules designed for the system make the proposed system robust and reliable.

[1]  Mohan M. Trivedi,et al.  A General Active-Learning Framework for On-Road Vehicle Recognition and Tracking , 2010, IEEE Transactions on Intelligent Transportation Systems.

[2]  Chih-Ming Hsieh,et al.  Vision-based nighttime vehicle detection and range estimation for driver assistance , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[3]  Jenq-Neng Hwang,et al.  Adaptive particle sampling and adaptive appearance for multiple video object tracking , 2009, Signal Process..

[4]  Nicolas Martel-Brisson,et al.  Learning and Removing Cast Shadows through a Multidistribution Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Edward Jones,et al.  Rear-Lamp Vehicle Detection and Tracking in Low-Exposure Color Video for Night Conditions , 2010, IEEE Transactions on Intelligent Transportation Systems.

[6]  Paola Mello,et al.  Image analysis and rule-based reasoning for a traffic monitoring system , 2000, IEEE Trans. Intell. Transp. Syst..

[7]  Enrico Viarani Extraction of traffic information from images at DEIS , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[8]  Jenq-Neng Hwang,et al.  Multiple-Target Tracking for Crossroad Traffic Utilizing Modified Probabilistic Data Association , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[9]  Chia-Hung Yeh,et al.  Robust Vehicle and Traffic Information Extraction for Highway Surveillance , 2005, EURASIP J. Adv. Signal Process..

[10]  M. Kilger,et al.  Video-based traffic monitoring , 1992 .

[11]  Nikolaos Papanikolopoulos,et al.  Clustering of Vehicle Trajectories , 2010, IEEE Transactions on Intelligent Transportation Systems.

[12]  Weihong Wang,et al.  A Two-Layer Night-Time Vehicle Detector , 2009, 2009 Digital Image Computing: Techniques and Applications.

[13]  Mahmood Fathy,et al.  A neural-vision based approach to measure traffic queue parameters in real-time , 1999, Pattern Recognit. Lett..

[14]  J. D Gergonne,et al.  The application of the method of least squares to the interpolation of sequences , 1974 .

[15]  Derek R. Magee,et al.  Tracking multiple vehicles using foreground, background and motion models , 2004, Image Vis. Comput..

[16]  Kosmas Dimitropoulos,et al.  Video sensor network for real-time traffic monitoring and surveillance , 2010 .

[17]  Hsu-Yung Cheng,et al.  Lane Detection With Moving Vehicles in the Traffic Scenes , 2006, IEEE Transactions on Intelligent Transportation Systems.

[18]  Jenq-Neng Hwang,et al.  Fast and automatic video object segmentation and tracking for content-based applications , 2002, IEEE Trans. Circuits Syst. Video Technol..

[19]  N. H. C. Yung,et al.  Lane detection by orientation and length discrimination , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[21]  Daniel J. Dailey,et al.  Dynamic camera calibration of roadside traffic management cameras for vehicle speed estimation , 2003, IEEE Trans. Intell. Transp. Syst..

[22]  Katsushi Ikeuchi,et al.  Traffic monitoring and accident detection at intersections , 2000, IEEE Trans. Intell. Transp. Syst..

[23]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[24]  K W Dickinson,et al.  VIDEO IMAGE PROCESSING FOR MONITORING ROAD TRAFFIC , 1984 .

[25]  Daniel J. Dailey,et al.  An algorithm to estimate mean traffic speed using uncalibrated cameras , 2000, IEEE Trans. Intell. Transp. Syst..

[26]  Nikolaos Papanikolopoulos,et al.  Learning to Recognize Video-Based Spatiotemporal Events , 2009, IEEE Transactions on Intelligent Transportation Systems.

[27]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[28]  Mahmood Fathy,et al.  A window-based image processing technique for quantitative and qualitative analysis of road traffic parameters , 1998 .

[29]  Kostia Robert Night-Time Traffic Surveillance: A Robust Framework for Multi-vehicle Detection, Classification and Tracking , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[30]  Mahmood Fathy,et al.  Image Processing Techniques For Real-Time Qualitative Road Traffic Data Analysis , 1999, Real Time Imaging.

[31]  Kuo-Chin Fan,et al.  Real-time traffic parameter extraction using entropy , 2004 .

[32]  Stanley T. Birchfield,et al.  A Taxonomy and Analysis of Camera Calibration Methods for Traffic Monitoring Applications , 2010, IEEE Transactions on Intelligent Transportation Systems.

[33]  Daeho Lee,et al.  Measurement of traffic parameters in image sequence using spatio-temporal information , 2008 .