Automatic Traffic Surveillance System for Vision-Based Vehicle Recognition and Tracking

This paper proposes a real-time traffic surveillance system for the detection, recognition, and tracking of multiple vehicles in roadway images. Moving vehicles can be automatically separated from the image sequences by a moving object segmentation method. Since CCD surveillance cameras are typically mounted at some distance from roadways, occlusion is a common and vexing problem for traffic surveillance systems. The segmentation and recognition method uses the length, width, and roof size to classify vehicles as vans, utility vehicles, sedans, mini trucks, or large vehicles, even when occlusive vehicles are continuously merging from one frame to the next. The segmented objects can be recognized and counted in accordance with their varying features, via the proposed recognition and tracking methods. The system has undergone roadside tests in Hsinchu and Taipei, Taiwan. Experiments using complex road scenes under various weather conditions are discussed and demonstrate the robustness, accuracy, and responsiveness of the method.

[1]  Gianni Conte,et al.  Algorithms for Image Processing , 1999 .

[2]  Nikos Paragios,et al.  A MRF-based approach for real-time subway monitoring , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  N. Ranganathan,et al.  A high speed systolic architecture for labeling connected components in an image , 1995, IEEE Trans. Syst. Man Cybern..

[4]  Kwang-Yeob Lee,et al.  Wavelet-based vehicle tracking for automatic traffic surveillance , 2001, Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology. TENCON 2001 (Cat. No.01CH37239).

[5]  Xia Limin.  Vehicle shape recovery and recognition using generic models , 2002, Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527).

[6]  Ramakant Nevatia,et al.  A model-based vehicle segmentation method for tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Liu Jilin,et al.  New method of background update for video-based vehicle detection , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[10]  Gian Luca Foresti,et al.  Vehicle recognition and tracking from road image sequences , 1999 .

[11]  Liyuan Li,et al.  Integrating intensity and texture differences for robust change detection , 2002, IEEE Trans. Image Process..

[12]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  N. H. C. Yung,et al.  A novel method for resolving vehicle occlusion in a monocular traffic-image sequence , 2004, IEEE Transactions on Intelligent Transportation Systems.

[15]  Yo-Sung Ho,et al.  Content-based event retrieval using semantic scene interpretation for automated traffic surveillance , 2001, IEEE Trans. Intell. Transp. Syst..

[16]  Wei Wu,et al.  A method of vehicle classification using models and neural networks , 2001, IEEE VTS 53rd Vehicular Technology Conference, Spring 2001. Proceedings (Cat. No.01CH37202).

[17]  Bing-Fei Wu,et al.  The moving object segmentation approach to vehicle extraction , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[18]  Jim R. Parker,et al.  Algorithms for image processing and computer vision , 1996 .

[19]  J. Canny.  Finding Edges and Lines in Images , 1983 .

[20]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..