A multi-camera collaboration framework for real-time vehicle detection and license plate recognition on highways

With the proliferation of advanced computer vision techniques, machine vision-based Intelligent Transportation System (ITS) will be the next wave of technologies for better traffic management and monitoring. In this paper, we present a reconfigurable and collaborative multi-camera framework for vehicle detection and license plate recognition. The synchronization between multiple cameras enable us envision in providing real-time vehicle detection and license plate recognition for the best usage of system resources while bolstering for high vehicle detection rate and license plate recognition rate. In addition, we also describe our novel 7times24 hours vehicle detection methods for crunching continuous video stream while synchronizing with license plate recognition software. We evaluated our platform and detection algorithms on a busy highway and show that we can provide up to 98% of real-time vehicle detection rate and 96% of license plate recognition rate.

[1]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[2]  Kai She,et al.  Vehicle tracking using on-line fusion of color and shape features , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[3]  Irene Yu-Hua Gu,et al.  PCR-Based Multi-Object Tracking for Video Surveillance , 2006 .

[4]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  George Bebis,et al.  Overtaking Vehicle Detection Using Dynamic and Quasi-Static Background Modeling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[6]  Derek R. Magee,et al.  Tracking multiple vehicles using foreground, background and motion models , 2004, Image Vis. Comput..

[7]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[8]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[9]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[10]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[11]  Wayne A Sarasua,et al.  Real-Time Detection and Tracking of Vehicle Base Fronts for Measuring Traffic Counts and Speeds on Highways , 2007 .

[12]  Daniel J. Dailey,et al.  An algorithm to estimate mean traffic speed using uncalibrated cameras , 2000, IEEE Trans. Intell. Transp. Syst..

[13]  Katsushi Ikeuchi,et al.  VEHICLE TRACKING IN LOW-ANGLE AND FRONT-VIEW IMAGES BASED ON SPATIO-TEMPORAL MARKOV RANDOM FIELD MODEL , 2001 .

[14]  G. Bebis,et al.  On-road vehicle detection using optical sensors: a review , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[15]  W. Eric L. Grimson,et al.  Using adaptive tracking to classify and monitor activities in a site , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  Suchendra M. Bhandarkar,et al.  Fast and Robust Background Updating for Real-time Traffic Surveillance and Monitoring , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[17]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.

[18]  Larry S. Davis,et al.  W/sup 4/: Who? When? Where? What? A real time system for detecting and tracking people , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[19]  Daniel J. Dailey,et al.  The Use of Uncalibrated Roadside CCTV Cameras to Estimate Mean Traffic Speed , 2001 .

[20]  Volodymyr Turchenko,et al.  Smart license plate recognition system based on image processing using neural network , 2003, Second IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, 2003. Proceedings.

[21]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..