Traffic flow estimation and vehicle-type classification using vision-based spatial-temporal profile analysis

Vision-based traffic surveillance plays an important role in traffic management. However, outdoor illuminations, the cast shadows and vehicle variations often create problems for video analysis and processing. Thus, the authors propose a real-time cost-effective traffic monitoring system that can reliably perform traffic flow estimation and vehicle classification at the same time. First, the foreground is extracted using a pixel-wise weighting list that models the dynamic background. Shadows are discriminated utilising colour and edge invariants. Second, the foreground on a specified check-line is then collected over time to form a spatial-temporal profile image. Third, the traffic flow is estimated by counting the number of connected components in the profile image. Finally, the vehicle type is classified according to the size of the foreground mask region. In addition, several traffic measures, including traffic velocity, flow, occupancy and density, are estimated based on the analysis of the segmentation. The availability and reliability of these traffic measures provides critical information for public transportation monitoring and intelligent traffic control. Since the proposed method only process a small area close to the check-line to collect the spatial-temporal profile for analysis, the complete system is much more efficient than existing visual traffic flow estimation methods.

[1]  N. H. C. Yung,et al.  Towards detection of moving cast shadows for visual traffic surveillance , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[2]  Mohan M. Trivedi,et al.  Moving shadow and object detection in traffic scenes , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Jean-Jacques E. Slotine,et al.  FastWavelet-Based Visual Classification , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[5]  Raanan Yehezkel,et al.  Multiclass object classification for real-time video surveillance systems , 2011, Pattern Recognit. Lett..

[6]  Wen-Chung Kao,et al.  An enhanced segmentation on vision-based shadow removal for vehicle detection , 2010, The 2010 International Conference on Green Circuits and Systems.

[7]  Kai-Tai Song,et al.  Background segmentation and its application to traffic monitoring using modified histogram , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[8]  Ali Javed,et al.  Comparative Analysis of Automatic Vehicle Classification Techniques: A Survey , 2012 .

[9]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[10]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[11]  Cláudio Rosito Jung,et al.  Efficient Background Subtraction and Shadow Removal for Monochromatic Video Sequences , 2009, IEEE Transactions on Multimedia.

[12]  N. H. C. Yung,et al.  A Method for Vehicle Count in the Presence of Multiple-Vehicle Occlusions in Traffic Images , 2007, IEEE Transactions on Intelligent Transportation Systems.

[13]  Nijad Al-Najdawi,et al.  A survey of cast shadow detection algorithms , 2012, Pattern Recognit. Lett..

[14]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Wen-Kai Tai,et al.  Moving cast shadow detection by exploiting multiple cues , 2008 .

[17]  Sei-Wang Chen,et al.  Shadow detection and removal for traffic images , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[18]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Y.-P. Guan,et al.  Spatio-temporal motion-based foreground segmentation and shadow suppression , 2010 .

[20]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[21]  K. Kiratiratanapruk,et al.  Vehicle Detection and Tracking for Traffic Monitoring System , 2006, TENCON 2006 - 2006 IEEE Region 10 Conference.

[22]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[23]  M. Ruhe,et al.  LUMOS - airborne traffic monitoring system , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[24]  Mohan M. Trivedi,et al.  Robust classification and tracking of vehicles in traffic video streams , 2006, 2006 IEEE Intelligent Transportation Systems Conference.