Moving Object Refining in Traffic Monitoring Applications

Moving object segmentation is an important task in vision-based traffic monitoring applications. In traffic scenes, various outliers such as sudden illumination changes, moving cast shadows, camera jitter, etc., often cause serious errors in image analysis due to misclassiflcation of moving objects. An efficient moving object refining approach is thus expected. In this paper, we address the problem of moving object refining by processing the background subtraction results. In an analytical multi-stage procedure, we remove sudden illumination changes and local reflected regions employing photometric color invariants, remove moving cast shadows based on a single Gaussian shadow model, uniform-region classification, and spatial analysis, and further remove other types of outliers in a postprocessing stage of area filtering and area-to-perimeter test. Experimental results on actual video sequences representative of different traffic scenes and illuminations are presented. The results illustrate that our approach is efficient when handling widely different conditions that can occur.

[1]  Soraia Raupp Musse,et al.  Background Subtraction and Shadow Detection in Grayscale Video Sequences , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[2]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[3]  Fatih Murat Porikli,et al.  Shadow flow: a recursive method to learn moving cast shadows , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  M. Kilger,et al.  Video-based traffic monitoring , 1992 .

[5]  Alessandro Bevilacqua,et al.  Effective Shadow Detection in Traffic Monitoring Applications , 2003, WSCG.

[6]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[7]  Mohan M. Trivedi,et al.  Moving shadow and object detection in traffic scenes , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[9]  Bir Bhanu,et al.  Physical models for moving shadow and object detection in video , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Kai-Tai Song,et al.  Image-Based Traffic Monitoring With Shadow Suppression , 2007, Proceedings of the IEEE.

[11]  Nicolas Martel-Brisson,et al.  Learning and Removing Cast Shadows through a Multidistribution Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Oliver Schreer,et al.  Fast and robust shadow detection in videoconference applications , 2002, International Symposium on VIPromCom Video/Image Processing and Multimedia Communications.

[13]  M. Kilger,et al.  A shadow handler in a video-based real-time traffic monitoring system , 1992, [1992] Proceedings IEEE Workshop on Applications of Computer Vision.

[14]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[15]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[16]  Osama Masoud,et al.  Computer vision algorithms for intersection monitoring , 2003, IEEE Trans. Intell. Transp. Syst..

[17]  Fei-Yue Wang,et al.  An automated vehicle counting system for traffic surveillance , 2007, 2007 IEEE International Conference on Vehicular Electronics and Safety.

[18]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[20]  Shree K. Nayar,et al.  Reflectance based object recognition , 1996, International Journal of Computer Vision.

[21]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Kuntal Sengupta,et al.  Framework for real-time behavior interpretation from traffic video , 2005, IEEE Transactions on Intelligent Transportation Systems.

[23]  Osama Masoud,et al.  A collision prediction system for traffic intersections , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Sei-Wang Chen,et al.  Shadow detection and removal for traffic images , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[25]  Ramakant Nevatia,et al.  Tracking multiple humans in complex situations , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Yo-Sung Ho,et al.  Content-based event retrieval using semantic scene interpretation for automated traffic surveillance , 2001, IEEE Trans. Intell. Transp. Syst..

[27]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..