Segmentation and tracking of static and moving objects in video surveillance scenarios

In this paper we present a real-time object tracking system for monocular video sequences with static camera. The workflow is based on a pixel-based foreground detection system followed by foreground object tracking. The foreground detection method performs the segmentation in three levels: Moving Foreground, Static Foreground and Background level. The tracking uses the foreground segmentation for identifying the tracked objects, but minimizes the reliance on the foreground segmentation, using a modified Mean Shift tracking algorithm. Combining this tracking system with the Multi-Level foreground segmentation, we have improved the tracking results using the classification in static or moving objects. The system solves successfully a high percentage of the moving objects occlusions, and most of the occlusions between static and moving objects.

[1]  Montse Pardàs,et al.  Shadow removal with blob-based morphological reconstruction for error correction , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  Fatih Porikli,et al.  Human Body Tracking by Adaptive Background Models and Mean-Shift Analysis , 2003 .

[3]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[4]  Jacques Verly,et al.  The State of the Art in Multiple Object Tracking Under Occlusion in Video Sequences , 2003 .

[5]  Carlos Orrite-Uruñuela,et al.  Detected motion classification with a double-background and a Neighborhood-based difference , 2003, Pattern Recognit. Lett..

[6]  Vassilios Morellas,et al.  Robust Foreground Detection In Video Using Pixel Layers , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[8]  Vassilios Morellas,et al.  A Pixel Layering Framework For Robust Foreground Detection In Video , 2006 .

[9]  Sridha Sridharan,et al.  Abandoned object detection using multi-layer motion detection , 2008 .

[10]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[11]  Hai Tao,et al.  Object Tracking with Bayesian Estimation of Dynamic Layer Representations , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Trista Pei-chun Chen,et al.  Computer Vision Workload Analysis: Case Study of Video Surveillance Systems , 2005 .

[13]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).