Segmentation of Motion Objects from Surveillance Video Sequences Using Temporal Differencing Combined with Multiple Correlation

Identifying moving objects from a video sequence is a fundamental and critical task in many computer vision applications. We develop an efficient adaptive segmentation algorithm for color video surveillance sequence in real time with non-stationary background; background is modeled using multiple correlation coefficient using pixel-level based approach. At runtime, segmentation is performed by checking color intensity values at corresponding pixels P(x,y) in three frames using temporal differencing (frame gap three). The segmentation starts from a seed in the form of 3×3 image blocks to avoid the noise. Usually, temporal differencing generates holes in motion objects. After subtraction, holes are filled using image fusion, which uses spatial clustering as criteria to link motion objects. The emphasis of this approach is on the robust detection of moving objects even under noise or environmental changes (indoor as well as outdoor).

[1]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[2]  W. Eric L. Grimson,et al.  Background Subtraction Using Markov Thresholds , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[3]  Hans-Hellmut Nagel,et al.  Tracking Persons in Monocular Image Sequences , 1999, Comput. Vis. Image Underst..

[4]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[5]  Nizar Bouguila,et al.  A Robust Video Foreground Segmentation by Using Generalized Gaussian Mixture Modeling , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[6]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Montse Pardàs,et al.  Segmentation and tracking of static and moving objects in video surveillance scenarios , 2008, 2008 15th IEEE International Conference on Image Processing.

[8]  Daniel Freedman,et al.  Illumination-invariant tracking via graph cuts , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[10]  Xingzhi Luo,et al.  A Multiscale Parametric Background Model for Stationary Foreground Object Detection , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[11]  László Havasi,et al.  Higher order symmetry for non-linear classification of human walk detection , 2006, Pattern Recognit. Lett..

[12]  Sei-Wang Chen,et al.  Pedestrian detection and tracking at crossroads , 2004, Pattern Recognit..

[13]  Sridha Sridharan,et al.  Adaptive Optical Flow for Person Tracking , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[14]  Nicolas Thome,et al.  A robust appearance model for tracking human motions , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..