A Hierarchical Model Incorporating Segmented Regions and Pixel Descriptors for Video Background Subtraction

Background subtraction is important for detecting moving objects in videos. Currently, there are many approaches to performing background subtraction. However, they usually neglect the fact that the background images consist of different objects whose conditions may change frequently. In this paper, a novel hierarchical background model is proposed based on segmented background images. It first segments the background images into several regions by the mean-shift algorithm. Then, a hierarchical model, which consists of the region models and pixel models, is created. The region model is a kind of approximate Gaussian mixture model extracted from the histogram of a specific region. The pixel model is based on the cooccurrence of image variations described by histograms of oriented gradients of pixels in each region. Benefiting from the background segmentation, the region models and pixel models corresponding to different regions can be set to different parameters. The pixel descriptors are calculated only from neighboring pixels belonging to the same object. The experimental results are carried out with a video database to demonstrate the effectiveness, which is applied to both static and dynamic scenes by comparing it with some well-known background subtraction methods.

[1]  Ho Gi Jung,et al.  Mixture of Gaussians-Based Background Subtraction for Bayer-Pattern Image Sequences , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Massimo Piccardi,et al.  Mean-shift background image modelling , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[3]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Guillaume-Alexandre Bilodeau,et al.  An Efficient Region-Based Background Subtraction Technique , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[6]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[7]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Hongxun Yao,et al.  Multl-resolution background subtraction for dynamic scenes , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[9]  Du-Ming Tsai,et al.  Mean Shift-Based Defect Detection in Multicrystalline Solar Wafer Surfaces , 2011, IEEE Transactions on Industrial Informatics.

[10]  Dorin Comaniciu,et al.  Robust analysis of feature spaces: color image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[12]  Cláudio Rosito Jung,et al.  Efficient Background Subtraction and Shadow Removal for Monochromatic Video Sequences , 2009, IEEE Transactions on Multimedia.

[13]  Venkatesh Saligrama,et al.  Foreground-Adaptive Background Subtraction , 2009, IEEE Signal Processing Letters.

[14]  Ahmed M. Elgammal,et al.  A Framework for Feature Selection for Background Subtraction , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Liyanage C. De Silva,et al.  Multimodal Approach to Human-Face Detection and Tracking , 2008, IEEE Transactions on Industrial Electronics.

[16]  Kazuhiko Sumi,et al.  Background subtraction based on cooccurrence of image variations , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[17]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[19]  Brian S. R. Armstrong,et al.  Soft Synchronization: Synchronization for Network-Connected Machine Vision Systems , 2007, IEEE Transactions on Industrial Informatics.

[20]  Yongtian Wang,et al.  An integrated background model for video surveillance based on primal sketch and 3D scene geometry , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[22]  José María Martínez Sanchez,et al.  Comparative Evaluation of Stationary Foreground Object Detection Algorithms Based on Background Subtraction Techniques , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[23]  Bing-Fei Wu,et al.  A Real-Time Vision System for Nighttime Vehicle Detection and Traffic Surveillance , 2011, IEEE Transactions on Industrial Electronics.

[24]  James W. Davis,et al.  Background-Subtraction in Thermal Imagery Using Contour Saliency , 2007, International Journal of Computer Vision.

[25]  Olivier Bernier,et al.  Real Time Illumination Invariant Background Subtraction Using Local Kernel Histograms , 2006, BMVC.

[26]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).