A background modeling and foreground segmentation approach based on the feedback of moving objects in traffic surveillance systems

Background modeling and foreground segmentation are the foundation of traffic surveillance systems. The preciseness of the background model and the accuracy of the foreground segmentation will directly affect the subsequent operations, such as object detection, target classification and behavior understanding. Additionally, the processing time is limited for real applications. The background modeling and foreground segmentation approaches, unfortunately, often have to make two tough trade-offs, including the one between the robustness to background changes and the sensitivity to foreground abnormalities and the other between suppressing noise and reducing the erroneous holes and splitting in foreground segmentation. To deal with these problems, an improved background modeling and foreground segmentation approach based on the feedback of the tracking results of moving objects is proposed. According to the achieved object tracking results, a frame image is divided into four kinds of regions, then a dual-layer background updating is done for these different regions with appropriate operations, which can significantly improve the quality of the background model. Based on the spatial relationship among the tracked objects, the predicted object blocks are merged into regions, among which adaptive segmentation thresholds are used for foreground segmentation. This adaptive threshold approach can efficiently avoid the erroneous holes and splitting in foreground segmentation. Our proposed approach is validated with several public data sets, which confirm its advantages over many existing approaches.

[1]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[2]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Jen-Hui Chuang,et al.  Regularized Background Adaptation: A Novel Learning Rate Control Scheme for Gaussian Mixture Modeling , 2011, IEEE Transactions on Image Processing.

[4]  Hao Zhou,et al.  Accurate Foreground Segmentation without Pre-learning , 2011, 2011 Sixth International Conference on Image and Graphics.

[5]  Nizar Bouguila,et al.  Finite Generalized Gaussian Mixture Modeling and Applications to Image and Video Foreground Segmentation , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[6]  Pankaj Kumar,et al.  Queue based fast background modelling and fast hysteresis thresholding for better foreground segmentation , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[7]  Terrance E. Boult,et al.  Frame-rate omnidirectional surveillance and tracking of camouflaged and occluded targets , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[8]  Yihua Tan,et al.  Accurate Dynamic Scene Model for Moving Object Detection , 2007, 2007 IEEE International Conference on Image Processing.

[9]  Rubén Heras Evangelio,et al.  Complementary background models for the detection of static and moving objects in crowded environments , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[10]  Rainer Stiefelhagen,et al.  Improving foreground segmentations with probabilistic superpixel Markov random fields , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Jan-Olof Eklundh,et al.  Statistical background subtraction for a mobile observer , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Max Lu,et al.  Robust and efficient foreground analysis for real-time video surveillance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Tao Xiang,et al.  Background Subtraction with Dirichlet Processes , 2012, ECCV.

[16]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Wen Gao,et al.  Nonparametric Background Generation , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[19]  Yuan Tian,et al.  Robust Foreground Segmentation Using Subspace Based Background Model , 2009, 2009 Asia-Pacific Conference on Information Processing.

[20]  S. Li,et al.  Learning semantic scene models by object classification and trajectory clustering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[22]  Changsheng Xu,et al.  Mining Semantic Context Information for Intelligent Video Surveillance of Traffic Scenes , 2013, IEEE Transactions on Industrial Informatics.