High-accuracy background model for real-time video foreground object detection

Video foreground object detection faces the problems of moving backgrounds, illumination changes, chaotic motion in real word applications. This paper presents a hybrid pixel-based background (HPB) model, which is constructed by single stable record and multi-layer astable records after initial learning. This HPB model can be used for background subtraction to extract objects precisely in various complex scenes. Using the multi-layer astable records, we also propose a homogeneous background subtraction that can detect the foreground object with less memory load. Based on the benchmark videos, the experimental results show that single stable and 3-layer multi-layer astable records can be enough for background model construction and are updated quickly to overcome the background variation. The proposed approach can improve the average error rates of foreground object detection up to 86% when comparing with the latest works. Furthermore, our method can achieve real-time analysis for complex scenes on personal computers and embedded platforms.

[1]  Shao-Yi Chien,et al.  Efficient Content Analysis Engine for Visual Surveillance Network , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Sergio A. Velastin,et al.  Detection and classification of vehicles for urban traffic scenes , 2008 .

[3]  Jorge S. Marques,et al.  Performance evaluation of object detection algorithms for video surveillance , 2006, IEEE Transactions on Multimedia.

[4]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Kuo-Chin Fan,et al.  Carried Object Detection Using Ratio Histogram and its Application to Suspicious Event Analysis , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Chengcui Zhang,et al.  Learning-based spatio-temporal vehicle tracking and indexing for transportation multimedia database systems , 2003, IEEE Trans. Intell. Transp. Syst..

[7]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[8]  Ping-Kuo Weng,et al.  Improved moving object segmentation by multiresolution and variable thresholding , 2006 .

[9]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[10]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[12]  Peter H. N. de With,et al.  Automatic video-based human motion analyzer for consumer surveillance system , 2009, IEEE Transactions on Consumer Electronics.

[13]  Wei Zhang,et al.  Moving vehicles detection based on adaptive motion histogram , 2010, Digit. Signal Process..

[14]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[15]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Max Mignotte,et al.  Statistical background subtraction using spatial cues , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Du-Ming Tsai,et al.  Motion detection using Fourier image reconstruction , 2008, Pattern Recognit. Lett..

[18]  Luigi di Stefano,et al.  Background subtraction by non-parametric probabilistic clustering , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[19]  Wen Gao,et al.  Modeling Background and Segmenting Moving Objects from Compressed Video , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Jie Yang,et al.  Flexible background mixture models for foreground segmentation , 2006, Image Vis. Comput..

[21]  Jun-Wei Hsieh,et al.  Video-Based Human Movement Analysis and Its Application to Surveillance Systems , 2008, IEEE Transactions on Multimedia.

[22]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Chung-Cheng Chiu,et al.  A Robust Object Segmentation System Using a Probability-Based Background Extraction Algorithm , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[25]  Touradj Ebrahimi,et al.  Tracking video objects in cluttered background , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Jenq-Neng Hwang,et al.  Object-based video abstraction for video surveillance systems , 2002, IEEE Trans. Circuits Syst. Video Technol..

[27]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Tiziana D'Orazio,et al.  Moving object segmentation by background subtraction and temporal analysis , 2006, Image Vis. Comput..

[29]  David Suter,et al.  A consensus-based method for tracking: Modelling background scenario and foreground appearance , 2007, Pattern Recognit..

[30]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[31]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..