High speed multi-layer background subtraction

Moving object detection is an important and fundamental step for intelligent video surveillance systems, since it provides a focus of attention for post-processing. In this study, a multi-layer codebook-based background subtraction model is proposed to cope with high resolution video sequences for the detection of moving objects. Combining the multi-layer block-based strategy and the feature extraction of blocks, the proposed method can remove most of the background, including non-stationary (dynamic) background, and significantly increase the processing efficiency. Moreover, pixel-based classification is adopted for refining the results of block-based background subtraction, which can further classify pixels as foreground, shadows, and highlights. The experimental results demonstrate that the proposed multi-layer codebook-based background subtraction method (for standard definition video sequences) can provide a high precision and efficient processing speed for moving objects detection. Moreover, extensive experiments have been conducted to compare with various former schemes, and the superiority of the proposed method shows that it can be a very effective candidate for real-time intelligent video surveillance applications.

[1]  Jwu-Sheng Hu,et al.  Robust Background Subtraction with Shadow and Highlight Removal for Indoor Surveillance , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Chih-Sheng Hsu,et al.  Hierarchical Method for Foreground Detection Using Codebook Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).