Background Modeling Through Spatiotemporal Edge Feature and Color

In this paper, we propose a new spatiotemporal edge feature for background modeling that can extract spatial and temporal (motion) features by considering the background model and current information. Previous work on background modeling considers mainly the spatial domain, which misses key temporal information. In our proposal, we create spatiotemporal edge features by using current and past background information by identifying the amount of change from past to present. By finding these differences, we can accurately detect the movement of objects that is more robust to noise and illumination variations. Moreover, our proposed background-modeling technique adapts to background changes that occur over time through a dynamic model update strategy. Additionally, we are enhancing the spatiotemporal edge features with color to maintain the characteristics of each other. Finally, we evaluated our proposed method on the publicly available CDNET 2012 dataset and compared with state-of-the-art methods. Our extensive evaluation and analysis show that our method outperforms previous methods on this dataset.

[1]  Guillaume-Alexandre Bilodeau,et al.  Improving background subtraction using Local Binary Similarity Patterns , 2014, IEEE Winter Conference on Applications of Computer Vision.

[2]  Byungyong Ryu,et al.  Simultaneous Foreground Detection and Classification with Hybrid Features , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Oksam Chae,et al.  Statistical Background Modeling: An Edge Segment Based Moving Object Detection Approach , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[4]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[8]  Guillaume-Alexandre Bilodeau,et al.  Change Detection in Feature Space Using Local Binary Similarity Patterns , 2013, 2013 International Conference on Computer and Robot Vision.

[9]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jaemyun Kim,et al.  Background Modeling Through Statistical Edge-Segment Distributions , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  David Suter,et al.  A consensus-based method for tracking: Modelling background scenario and foreground appearance , 2007, Pattern Recognit..

[12]  Jaemyun Kim,et al.  Background Subtraction Based on Fusion of Color and Local Patterns , 2018, ACCV.