A Novel Foreground Segmentation Method Using Convolutional Neural Network

Background subtraction is a commonly used approach for foreground segmentation (moving object detection). Different methods have been proposed based on this background subtraction technique. However, the algorithms give the false alarm in case of complex scenarios such as dynamic background, camera motion, shadow, illumination variation, camouflage, etc. A foreground segmentation system using convolutional neural network framework is proposed in this paper to handle these complex scenarios. In this approach, the non-handcrafted features learned from the deep neural network are used for the detection of moving objects. These non-handcrafted features are robust and efficient compared to the handcrafted features. The presented method is learned using spatial and temporal information. Additionally, a new background model is proposed to estimate the temporal information. We train the model end-to-end using input images, background images, and optical flow images. For the training purpose, we have randomly selected few images and its ground truth images from CDnet 2014. The proposed method is evaluated with benchmark datasets, and it outperforms the state-of-the-art methods in terms of qualitative and quantitative analyzes. The proposed model is capable of real-time processing because of its network architecture. Hence the model can be used in real-surveillance applications.

[1]  Luís Corte-Real,et al.  BMOG: boosted Gaussian Mixture Model with controlled complexity for background subtraction , 2017, Pattern Analysis and Applications.

[2]  Zhiming Luo,et al.  Interactive deep learning method for segmenting moving objects , 2017, Pattern Recognit. Lett..

[3]  Guillaume-Alexandre Bilodeau,et al.  A Self-Adjusting Approach to Change Detection Based on Background Word Consensus , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[4]  Zezhi Chen,et al.  A self-adaptive Gaussian mixture model , 2014, Comput. Vis. Image Underst..

[5]  Trevor Darrell,et al.  Learning Features by Watching Objects Move , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Mario Ignacio Chacon Murguia,et al.  Auto-Adaptive Parallel SOM Architecture with a modular analysis for dynamic object segmentation in videos , 2016, Neurocomputing.

[7]  Wilfried Philips,et al.  EFIC: Edge Based Foreground Background Segmentation and Interior Classification for Dynamic Camera Viewpoints , 2015, ACIVS.

[8]  Fatih Murat Porikli,et al.  CDnet 2014: An Expanded Change Detection Benchmark Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Hasan Sajid,et al.  Background subtraction for static & moving camera , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[10]  K. C. Santosh,et al.  Feature Learning for Offline Handwritten Signature Verification Using Convolutional Neural Network , 2019, Int. J. Technol. Hum. Interact..

[11]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  Xiaobo Lu,et al.  WeSamBE: A Weight-Sample-Based Method for Background Subtraction , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[14]  Hanqing Lu,et al.  Learning sharable models for robust background subtraction , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[15]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[16]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[17]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[18]  G. Sreelekha,et al.  Sample-based integrated background subtraction and shadow detection , 2017, IPSJ Transactions on Computer Vision and Applications.

[19]  Kristen Grauman,et al.  FusionSeg: Learning to Combine Motion and Appearance for Fully Automatic Segmentation of Generic Objects in Videos , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Mario I. Chacon-Murguia,et al.  Auto-Adaptive Parallel SOM Architecture with a modular analysis for dynamic object segmentation in videos , 2016 .

[21]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Yuansheng Luo,et al.  Deep Background Modeling Using Fully Convolutional Network , 2018, IEEE Transactions on Intelligent Transportation Systems.

[23]  Fei-Yue Wang,et al.  $M^{4}CD$ : A Robust Change Detection Method for Intelligent Visual Surveillance , 2018, IEEE Access.

[24]  Gerhard Rigoll,et al.  A deep convolutional neural network for video sequence background subtraction , 2018, Pattern Recognit..

[25]  Mohan Ramasundaram,et al.  Moving object detection using vector image model , 2018, Optik.

[26]  Guillaume-Alexandre Bilodeau,et al.  Universal Background Subtraction Using Word Consensus Models , 2016, IEEE Transactions on Image Processing.

[27]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[28]  Massimo De Gregorio,et al.  WiSARDrp for Change Detection in Video Sequences , 2017, ESANN.

[29]  Marc Van Droogenbroeck,et al.  Deep background subtraction with scene-specific convolutional neural networks , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).