Semi-Supervised Background Subtraction Of Unseen Videos: Minimization Of The Total Variation Of Graph Signals

Recently, several successful methods based on deep neural networks have been proposed for background subtraction. These deep neural algorithms have almost perfect performance, relying in the availability of ground-truth frames of the tested videos during the training step. However, the performance of some of these algorithms drops significantly when tested on unseen videos. In this paper, concepts of semi-supervised learning are introduced in the problem of background subtraction for unseen videos. We propose a new algorithm named Graph-BGS-TV, this method uses: Mask R-CNN for instances segmentation; temporal median filter for background initialization; motion, texture, and intensity features for representing the nodes of a graph; k-nearest neighbors for the construction of the graph; and finally a total variation minimization algorithm to solve the problem of background subtraction. GraphBGS-TV is tested in the change detection dataset, outperforming unsupervised and supervised methods in the challenges “PTZ” and “shadows”.

[1]  Soon Ki Jung,et al.  Deep Neural Network Concepts for Background Subtraction: A Systematic Review and Comparative Evaluation , 2018, Neural Networks.

[2]  Sang-Ha Lee,et al.  WisenetMD: Motion Detection Using Dynamic Background Region Analysis , 2018, Symmetry.

[3]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[4]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[5]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Kunfeng Wang,et al.  A novel background subtraction algorithm based on parallel vision and Bayesian GANs , 2020, Neurocomputing.

[7]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[9]  Isaac Z. Pesenson,et al.  Variational Splines and Paley–Wiener Spaces on Combinatorial Graphs , 2009, ArXiv.

[10]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Fatih Murat Porikli,et al.  CDnet 2014: An Expanded Change Detection Benchmark Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[13]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[14]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[15]  Prakash Ishwar,et al.  BSUV-Net: A Fully-Convolutional Neural Network for Background Subtraction of Unseen Videos , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[16]  Guillaume-Alexandre Bilodeau,et al.  A Self-Adjusting Approach to Change Detection Based on Background Word Consensus , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[17]  Long Ang Lim,et al.  Learning multi-scale features for foreground segmentation , 2018, Pattern Analysis and Applications.

[18]  Pierre Vandergheynst,et al.  UNLocBoX A matlab convex optimization toolbox using proximal splitting methods , 2014, ArXiv.

[19]  Pierre Vandergheynst,et al.  GSPBOX: A toolbox for signal processing on graphs , 2014, ArXiv.

[20]  Jhony H. Giraldo,et al.  GraphBGS: Background Subtraction via Recovery of Graph Signals , 2020, ArXiv.

[21]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[22]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[23]  Marc Van Droogenbroeck,et al.  Semantic background subtraction , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[24]  Yonina C. Eldar,et al.  Semi-Supervised Learning in Network-Structured Data via Total Variation Minimization , 2019, IEEE Transactions on Signal Processing.