Local-to-global background modeling for moving object detection from non-static cameras

This paper investigates efficient and robust moving object detection from non-static cameras. To tackle the motion of background caused by moving cameras and to alleviate the interference of noises, we propose a local-to-global background model for moving object detection. Firstly, motion compensation based local location-specific background model is deployed to roughly detect the foreground regions in non-static cameras. More specifically, the local background model is built for each pixel and represented by a set of pixel values drawn from its location and neighborhoods. Each pixel can be classified as foreground or background pixel according to the compensated background model based on the fast optical flow. Secondly, we estimate the global background model by the rough superpixel-based background regions to further separate foregrounds from background accurately. In particular, we use the superpixel to generate the initial background regions based on the detection results generated by local background model to alleviate the noises. Then, a Gaussian Mixture Model (GMM) is estimated for the backgrounds on superpixel level to refine the foreground regions. Extensive experiments on newly created dataset, including 10 challenging video sequences recorded in PTZ cameras and hand-held cameras, suggest that our method outperforms other state-of-the-art methods in accuracy.

[1]  Li Li Lin,et al.  Moving Objects Detection Based on Gaussian Mixture Model and Saliency Map , 2011 .

[2]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[3]  Xiaofei Wang,et al.  Fast moving object detection with non-stationary background , 2012, Multimedia Tools and Applications.

[4]  Marko Rak,et al.  Deformable part models for object detection in medical images , 2014, Biomedical engineering online.

[5]  Shankar K. Parmar,et al.  Moving object detection with moving background using optic flow , 2014, International Conference on Recent Advances and Innovations in Engineering (ICRAIE-2014).

[6]  Daniel Cremers,et al.  High resolution motion layer decomposition using dual-space graph cuts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[8]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[9]  Wei Zhang,et al.  Motion Compensation Based Fast Moving Object Detection in Dynamic Background , 2015, CCCV.

[10]  Nanning Zheng,et al.  Video object segmentation by integrating trajectories from points and regions , 2014, Multimedia Tools and Applications.

[11]  Narendra Ahuja,et al.  An edge-preserving filtering framework for visibility restoration , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[12]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Christian Breiteneder,et al.  A Novel Trajectory Clustering Approach for Motion Segmentation , 2010, MMM.

[14]  Allen R. Hanson,et al.  Coherent Motion Segmentation in Moving Camera Videos Using Optical Flow Orientations , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Ruigang Yang,et al.  Spatial-Depth Super Resolution for Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Hong Zhang,et al.  COROLA: A Sequential Solution to Moving Object Detection Using Low-rank Approximation , 2015, Comput. Vis. Image Underst..

[18]  Jin Tang,et al.  Real-Time Grayscale-Thermal Tracking via Laplacian Sparse Representation , 2016, MMM.

[19]  Maoguo Gong,et al.  RBoost: Label Noise-Robust Boosting Algorithm Based on a Nonconvex Loss Function and the Numerically Stable Base Learners , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Chen Jingzhu.  Moving object detection based on improved Gaussian mixture background model , 2010 .

[21]  Shuicheng Yan,et al.  SOLD: Sub-optimal low-rank decomposition for efficient video segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Wen J. Li,et al.  Salient object detection based on regions , 2012, Multimedia Tools and Applications.

[24]  Oihana Otaegui,et al.  Adaptive Multicue Background Subtraction for Robust Vehicle Counting and Classification , 2012, IEEE Transactions on Intelligent Transportation Systems.

[25]  Li Zhang,et al.  Kernel sparse representation-based classifier ensemble for face recognition , 2013, Multimedia Tools and Applications.

[26]  Hailin Jin,et al.  Fast Edge-Preserving PatchMatch for Large Displacement Optical Flow , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Jitendra Malik,et al.  Object Segmentation by Long Term Analysis of Point Trajectories , 2010, ECCV.

[28]  Sylvain Paris,et al.  SimpleFlow: A Non‐iterative, Sublinear Optical Flow Algorithm , 2012, Comput. Graph. Forum.

[29]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[30]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Vittorio Ferrari,et al.  Fast Object Segmentation in Unconstrained Video , 2013, 2013 IEEE International Conference on Computer Vision.

[32]  Jenny Benois-Pineau,et al.  Segmentation-based multi-class semantic object detection , 2012, Multimedia Tools and Applications.

[33]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[34]  Marc Van Droogenbroeck,et al.  Background subtraction: Experiments and improvements for ViBe , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.