Base selection in estimating sparse foreground in video

We investigate effective means of building robust dictionaries for detecting the sparse foreground in videos with static background. This work is an extension to our existing solution [1] to foreground/background segmentation problem using the linear programming method [2] proposed to detect sparse errors in signals, which are created by a known dictionary. The dictionary building methods we study are established robust component analysis techniques in the literature (i.e. k-SVD [3] & robust-PCA [4]) as well as a heuristic (running median) inspired by the highly correlated nature of the static video background signal. We compare the effectiveness of the new methods with our original system as well as a baseline method, which is the commonly used single Gaussian model of the background pixels.

[1]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[3]  Thomas S. Huang,et al.  Robust estimation of foreground in surveillance videos by sparse error estimation , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[5]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[6]  Manuele Bicego,et al.  Integrated region- and pixel-based approach to background modelling , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[7]  Michael Harville,et al.  A Framework for High-Level Feedback to Adaptive, Per-Pixel, Mixture-of-Gaussian Background Models , 2002, ECCV.

[8]  Berna Erol,et al.  A Bayesian framework for Gaussian mixture background modeling , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[9]  Michael Elad,et al.  K-SVD : DESIGN OF DICTIONARIES FOR SPARSE REPRESENTATION , 2005 .

[10]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[11]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[12]  Nikos Paragios,et al.  Motion-based background subtraction using adaptive kernel density estimation , 2004, CVPR 2004.

[13]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[14]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.