Automatic foreground extraction via joint CRF and online learning

A novel approach is proposed for automatic foreground extraction which aims to segment out all foreground objects from the background in the image. The segmentation problem is formulated as an iterative energy minimisation of the conditional random field (CRF), which can be efficiently optimised by graph-cuts. The energy minimisation is initialised and modulated by a soft location map predicted by a discriminative classifier which is learned on-the-fly from a set of segmented exemplar images. Iteratively minimising the CRF energy leads to optimal segmentation. Experimental results on the Pascal visual object classes (VOC) 2010 segmentation dataset, a widely acknowledged difficult dataset, show that the proposed approach outperforms the state-of-the-art techniques.

[1]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[4]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[6]  Amir Rosenfeld,et al.  Extracting foreground masks towards object recognition , 2011, 2011 International Conference on Computer Vision.

[7]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[8]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[9]  Vittorio Ferrari,et al.  Figure-ground segmentation by transferring window masks , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.