Variational Earth Mover's Distance for Image Segmentation

Image segmentation using similarity or dissimilarity measures between probability distributions has been of great research interest in recent years. It is shown that the cross-bin metrics such as EMD is superior to the bin-wise metrics. However, existing segmentation approaches involving EMD are limited to univariate distributions, or one-dimensional marginal distributions of multidimensional features. This paper presents a novel segmentation method based on the variational EMD (VEMD) model, which can exploit joint distributions of multidimensional features. This method formulates the segmentation problem as the minimization of the EMD-based functional, which measures the distance between the foreground (resp. background) distribution and the reference foreground (resp. background) distribution. Using the simplex method and theory of shape derivative, we minimize the functional and obtain the gradient descent flow. We use a Gaussian filtering level-set method to obtain the numerical solution, in which the level-set re-initialization and smoothness constraint commonly imposed by the contour length are not necessary. Experiments show that the proposed method outperforms the state-of-the-art segmentation methods in the presence of illumination changes and noise.

[1]  Qi Zhao,et al.  Differential Earth Mover's Distance with Its Applications to Visual Tracking , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[3]  Tao Zhang,et al.  Model-based segmentation of medical imagery by matching distributions , 2005, IEEE Transactions on Medical Imaging.

[4]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[5]  Olivier D. Faugeras,et al.  Shape gradients for histogram segmentation using active contours , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[7]  Rachid Deriche,et al.  A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape , 2007, International Journal of Computer Vision.

[8]  Ehud Rivlin,et al.  On Scene Segmentation and Histograms-Based Curve Evolution , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yogesh Rathi,et al.  Image Segmentation Using Active Contours Driven by the Bhattacharyya Gradient Flow , 2007, IEEE Transactions on Image Processing.

[10]  Julien Rabin,et al.  Geodesic Shape Retrieval via Optimal Mass Transport , 2010, ECCV.

[11]  Xavier Bresson,et al.  Local Histogram Based Segmentation Using the Wasserstein Distance , 2009, International Journal of Computer Vision.

[12]  Michael Werman,et al.  Fast and robust Earth Mover's Distances , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Haibin Ling,et al.  EMD-L1: An Efficient and Robust Algorithm for Comparing Histogram-Based Descriptors , 2006, ECCV.

[14]  Olivier D. Faugeras,et al.  Image Segmentation Using Active Contours: Calculus of Variations or Shape Gradients? , 2003, SIAM J. Appl. Math..

[15]  Robert T. Collins,et al.  CSDD Features: Center-Surround Distribution Distance for Feature Extraction and Matching , 2008, ECCV.

[16]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[17]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[18]  Tao Zhang,et al.  Model-Based Multi-Object Segmentation via Distribution Matching , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[19]  Peihua Li,et al.  Tensor-SIFT Based Earth Mover’s Distance for Contour Tracking , 2010, Journal of Mathematical Imaging and Vision.

[20]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[21]  Ido Leichter,et al.  Mean Shift Trackers with Cross-Bin Metrics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.