Texture Segmentation via Non-local Non-parametric Active Contours

This article introduces a novel active contour model that makes use of non-parametric estimators over patches for the segmentation of textured images. It is based on an energy that enforces the homogeneity of these statistics. This smoothness is measured using Wasserstein distances among discretized probability distributions that can handle features in arbitrary dimension. It is thus usable for the segmentation of color images or other high dimensional features. The Wasserstein distance is more robust than traditional pointwise statistical metrics (such as the Kullback-Leibler divergence) because it takes into account the relative distances between modes in the distributions. This makes the corresponding energy robust and does not require any smoothing of the statistical estimators. To speed-up the computational time, we propose an alternative metric that retains the main qualities of the Wasserstein distance, while being faster to compute. It aggregates 1-D Wasserstein distances over a set of directions, and thus benefits from the simplicity of 1-D statistical metrics while being able to discriminate high dimensional features. We show numerical results that instantiate this novel framework using grayscale and color values distributions. This allows us to segment regions with smoothly varying intensities or colors as well as complicated textures.

[1]  Xiaofeng Wang,et al.  An efficient local Chan-Vese model for image segmentation , 2010, Pattern Recognit..

[2]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[3]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[4]  Abderrahim Elmoataz,et al.  Nonlocal Discrete Regularization on Weighted Graphs: A Framework for Image and Manifold Processing , 2008, IEEE Transactions on Image Processing.

[5]  T. Chan NON-LOCAL UNSUPERVISED VARIATIONAL IMAGE SEGMENTATION MODELS , 2008 .

[6]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[7]  Laurent D. Cohen,et al.  Non-local active contours , 2012 .

[8]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Chunming Li,et al.  Active contours driven by local Gaussian distribution fitting energy , 2009, Signal Process..

[10]  Tony F. Chan,et al.  Active Contours without Edges for Vector-Valued Images , 2000, J. Vis. Commun. Image Represent..

[11]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[12]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[13]  Julien Rabin,et al.  Wasserstein Barycenter and Its Application to Texture Mixing , 2011, SSVM.

[14]  Mauro Dell'Amico,et al.  Assignment Problems , 1998, IFIP Congress: Fundamentals - Foundations of Computer Science.

[15]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[16]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[17]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[18]  Mauro Dell'Amico,et al.  8. Quadratic Assignment Problems: Algorithms , 2009 .

[19]  Matthieu Guillaumin,et al.  Combining Image-Level and Segment-Level Models for Automatic Annotation , 2012, MMM.

[20]  Laurent D. Cohen,et al.  Non-local segmentation and inpaiting , 2011, 2011 18th IEEE International Conference on Image Processing.

[21]  Chunming Li,et al.  Computerized Medical Imaging and Graphics Active Contours Driven by Local and Global Intensity Fitting Energy with Application to Brain Mr Image Segmentation , 2022 .

[22]  John W. Fisher,et al.  Submitted to Ieee Transactions on Image Processing a Nonparametric Statistical Method for Image Segmentation Using Information Theory and Curve Evolution , 2022 .

[23]  Laurent D. Cohen,et al.  Nonlocal Active Contours , 2012, SIAM J. Imaging Sci..

[24]  Rachid Deriche,et al.  Geodesic Active Regions: A New Framework to Deal with Frame Partition Problems in Computer Vision , 2002, J. Vis. Commun. Image Represent..

[25]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[26]  Michel Barlaud,et al.  Segmentation of Vectorial Image Features Using Shape Gradients and Information Measures , 2006, Journal of Mathematical Imaging and Vision.

[27]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Zheng Bao,et al.  Variational Color Image Segmentation via Chromaticity-Brightness Decomposition , 2010, MMM.

[29]  Xavier Bresson,et al.  Local Histogram Based Segmentation Using the Wasserstein Distance , 2009, International Journal of Computer Vision.