Local Histogram Based Segmentation Using the Wasserstein Distance

We propose and analyze a nonparametric region-based active contour model for segmenting cluttered scenes. The proposed model is unsupervised and assumes pixel intensity is independently identically distributed. Our proposed energy functional consists of a geometric regularization term that penalizes the length of the partition boundaries and a region-based image term that uses histograms of pixel intensity to distinguish different regions. More specifically, the region data encourages segmentation so that local histograms within each region are approximately homogeneous. An advantage of using local histograms in the data term is that histogram differentiation is not required to solve the energy minimization problem. We use Wasserstein distance with exponent 1 to determine the dissimilarity between two histograms. The Wasserstein distance is a metric and is able to faithfully measure the distance between two histograms, compared to many pointwise distances. Moreover, it is insensitive to oscillations, and therefore our model is robust to noise. A fast global minimization method based on (Chan et al. in SIAM J. Appl. Math. 66(5):1632–1648, 2006; Bresson et al. in J. Math. Imaging Vis. 28(2):151–167, 2007) is employed to solve the proposed model. The advantages of using this method are two-fold. First, the computational time is less than that of the method by gradient descent of the associated Euler-Lagrange equation (Chan et al. in Proc. of SSVM, pp. 697–708, 2007). Second, it is able to find a global minimizer. Finally, we propose a variant of our model that is able to properly segment a cluttered scene with local illumination changes.

[1]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[3]  Astrid Wang,et al.  Snakes Active contours models for boundary detection , 2003 .

[4]  Zhuowen Tu,et al.  Image Segmentation by Data-Driven Markov Chain Monte Carlo , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Michel Barlaud,et al.  Segmentation of Vectorial Image Features Using Shape Gradients and Information Measures , 2006, Journal of Mathematical Imaging and Vision.

[6]  A. Chambolle.  Practical, Unified, Motion and Missing Data Treatment in Degraded Video , 2004, Journal of Mathematical Imaging and Vision.

[7]  C. Villani.  Topics in Optimal Transportation , 2003 .

[8]  A. Tannenbaum,et al.  Distribution Metrics and Image Segmentation. , 2007, Linear algebra and its applications.

[9]  Guillermo Sapiro,et al.  Shape preserving local histogram modification , 1999, IEEE Trans. Image Process..

[10]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[11]  D CohenLaurent.  On active contour models and balloons , 1991 .

[12]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[14]  G. Sapiro,et al.  Histogram Modification via Differential Equations , 1997 .

[15]  Mila Nikolova,et al.  Algorithms for Finding Global Minimizers of Image Segmentation and Denoising Models , 2006, SIAM J. Appl. Math..

[16]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[17]  Tony F. Chan,et al.  Structure-Texture Image Decomposition—Modeling, Algorithms, and Parameter Selection , 2006, International Journal of Computer Vision.

[18]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[19]  Robert E. Broadhurst.  Statistical Estimation of Histogram Variation for Texture Classification , 2005 .

[20]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[21]  R. Chartrand,et al.  A Gradient Descent Solution to the Monge-Kantorovich Problem , 2009 .

[22]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[23]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[24]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[25]  Benoit Mory,et al.  Fuzzy Region Competition: A Convex Two-Phase Segmentation Framework , 2007, SSVM.

[26]  Anthony J. Yezzi,et al.  A statistical approach to snakes for bimodal and trimodal imagery , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[27]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[28]  Rachid Deriche,et al.  Geodesic Active Regions: A New Framework to Deal with Frame Partition Problems in Computer Vision , 2002, J. Vis. Commun. Image Represent..

[29]  P. Olver,et al.  Conformal curvature flows: From phase transitions to active vision , 1996, ICCV 1995.

[30]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[31]  Tianzi Jiang,et al.  Local Region Based Medical Image Segmentation Using J-Divergence Measures , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[32]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[33]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[34]  L. Kantorovich.  On the Translocation of Masses , 2006 .

[35]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[36]  Luminita A. Vese,et al.  Energy Minimization Based Segmentation and Denoising Using a Multilayer Level Set Approach , 2005, EMMCVPR.

[37]  Yogesh Rathi,et al.  Image Segmentation Using Active Contours Driven by the Bhattacharyya Gradient Flow , 2007, IEEE Transactions on Image Processing.

[38]  Tony F. Chan,et al.  Histogram Based Segmentation Using Wasserstein Distances , 2007, SSVM.

[39]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[40]  S. Rachev,et al.  Mass transportation problems , 1998 .

[41]  Mtw,et al.  Mass Transportation Problems: Vol. I: Theory@@@Mass Transportation Problems: Vol. II: Applications , 1999 .

[42]  John W. Fisher,et al.  Submitted to Ieee Transactions on Image Processing a Nonparametric Statistical Method for Image Segmentation Using Information Theory and Curve Evolution , 2022 .

[43]  Olivier D. Faugeras,et al.  Image Segmentation Using Active Contours: Calculus of Variations or Shape Gradients? , 2003, SIAM J. Appl. Math..

[44]  Michel Barlaud,et al.  Shape gradient for image segmentation using information theory , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.