Regularized Discrete Optimal Transport

This article introduces a generalization of discrete Optimal Transport that includes a regularity penalty and a relaxation of the bijectivity constraint. The corresponding transport plan is solved by minimizing an energy which is a convexification of an integer optimization problem. We propose to use a proximal splitting scheme to perform the minimization on large scale imaging problems. For un-regularized relaxed transport, we show that the relaxation is tight and that the transport plan is an assignment. In the general case, the regularization prevents the solution from being an assignment, but we show that the corresponding map can be used to solve imaging problems. We show an illustrative application of this discrete regularized transport to color transfer between images. This imaging problem cannot be solved in a satisfying manner without relaxing the bijective assignment constraint because of mass variation across image color palettes. Furthermore, the regularization of the transport plan helps remove colorization artifacts due to noise amplification.

[1]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[2]  Francis R. Bach,et al.  Many-to-Many Graph Matching: a Continuous Relaxation Approach , 2010, ECML/PKDD.

[3]  Julien Rabin,et al.  Wasserstein Barycenter and Its Application to Texture Mixing , 2011, SSVM.

[4]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[5]  Guillaume Carlier,et al.  Barycenters in the Wasserstein Space , 2011, SIAM J. Math. Anal..

[6]  Nicolas Papadakis,et al.  A Variational Model for Histogram Transfer of Color Images , 2011, IEEE Transactions on Image Processing.

[7]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[8]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[9]  Julie Delon,et al.  Movie and video scale-time equalization application to flicker reduction , 2006, IEEE Transactions on Image Processing.

[10]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[11]  Christoph Schnörr,et al.  Evaluation of a convex relaxation to a quadratic assignment matching approach for relational object views , 2007, Image Vis. Comput..

[12]  Julie Delon Midway Image Equalization , 2004, Journal of Mathematical Imaging and Vision.

[13]  M. Zaslavskiy,et al.  A Path Following Algorithm for the Graph Matching Problem , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  D. Bertsekas The auction algorithm: A distributed relaxation method for the assignment problem , 1988 .

[15]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[16]  W. Gangbo,et al.  Optimal maps for the multidimensional Monge-Kantorovich problem , 1998 .

[17]  Julien Rabin,et al.  Wasserstein regularization of imaging problem , 2011, 2011 18th IEEE International Conference on Image Processing.

[18]  David S. Doermann,et al.  Robust point matching for nonrigid shapes by preserving local neighborhood structures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[20]  Benno Heigl,et al.  Color Normalization and Object Localization , 1998 .

[21]  Edoardo Provenzi,et al.  A Perceptually Inspired Variational Framework for Color Enhancement , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jean Louet,et al.  A sharp inequality for transport maps in W1, p(R) via approximation , 2011, Appl. Math. Lett..

[23]  R. McCann A Convexity Principle for Interacting Gases , 1997 .

[24]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[25]  Nesa L'abbe Wu,et al.  Linear programming and extensions , 1981 .

[26]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[27]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[28]  C. Villani Topics in Optimal Transportation , 2003 .

[29]  W. F. Clocksin,et al.  Multidimensional Histogram Equalization and Modification , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[30]  Ján Morovic,et al.  Accurate 3D image colour histogram transformation , 2003, Pattern Recognit. Lett..

[31]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[32]  Michael Werman,et al.  Fast and robust Earth Mover's Distances , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[33]  M. V. D. Panne,et al.  Displacement Interpolation Using Lagrangian Mass Transport , 2011 .

[34]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[35]  Salih O. Duffuaa,et al.  A Linear Programming Approach for the Weighted Graph Matching Problem , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Abderrahim Elmoataz,et al.  Nonlocal Discrete Regularization on Weighted Graphs: A Framework for Image and Manifold Processing , 2008, IEEE Transactions on Image Processing.

[37]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Gui-Song Xia,et al.  Static and Dynamic Texture Mixing Using Optimal Transport , 2013, SSVM.

[39]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[40]  Gabriel Peyré,et al.  Regularized Discrete Optimal Transport , 2014, SIAM J. Imaging Sci..

[41]  Yann Brenier,et al.  A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem , 2000, Numerische Mathematik.

[42]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[43]  Yao-Hsien Huang,et al.  A Novel Color Transfer Algorithm for Image Sequences , 2004, J. Inf. Sci. Eng..

[44]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[45]  L. Kantorovich On the Translocation of Masses , 2006 .