Multimarginal Optimal Transport by Accelerated Gradient Descent

We consider a multimarginal optimal transport, which includes as a particular case the Wasserstein barycenter problem. In this problem one has to find an optimal coupling between m probability measures, which amounts to finding a tensor of the order m. We propose an accelerated method based on accelerated alternating minimization and estimate its complexity to find the approximate solution to the problem. We use entropic regularization with sufficiently small regularization parameter and apply accelerated alternating minimization to the dual problem. A novel primal-dual analysis is used to reconstruct the approximately optimal coupling tensor. Our algorithm exhibits a better computational complexity than the state-of-the-art methods for some regimes of the problem parameters.

[1]  R. Parr Density-functional theory of atoms and molecules , 1989 .

[2]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[3]  Andrew R. Teel,et al.  ESAIM: Control, Optimisation and Calculus of Variations , 2022 .

[4]  I. Ekeland An optimal matching problem , 2003, math/0308206.

[5]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[6]  Marco Cuturi,et al.  Sinkhorn Distances: Lightspeed Computation of Optimal Transport , 2013, NIPS.

[7]  L. Ambrosio,et al.  A User’s Guide to Optimal Transport , 2013 .

[8]  R. McCann,et al.  A glimpse into the difierential topology and geometry of optimal transport , 2012, 1207.1867.

[9]  Brendan Pass Multi-marginal optimal transport: theory and applications , 2014, 1406.0026.

[10]  Yin Tat Lee,et al.  Path Finding Methods for Linear Programming: Solving Linear Programs in Õ(vrank) Iterations and Faster Algorithms for Maximum Flow , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[11]  Gabriel Peyré,et al.  Iterative Bregman Projections for Regularized Transportation Problems , 2014, SIAM J. Sci. Comput..

[12]  Gabriel Peyré,et al.  Fast Optimal Transport Averaging of Neuroimaging Data , 2015, IPMI.

[13]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[14]  Jason Altschuler,et al.  Near-linear time approximation algorithms for optimal transport via Sinkhorn iteration , 2017, NIPS.

[15]  Tryphon T. Georgiou,et al.  Optimal Transport Over a Linear Dynamical System , 2015, IEEE Transactions on Automatic Control.

[16]  G. Carlier,et al.  Tomographic Reconstruction from a Few Views: A Multi-Marginal Optimal Transport Approach , 2017 .

[17]  Alexander Gasnikov,et al.  Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithm , 2018, ICML.

[18]  Tingran Gao,et al.  Curvature of Hypergraphs via Multi-Marginal Optimal Transport , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[19]  Johan Karlsson,et al.  Multi-Marginal Optimal Mass Transport with Partial Information , 2019, 1905.03847.

[20]  Michael I. Jordan,et al.  On the Complexity of Approximating Multimarginal Optimal Transport , 2019, J. Mach. Learn. Res..

[21]  Darina Dvinskikh,et al.  On the Complexity of Approximating Wasserstein Barycenters , 2019, ICML.

[22]  S. Guminov,et al.  Accelerated Alternating Minimization, Accelerated Sinkhorn's Algorithm and Accelerated Iterative Bregman Projections. , 2019 .

[23]  Mingkui Tan,et al.  Multi-marginal Wasserstein GAN , 2019, NeurIPS.

[24]  Michael I. Jordan,et al.  On Efficient Optimal Transport: An Analysis of Greedy and Accelerated Mirror Descent Algorithms , 2019, ICML.