Inverse Optimal Transport

Discrete optimal transportation problems arise in various contexts in engineering, the sciences and the social sciences. Often the underlying cost criterion is unknown, or only partly known, and the observed optimal solutions are corrupted by noise. In this paper we propose a systematic approach to infer unknown costs from noisy observations of optimal transportation plans. The algorithm requires only the ability to solve the forward optimal transport problem, which is a linear program, and to generate random numbers. It has a Bayesian interpretation, and may also be viewed as a form of stochastic optimization. We illustrate the developed methodologies using the example of international migration flows. Reported migration flow data captures (noisily) the number of individuals moving from one country to another in a given period of time. It can be interpreted as a noisy observation of an optimal transportation map, with costs related to the geographical position of countries. We use a graph-based formulation of the problem, with countries at the nodes of graphs and non-zero weighted adjacencies only on edges between countries which share a border. We use the proposed algorithm to estimate the weights, which represent cost of transition, and to quantify uncertainty in these weights.

[1]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[2]  Optimal Scaling of Random-Walk Metropolis Algorithms on General Target Distributions , 2019 .

[3]  Ravindra K. Ahuja,et al.  Inverse Optimization , 2001, Oper. Res..

[4]  Juan M. Morales,et al.  Short-Term Forecasting of Price-Responsive Loads Using Inverse Optimization , 2016, IEEE Transactions on Smart Grid.

[5]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[6]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[7]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[8]  G. Abel,et al.  Quantifying Global International Migration Flows , 2014, Science.

[9]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[10]  Jianzhon Zhang,et al.  Calculating some inverse linear programming problems , 1996 .

[11]  A. Gelman,et al.  Weak convergence and optimal scaling of random walk Metropolis algorithms , 1997 .

[12]  E. Somersalo,et al.  Statistical and computational inverse problems , 2004 .

[13]  Adrian E. Raftery,et al.  Estimation of emigration, return migration, and transit migration between all pairs of countries , 2018, Proceedings of the National Academy of Sciences.

[14]  Bernhard Schmitzer,et al.  Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problems , 2016, SIAM J. Sci. Comput..

[15]  J. de Beer,et al.  Overcoming the Problems of Inconsistent International Migration data: A New Method Applied to Flows in Europe , 2010, European journal of population = Revue europeenne de demographie.

[16]  J. Rosenthal,et al.  Optimal Scaling of Metropolis Algorithms on General Target Distributions , 2019 .

[17]  A. Galichon,et al.  Cupid’s Invisible Hand: Social Surplus and Identification in Matching Models , 2015, 2106.02371.

[18]  James Raymer,et al.  Putting the Pieces of the Puzzle Together: Age and Sex-Specific Estimates of Migration amongst Countries in the EU/EFTA, 2002–2007 , 2011 .

[19]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[20]  C. Villani Topics in Optimal Transportation , 2003 .

[21]  J. Rosenthal,et al.  Optimal scaling for various Metropolis-Hastings algorithms , 2001 .

[22]  Sebastian Reich,et al.  Data assimilation: The Schrödinger perspective , 2018, Acta Numerica.

[23]  Jakub Bijak,et al.  Integrated Modeling of European Migration , 2013 .

[24]  F. Santambrogio Optimal Transport for Applied Mathematicians: Calculus of Variations, PDEs, and Modeling , 2015 .

[25]  Marco Cuturi,et al.  Sinkhorn Distances: Lightspeed Computation of Optimal Transport , 2013, NIPS.

[26]  Gabriel Peyré,et al.  Computational Optimal Transport , 2018, Found. Trends Mach. Learn..

[27]  George B. Dantzig,et al.  Linear programming and extensions , 1965 .

[28]  Stephan Dempe,et al.  Inverse Linear Programming , 2006 .

[29]  M. V. D. Panne,et al.  Displacement Interpolation Using Lagrangian Mass Transport , 2011 .