Consensus-Based Distributed Discrete Optimal Transport for Decentralized Resource Matching

Optimal transport has been extensively used in resource matching to promote the efficiency of resource usages by matching sources to targets. However, it requires a significant amount of computations and storage spaces for large-scale problems. In this paper, we take a consensus-based approach to decentralize discrete optimal transport problems and develop fully distributed algorithms with alternating direction method of multipliers. We show that our algorithms guarantee certain levels of efficiency and privacy besides the distributed nature. We further derive primal and dual algorithms by exploring the primal and dual problems of discrete optimal transport with linear utility functions and prove the equivalence between them. We verify the convergence, online adaptability, and the equivalence between the primal algorithm and the dual algorithm with numerical experiments. Our algorithms reflect the bargaining between sources and targets on the amounts and prices of transferred resources and reveal an averaging principle which can be used to regulate resource markets and improve resource efficiency.

[1]  Gabriel Peyré,et al.  Computational Optimal Transport , 2018, Found. Trends Mach. Learn..

[2]  Quanyan Zhu,et al.  A Game-Theoretic Approach to Design Secure and Resilient Distributed Support Vector Machines , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[3]  A. Galichon,et al.  Optimal Transport Methods in Economics , 2016 .

[4]  Nikos D. Sidiropoulos,et al.  Consensus-ADMM for General Quadratically Constrained Quadratic Programming , 2016, IEEE Transactions on Signal Processing.

[5]  Björn Geißler,et al.  Solving power-constrained gas transportation problems using an MIP-based alternating direction method , 2015, Comput. Chem. Eng..

[6]  Jean-David Benamou,et al.  Augmented Lagrangian Methods for Transport Optimization, Mean Field Games and Degenerate Elliptic Equations , 2015, J. Optim. Theory Appl..

[7]  Ekram Hossain,et al.  Distributed Resource Allocation for Relay-Aided Device-to-Device Communication Under Channel Uncertainties: A Stable Matching Approach , 2015, IEEE Transactions on Communications.

[8]  Walid Saad,et al.  Matching theory for future wireless networks: fundamentals and applications , 2014, IEEE Communications Magazine.

[9]  Xiangfeng Wang,et al.  Multi-Agent Distributed Optimization via Inexact Consensus ADMM , 2014, IEEE Transactions on Signal Processing.

[10]  Shanlin Yang,et al.  QoS-aware resource matching and recommendation for cloud computing systems , 2014, Appl. Math. Comput..

[11]  Fernando Diaz,et al.  Emergency-relief coordination on social media: Automatically matching resource requests and offers , 2013, First Monday.

[12]  Gabriel Peyré,et al.  Optimal Transport with Proximal Splitting , 2013, SIAM J. Imaging Sci..

[13]  Marco Cuturi,et al.  Sinkhorn Distances: Lightspeed Computation of Optimal Transport , 2013, NIPS.

[14]  Christos G. Cassandras,et al.  New “Smart Parking” System Based on Resource Allocation and Reservations , 2013, IEEE Transactions on Intelligent Transportation Systems.

[15]  Karl Aberer,et al.  Matching demand with supply in the smart grid using agent-based multiunit auction , 2013, 2013 Fifth International Conference on Communication Systems and Networks (COMSNETS).

[16]  Asuman E. Ozdaglar,et al.  Distributed Alternating Direction Method of Multipliers , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[17]  Chong-Yung Chi,et al.  Distributed Robust Multicell Coordinated Beamforming With Imperfect CSI: An ADMM Approach , 2011, IEEE Transactions on Signal Processing.

[18]  Wolfgang Heidrich,et al.  Displacement interpolation using Lagrangian mass transport , 2011, ACM Trans. Graph..

[19]  Bert Huang,et al.  Fast b-matching via Sufficient Selection Belief Propagation , 2011, AISTATS.

[20]  Nikhil R. Devanur,et al.  Near optimal online algorithms and fast approximation algorithms for resource allocation problems , 2011, EC '11.

[21]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[22]  Emiliano Dall'Anese,et al.  Fast clock synchronization in wireless sensor networks via ADMM-based consensus , 2011, 2011 International Symposium of Modeling and Optimization of Mobile, Ad Hoc, and Wireless Networks.

[23]  Vincent W. S. Wong,et al.  Optimal Real-Time Pricing Algorithm Based on Utility Maximization for Smart Grid , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[24]  Stephen P. Boyd,et al.  Fast Algorithms for Resource Allocation in Wireless Cellular Networks , 2010, IEEE/ACM Transactions on Networking.

[25]  Georgios B. Giannakis,et al.  Consensus-Based Distributed Support Vector Machines , 2010, J. Mach. Learn. Res..

[26]  A Rigorous Analysis Using Optimal Transport Theory for a Two-reflector Design Problem with a Point Source , 2009, 0908.2464.

[27]  Leonidas J. Guibas,et al.  Distributed resource management and matching in sensor networks , 2009, 2009 International Conference on Information Processing in Sensor Networks.

[28]  Terence D. Todd,et al.  Resource Allocation and Outage Control for Solar-Powered WLAN Mesh Networks , 2007, IEEE Transactions on Mobile Computing.

[29]  Henry H. Willis.  Guiding Resource Allocations Based on Terrorism Risk , 2007, Risk analysis : an official publication of the Society for Risk Analysis.

[30]  Leandros Tassiulas,et al.  Resource Allocation and Cross-Layer Control in Wireless Networks , 2006, Found. Trends Netw..

[31]  Matt Welsh,et al.  Decentralized, adaptive resource allocation for sensor networks , 2005, NSDI.

[32]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[33]  Rajkumar Buyya,et al.  Economic-based Distributed Resource Management and Scheduling for Grid Computing , 2002, ArXiv.

[34]  P. Rose,et al.  Needs-based resource allocation in education : via formula funding of schools , 2002 .

[35]  Fritz Gehbauer,et al.  Optimized resource allocation for emergency response after earthquake disasters , 2000 .

[36]  David P. Lepak,et al.  The Human Resource Architecture: Toward a Theory of Human Capital Allocation and Development , 1999 .

[37]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[38]  Rajesh Raman,et al.  Matchmaking: distributed resource management for high throughput computing , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[39]  S. Clearwater.  Market-based control: a paradigm for distributed resource allocation , 1996 .

[40]  L. Haddad,et al.  Effects of Agricultural Commercialization on Land Tenure, Household Resource Allocation, and Nutrition in the Philippines , 1990 .

[41]  W. Abrahamson.  PATTERNS OF RESOURCE ALLOCATION IN WILDFLOWER POPULATIONS OF FIELDS AND WOODS , 1979 .

[42]  George B. Dantzig,et al.  Linear programming and extensions , 1965 .

[43]  M. Sion.  On general minimax theorems , 1958 .