Derandomized Distributed Multi-resource Allocation with Little Communication Overhead

We study a class of distributed optimization problems for multiple shared resource allocation in Internet-connected devices. We propose a derandomized version of an existing stochastic additive-increase and multiplicative-decrease (AIMD) algorithm. The proposed solution uses one bit feedback signal for each resource between the system and the Internet-connected devices and does not require inter-device communication. Additionally, the Internet-connected devices do not compromise their privacy and the solution does not dependent on the number of participating devices. In the system, each Internet-connected device has private cost functions which are strictly convex, twice continuously differentiable and increasing. We show empirically that the long-term average allocations of multiple shared resources converge to optimal allocations and the system achieves minimum social cost. Furthermore, we show that the proposed derandomized AIMD algorithm converges faster than the stochastic AIMD algorithm and both the approaches provide approximately same solutions.

[1]  Yongduan Song,et al.  Distributed optimization with the consideration of adaptivity and finite-time convergence , 2014, 2014 American Control Conference.

[2]  Dimitri P. Bertsekas,et al.  Incremental proximal methods for large scale convex optimization , 2011, Math. Program..

[3]  Mahadev Satyanarayanan,et al.  An empirical study of latency in an emerging class of edge computing applications for wearable cognitive assistance , 2017, SEC.

[4]  Mohammad A. S. Masoum,et al.  Real-Time Coordination of Plug-In Electric Vehicle Charging in Smart Grids to Minimize Power Losses and Improve Voltage Profile , 2011, IEEE Transactions on Smart Grid.

[5]  Jianping Pan,et al.  Performance analysis of TCP-friendly AIMD algorithms for multimedia applications , 2005, IEEE Transactions on Multimedia.

[6]  Robert Shorten,et al.  AIMD in a discrete time implementation or with a non-constant shared resource , 2015, 2015 5th Australian Control Conference (AUCC).

[7]  Mohsen Guizani,et al.  Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications , 2015, IEEE Communications Surveys & Tutorials.

[8]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[9]  T. Koopmans,et al.  Assignment Problems and the Location of Economic Activities , 1957 .

[10]  Ufuk Topcu,et al.  Differentially Private Distributed Constrained Optimization , 2014, IEEE Transactions on Automatic Control.

[11]  Jia Yuan Yu,et al.  Nonhomogeneous Place-Dependent Markov Chains, Unsynchronised AIMD, and Network Utility Maximization , 2014, 1404.5064.

[12]  Mahadev Satyanarayanan,et al.  Towards wearable cognitive assistance , 2014, MobiSys.

[13]  Bingsheng He,et al.  Fairness-Efficiency Allocation of CPU-GPU Heterogeneous Resources , 2019, IEEE Transactions on Services Computing.

[14]  Matti Siekkinen,et al.  Exploring Vision-Based Techniques for Outdoor Positioning Systems: A Feasibility Study , 2017, IEEE Transactions on Mobile Computing.

[15]  Jing Wang,et al.  Control approach to distributed optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[16]  Karl Henrik Johansson,et al.  Subgradient methods and consensus algorithms for solving convex optimization problems , 2008, 2008 47th IEEE Conference on Decision and Control.

[17]  Sonia Martínez,et al.  Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication , 2014, Autom..

[18]  Karl Henrik Johansson,et al.  Reaching an Optimal Consensus: Dynamical Systems That Compute Intersections of Convex Sets , 2011, IEEE Transactions on Automatic Control.

[19]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[20]  Giuseppe Notarstefano,et al.  Distributed Abstract Optimization via Constraints Consensus: Theory and Applications , 2011, IEEE Transactions on Automatic Control.

[21]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[22]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[23]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[24]  Robert Shorten,et al.  On the Design of Campus Parking Systems With QoS Guarantees , 2015, IEEE Transactions on Intelligent Transportation Systems.

[25]  Fabian R. Wirth,et al.  AIMD Dynamics and Distributed Resource Allocation , 2016 .

[26]  Grace A. Lewis,et al.  On-demand VM provisioning for cloudlet-based cyber-foraging in resource-constrained environments , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[27]  Xavier Masip-Bruin,et al.  Managing resources continuity from the edge to the cloud: Architecture and performance , 2018, Future Gener. Comput. Syst..

[28]  Robert Shorten,et al.  On the control of agents coupled through shared resources , 2018, ArXiv.

[29]  Angelia Nedic,et al.  Asynchronous Broadcast-Based Convex Optimization Over a Network , 2011, IEEE Transactions on Automatic Control.

[30]  Robert Shorten,et al.  Plug-and-Play Distributed Algorithms for Optimized Power Generation in a Microgrid , 2014, IEEE Transactions on Smart Grid.

[31]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[32]  Anna Scaglione,et al.  Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method , 2013, IEEE Transactions on Automatic Control.

[33]  Raj Jain,et al.  Analysis of the Increase and Decrease Algorithms for Congestion Avoidance in Computer Networks , 1989, Comput. Networks.

[34]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[35]  Di Yuan,et al.  Allocation of Heterogeneous Resources of an IoT Device to Flexible Services , 2015, IEEE Internet of Things Journal.

[36]  Paramvir Bahl,et al.  The Case for VM-Based Cloudlets in Mobile Computing , 2009, IEEE Pervasive Computing.