Learn-and-adapt network resource allocation

Recognizing the central role of Lagrange multipliers in network resource allocation, a novel learn-and-adapt stochastic dual gradient (LA-SDG) method is developed in this paper to learn the empirical optimal Lagrange multiplier from historical data, and adapt to the upcoming resource allocation strategy. Remarkably, it only requires one more sample (gradient) evaluation than the celebrated stochastic dual gradient (SDG) method. LA-SDG can be interpreted as a foresighted learning approach with an eye on the future. It is established — both theoretically and empirically — that LA-SDG markedly improves the cost-delay tradeoff over state-of-the-art network resource allocation schemes.

[1]  Atilla Eryilmaz,et al.  Heavy-ball: A new approach to tame delay and convergence in wireless network optimization , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[2]  Dimitri P. Bertsekas,et al.  Convex Analysis and Optimization , 2003 .

[3]  Leandros Tassiulas,et al.  Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks , 1990, 29th IEEE Conference on Decision and Control.

[4]  Qing Ling,et al.  Learn-and-Adapt Stochastic Dual Gradients for Network Resource Allocation , 2017, IEEE Transactions on Control of Network Systems.

[5]  Xin Wang,et al.  Cooling-Aware Energy and Workload Management in Data Centers via Stochastic Optimization , 2016, IEEE Journal of Selected Topics in Signal Processing.

[6]  Steven H. Low,et al.  Optimization flow control—I: basic algorithm and convergence , 1999, TNET.

[7]  Alexander Shapiro,et al.  Stochastic Approximation approach to Stochastic Programming , 2013 .

[8]  Alejandro Ribeiro,et al.  Ergodic Stochastic Optimization Algorithms for Wireless Communication and Networking , 2010, IEEE Transactions on Signal Processing.

[9]  Georgios B. Giannakis,et al.  DGLB: Distributed Stochastic Geographical Load Balancing over Cloud Networks , 2017, IEEE Transactions on Parallel and Distributed Systems.

[10]  Longbo Huang,et al.  The power of online learning in stochastic network optimization , 2014, SIGMETRICS '14.