Non-stationary Stochastic Network Optimization with Imperfect Estimations

We investigate the problem of stochastic network optimization in presence of non-stationarity and estimations of average states in the future. Specifically, we first prove that the widely-used Drift and Penalty Algorithm in the Lyapunov optimization framework works well for non-stationary systems with periodical states. However, when the system is not periodical, non-stationarity may lead to severe performance degradation, which motivates the design of a novel, online algorithm named DPNP that incorporates the estimations of average future states into the stochastic optimization framework for decision making. DPNP is an online algorithm that requires zero a-prior distributional information about estimation errors. DPNP not only has near-optimal theoretical performance guarantees, but also outperforms existing Drift and Penalty Algorithm in numerical simulations. The improvement of DPNP highlights the importance of combining historic and future state estimations in non-stationary stochastic network optimization.

[1]  Na Li,et al.  Using Predictions in Online Optimization with Switching Costs: A Fast Algorithm and A Fundamental Limit , 2018, 2018 Annual American Control Conference (ACC).

[2]  Jaime Llorca,et al.  Dynamic Cloud Network Control Under Reconfiguration Delay and Cost , 2019, IEEE/ACM Transactions on Networking.

[3]  Ricardo Bianchini,et al.  Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms , 2017, SOSP.

[4]  Swades De,et al.  Joint VNF Placement and CPU Allocation in 5G , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[5]  Bo Ji,et al.  Throughput characterization of node-based scheduling in multihop wireless networks: a novel application of the Gallai-Edmonds structure theorem , 2016, MobiHoc.

[6]  Atilla Eryilmaz,et al.  Proactive Resource Allocation: Harnessing the Diversity and Multicast Gains , 2011, IEEE Transactions on Information Theory.

[7]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[8]  R. Srikant,et al.  Fair resource allocation in wireless networks using queue-length-based scheduling and congestion control , 2007, TNET.

[9]  Doreen Eichel.  Estimation Theory With Applications To Communications And Control , 2016 .

[10]  Jie Xu,et al.  Computation Peer Offloading for Energy-Constrained Mobile Edge Computing in Small-Cell Networks , 2017, IEEE/ACM Transactions on Networking.

[11]  Michael J. Neely,et al.  Stability and Capacity Regions or Discrete Time Queueing Networks , 2010, ArXiv.

[12]  R. Srikant,et al.  Queue-Proportional Rate Allocation with Per-Link Information in Multihop Networks , 2015, SIGMETRICS.

[13]  Minghua Chen,et al.  Learning-aided Stochastic Network Optimization with Imperfect State Prediction , 2017, MobiHoc.

[14]  Han-I Su,et al.  Modeling and analysis of the role of fast-response energy storage in the smart grid , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[15]  Ravi Kiran Raman,et al.  Downlink resource allocation under time-varying interference: Fairness and throughput optimality , 2014, Allerton.

[16]  Longbo Huang,et al.  The power of online learning in stochastic network optimization , 2014, SIGMETRICS '14.

[17]  Longbo Huang.  Receding learning-aided control in stochastic networks , 2015, Perform. Evaluation.

[18]  Jie Xu,et al.  Joint Service Caching and Task Offloading for Mobile Edge Computing in Dense Networks , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[19]  X. Zhou,et al.  Continuous-Time Mean-Variance Portfolio Selection: A Stochastic LQ Framework , 2000 .

[20]  Tong Zhang,et al.  Towards Stable Flow Scheduling in Data Centers , 2018, IEEE Transactions on Parallel and Distributed Systems.

[21]  Anand Sivasubramaniam,et al.  Optimal power cost management using stored energy in data centers , 2011, PERV.

[22]  Adam Wierman,et al.  Using Predictions in Online Optimization: Looking Forward with an Eye on the Past , 2016, SIGMETRICS.

[23]  Leandros Tassiulas,et al.  Control of wireless networks with rechargeable batteries [transactions papers] , 2010, IEEE Transactions on Wireless Communications.

[24]  Joel H. Spencer,et al.  Queueing with future information , 2014, PERV.