Virtual Service Placement for Edge Computing Under Finite Memory and Bandwidth

Edge computing allows an edge server to adaptively place virtual instances to serve different types of data. This article presents a new algorithm which jointly optimizes virtual service placement farsightedly and service data admission instantly to maximize the time-average service throughput of edge computing. The data admission is optimized, adapting to fast-changing data arrivals and wireless channels. The service placement is transformed into a two-dimensional knapsack problem by approximating future arrivals and channels with past observations, and solved over a slow timescale to allow services to be properly installed. Different from existing studies, our algorithm considers practical aspects of edge servers, such as finite memory size and bandwidth. We prove that the algorithm is asymptotically optimal and the optimality loss resulting from the approximation diminishes. Simulations show that our approach can improve the time-average throughput of existing alternatives by 16% for our considered simulation setup. The improvement becomes higher, as the memory size becomes increasingly tight. The number of services to be replaced is reduced without loss of throughput, after being placed farsightedly.

[1]  Wei Zhang,et al.  Energy Optimal Wireless Data Transmission for Wearable Devices: A Compression Approach , 2018, IEEE Transactions on Vehicular Technology.

[2]  Victor C. M. Leung,et al.  Joint Resource Allocation for Latency-Sensitive Services Over Mobile Edge Computing Networks With Caching , 2019, IEEE Internet of Things Journal.

[3]  Nirwan Ansari,et al.  Application Aware Workload Allocation for Edge Computing-Based IoT , 2018, IEEE Internet of Things Journal.

[4]  Xin Wang,et al.  Multi-Timescale Online Optimization of Network Function Virtualization for Service Chaining , 2019, IEEE Transactions on Mobile Computing.

[5]  Shiqiang Wang,et al.  Red/LeD: An Asymptotically Optimal and Scalable Online Algorithm for Service Caching at the Edge , 2018, IEEE Journal on Selected Areas in Communications.

[6]  Yuguang Fang,et al.  Beef Up the Edge: Spectrum-Aware Placement of Edge Computing Services for the Internet of Things , 2019, IEEE Transactions on Mobile Computing.

[7]  Zhu Han,et al.  Joint Optimization of Caching, Computing, and Radio Resources for Fog-Enabled IoT Using Natural Actor–Critic Deep Reinforcement Learning , 2019, IEEE Internet of Things Journal.

[8]  Mahadev Satyanarayanan,et al.  vTube: efficient streaming of virtual appliances over last-mile networks , 2013, SoCC.

[9]  Wei Ni,et al.  Stochastic Online Learning for Mobile Edge Computing: Learning from Changes , 2019, IEEE Communications Magazine.

[10]  Ingrid Nunes,et al.  Understanding Application-Level Caching in Web Applications , 2017, ACM Comput. Surv..

[11]  Anoj Kumar,et al.  A Cache Content Replacement Scheme for Information Centric Network , 2016 .

[12]  James R. Goodman,et al.  Limited bandwidth to affect processor design , 1997, IEEE Micro.

[13]  Xu Han,et al.  Cost Aware Service Placement and Load Dispatching in Mobile Cloud Systems , 2016, IEEE Transactions on Computers.

[14]  Eytan Modiano,et al.  Dynamic power allocation and routing for time varying wireless networks , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[15]  Qianbin Chen,et al.  Computation Offloading and Resource Allocation in Wireless Cellular Networks With Mobile Edge Computing , 2017, IEEE Transactions on Wireless Communications.

[16]  Hossein Pedram,et al.  On Resource Management in Load-Coupled OFDMA Networks , 2018, IEEE Transactions on Communications.

[17]  Mianxiong Dong,et al.  Saving Energy on the Edge: In-Memory Caching for Multi-Tier Heterogeneous Networks , 2018, IEEE Communications Magazine.

[18]  Andrea Lodi,et al.  A storm of feasibility pumps for nonconvex MINLP , 2012, Mathematical Programming.

[19]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[20]  Longbo Huang,et al.  Power Cost Reduction in Distributed Data Centers: A Two-Time-Scale Approach for Delay Tolerant Workloads , 2015, IEEE Transactions on Parallel and Distributed Systems.

[21]  Arogyaswami Paulraj,et al.  Information Prediction and Dynamic Programming-Based RAN Slicing for Mobile Edge Computing , 2018, IEEE Wireless Communications Letters.

[22]  Shaolei Ren,et al.  Spatio–Temporal Edge Service Placement: A Bandit Learning Approach , 2018, IEEE Transactions on Wireless Communications.

[23]  A. M. Geoffrion Integer Programming by Implicit Enumeration and Balas’ Method , 1967 .

[24]  Dario Pompili,et al.  Joint Task Offloading and Resource Allocation for Multi-Server Mobile-Edge Computing Networks , 2017, IEEE Transactions on Vehicular Technology.

[25]  Victor C. M. Leung,et al.  Cache-Enabled Adaptive Video Streaming Over Vehicular Networks: A Dynamic Approach , 2018, IEEE Transactions on Vehicular Technology.

[26]  Oghenekome Oteri,et al.  Optimal resource allocation in uplink SC-FDMA systems , 2009, IEEE Transactions on Wireless Communications.

[27]  Quanyan Zhu,et al.  Dynamic Service Placement in Geographically Distributed Clouds , 2012, IEEE Journal on Selected Areas in Communications.

[28]  Wei Ni,et al.  Optimal Schedule of Mobile Edge Computing for Internet of Things Using Partial Information , 2017, IEEE Journal on Selected Areas in Communications.

[29]  M.J. Neely,et al.  Delay Analysis for Maximal Scheduling With Flow Control in Wireless Networks With Bursty Traffic , 2009, IEEE/ACM Transactions on Networking.

[30]  Claus Pahl,et al.  Containerization and the PaaS Cloud , 2015, IEEE Cloud Computing.

[31]  Feng Qi,et al.  Resource allocation and distributed uplink offloading mechanism in fog environment , 2018, Journal of Communications and Networks.

[32]  Jie Zhang,et al.  Coexistence of LTE-LAA and Wi-Fi on 5 GHz With Corresponding Deployment Scenarios: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[33]  R. M. A. P. Rajatheva,et al.  Edge Caching in Delay-Constrained Virtualized Cellular Networks: Analysis and Market , 2018, ArXiv.

[34]  H. Vincent Poor,et al.  Dynamic Task Offloading and Resource Allocation for Ultra-Reliable Low-Latency Edge Computing , 2018, IEEE Transactions on Communications.

[35]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[36]  Pieter Simoens,et al.  Docker Layer Placement for On-Demand Provisioning of Services on Edge Clouds , 2018, IEEE Transactions on Network and Service Management.

[37]  Eytan Modiano,et al.  Scheduling in networks with time-varying channels and reconfiguration delay , 2012, 2012 Proceedings IEEE INFOCOM.

[38]  Jingdong Xu,et al.  Online Resource Allocation, Content Placement and Request Routing for Cost-Efficient Edge Caching in Cloud Radio Access Networks , 2018, IEEE Journal on Selected Areas in Communications.