Resource Provisioning and Allocation in Function-as-a-Service Edge-Clouds

Edge computing has emerged as a new paradigm to bring cloud applications closer to users for increased performance. Unlike back-end cloud systems which consolidate their resources in a centralized data center location with virtually unlimited capacity, edge-clouds comprise distributed resources at various “computation spots”, each with very limited capacity. In this paper, we consider Function-as-a-Service (FaaS) edge-clouds where application providers deploy their latency-critical functions that process user requests with strict response time deadlines. In this setting, we investigate the problem of resource provisioning and allocation. After formulating the optimal solution, we propose resource allocation and provisioning algorithms across the spectrum of fully-centralized to fully-decentralized. We evaluate the performance of these algorithms in terms of their ability to utilize CPU resources and meet request deadlines under various system parameters. Our results indicate that practical decentralized strategies, which require no coordination among computation spots, achieve performance that is close to the optimal fullycentralized strategy with coordination overheads.

[1]  Liang Tong,et al.  A hierarchical edge cloud architecture for mobile computing , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[2]  George Pavlou,et al.  Edge-MAP: Auction Markets for Edge Resource Provisioning , 2018, 2018 IEEE 19th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[3]  Karim Habak,et al.  COSMOS: computation offloading as a service for mobile devices , 2014, MobiHoc '14.

[4]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[5]  Luis Rodero-Merino,et al.  Finding your Way in the Fog: Towards a Comprehensive Definition of Fog Computing , 2014, CCRV.

[6]  George Pavlou,et al.  Cost-Efficient NFV-Enabled Mobile Edge-Cloud for Low Latency Mobile Applications , 2018, IEEE Transactions on Network and Service Management.

[7]  Xiang-Yang Li,et al.  Online job dispatching and scheduling in edge-clouds , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[8]  George Pavlou,et al.  Probabilistic in-network caching for information-centric networks , 2012, ICN '12.

[9]  Miguel Rio,et al.  Utility-maximizing server selection , 2016, 2016 IFIP Networking Conference (IFIP Networking) and Workshops.

[10]  Edward A. Lee,et al.  The Cloud is Not Enough: Saving IoT from the Cloud , 2015, HotStorage.

[11]  Heiko Ludwig,et al.  Zenith: Utility-Aware Resource Allocation for Edge Computing , 2017, 2017 IEEE International Conference on Edge Computing (EDGE).

[12]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[13]  Sampath Rangarajan,et al.  ACACIA: Context-aware Edge Computing for Continuous Interactive Applications over Mobile Networks , 2016, CoNEXT.

[14]  David A. Patterson,et al.  Cloud Programming Simplified: A Berkeley View on Serverless Computing , 2019, ArXiv.

[15]  Qiang Duan Delay Characteristics of Packet Switched Networks , 2009 .

[16]  Ning Zhang,et al.  Joint Admission Control and Resource Allocation in Edge Computing for Internet of Things , 2018, IEEE Network.

[17]  Ioannis Psaras,et al.  Decentralised Edge-Computing and IoT through Distributed Trust , 2018, MobiSys.

[18]  Shiqiang Wang,et al.  Red/LeD: An Asymptotically Optimal and Scalable Online Algorithm for Service Caching at the Edge , 2018, IEEE Journal on Selected Areas in Communications.

[19]  Song Guo,et al.  Joint Optimization of Task Scheduling and Image Placement in Fog Computing Supported Software-Defined Embedded System , 2016, IEEE Transactions on Computers.

[20]  Mahadev Satyanarayanan,et al.  Towards wearable cognitive assistance , 2014, MobiSys.

[21]  George Pavlou,et al.  On Uncoordinated Service Placement in Edge-Clouds , 2017, 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom).

[22]  George Pavlou,et al.  FogSpot: Spot Pricing for Application Provisioning in Edge/Fog Computing , 2019, IEEE Transactions on Services Computing.

[23]  Zhuo Chen,et al.  Edge Analytics in the Internet of Things , 2015, IEEE Pervasive Computing.

[24]  Miguel Rio,et al.  DR-Cache: Distributed Resilient Caching with Latency Guarantees , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[25]  Paramvir Bahl,et al.  The Case for VM-Based Cloudlets in Mobile Computing , 2009, IEEE Pervasive Computing.

[26]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[27]  Lazaros Gkatzikis,et al.  Distributed Cache Management in Information-Centric Networks , 2013, IEEE Transactions on Network and Service Management.

[28]  Luciano Baresi,et al.  PAPS: A Framework for Decentralized Self-management at the Edge , 2019, ICSOC.

[29]  George Pavlou,et al.  Icarus: a caching simulator for information centric networking (ICN) , 2014, SimuTools.

[30]  Umakishore Ramachandran,et al.  An execution model for serverless functions at the edge , 2019, IoTDI.

[31]  Weisong Shi,et al.  LAVEA: latency-aware video analytics on edge computing platform , 2017, SEC.

[32]  Miguel Rio,et al.  Utility-Centric Networking: Balancing Transit Costs With Quality of Experience , 2018, IEEE/ACM Transactions on Networking.