Why cloud applications are not ready for the edge (yet)

Mobile Edge Clouds (MECs) are distributed platforms in which distant data-centers are complemented with computing and storage capacity located at the edge of the network. Their wide resource distribution enables MECs to fulfill the need of low latency and high bandwidth to offer an improved user experience. As modern cloud applications are increasingly architected as collections of small, independently deployable services, they can be flexibly deployed in various configurations that combines resources from both centralized datacenters and edge locations. In principle, such applications should therefore be well-placed to exploit the advantages of MECs so as to reduce service response times. In this paper, we quantify the benefits of deploying such cloud micro-service applications on MECs. Using two popular benchmarks, we show that, against conventional wisdom, end-to-end latency does not improve significantly even when most application services are deployed in the edge location. We developed a profiler to better understand this phenomenon, allowing us to develop recommendations for adapting applications to MECs. Further, by quantifying the gains of those recommendations, we show that the performance of an application can be made to reach the ideal scenario, in which the latency between an edge datacenter and a remote datacenter has no impact on the application performance. This work thus presents ways of adapting cloud-native applications to take advantage of MECs and provides guidance for developing MEC-native applications. We believe that both these elements are necessary to drive MEC adoption.

[1]  George Pallis,et al.  Content Delivery Networks: Status and Trends , 2003, IEEE Internet Comput..

[2]  Johan Tordsson,et al.  How Beneficial Are Intermediate Layer Data Centers in Mobile Edge Networks? , 2016, 2016 IEEE 1st International Workshops on Foundations and Applications of Self* Systems (FAS*W).

[3]  Haiying Shen,et al.  CloudFog: Leveraging Fog to Extend Cloud Gaming for Thin-Client MMOG with High Quality of Service , 2017, IEEE Transactions on Parallel and Distributed Systems.

[4]  David A. Maltz,et al.  Cloudward bound: planning for beneficial migration of enterprise applications to the cloud , 2010, SIGCOMM 2010.

[5]  Mubashir Husain Rehmani,et al.  Mobile Edge Computing: Opportunities, solutions, and challenges , 2017, Future Gener. Comput. Syst..

[6]  Cesare Pautasso,et al.  Microservices in Practice, Part 1: Reality Check and Service Design , 2017, IEEE Software.

[7]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[8]  Ahmed E. Hassan,et al.  Finding and Evaluating the Performance Impact of Redundant Data Access for Applications that are Developed Using Object-Relational Mapping Frameworks , 2016, IEEE Transactions on Software Engineering.

[9]  Fan Yang,et al.  The QUIC Transport Protocol: Design and Internet-Scale Deployment , 2017, SIGCOMM.

[10]  Martin Thomson,et al.  Hypertext Transfer Protocol Version 2 (HTTP/2) , 2015, RFC.

[11]  Ying Gao,et al.  Quantifying the Impact of Edge Computing on Mobile Applications , 2016, APSys.

[12]  Gwendal Simon,et al.  A hybrid edge-cloud architecture for reducing on-demand gaming latency , 2014, Multimedia Systems.

[13]  Rod Johnson,et al.  J2EE Development Frameworks , 2005, Computer.

[14]  Michael Ferdman,et al.  Demystifying cloud benchmarking , 2016, 2016 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).

[15]  P. Mell,et al.  SP 800-145. The NIST Definition of Cloud Computing , 2011 .

[16]  Cesare Pautasso,et al.  Microservices in Practice, Part 2: Service Integration and Sustainability , 2017, IEEE Software.

[17]  Sam Newman,et al.  Building Microservices , 2015 .

[18]  Arjuna Sathiaseelan,et al.  Deep Diving into Africa's Inter-Country Latencies , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[19]  George Pallis,et al.  Insight and perspectives for content delivery networks , 2006, CACM.

[20]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[21]  Takuya Nakaike,et al.  Workload characterization for microservices , 2016, 2016 IEEE International Symposium on Workload Characterization (IISWC).

[22]  C. Moallemi,et al.  The Cost of Latency ∗ , 2009 .

[23]  David A. Maltz,et al.  Cloudward bound: planning for beneficial migration of enterprise applications to the cloud , 2010, SIGCOMM '10.

[24]  Rubby Casallas,et al.  Infrastructure Cost Comparison of Running Web Applications in the Cloud Using AWS Lambda and Monolithic and Microservice Architectures , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[25]  Hans C. Woithe,et al.  Edge computing in the ePC: a reality check , 2017, SEC.

[26]  Frank Leymann,et al.  How to adapt applications for the Cloud environment , 2012, Computing.

[27]  Paramvir Bahl,et al.  Real-Time Video Analytics: The Killer App for Edge Computing , 2017, Computer.

[28]  Faria Kalim,et al.  To edge or not to edge? , 2017, SoCC.

[29]  Alex Reznik,et al.  Mobile Edge Cloud System: Architectures, Challenges, and Approaches , 2018, IEEE Systems Journal.

[30]  Aakanksha Chowdhery,et al.  The Design and Implementation of a Wireless Video Surveillance System , 2015, MobiCom.

[31]  Mahadev Satyanarayanan,et al.  An empirical study of latency in an emerging class of edge computing applications for wearable cognitive assistance , 2017, SEC.