BumbleBee: Application-aware adaptation for container orchestration

Application-aware adaptation is the key to maintaining acceptable quality when resources become scarce. Application-oblivious responses to resource scarcity, such as TCP congestion control, may fairly reallocate a diminishing resource pool, but only the application knows how to adjust its fidelity under resource scarcity. Unfortunately, modern container-orchestration platforms like Kubernetes do not offer good support for application-aware adaptation. Thus, this paper presents a set of orchestration extensions to support application-aware adaption called BumbleBee. BumbleBee provides a clean abstraction for making decisions about network data using application semantics. Experiments with a BumbleBee prototype show that it can help a video-analytics application utilize cloud resources when available and operate without interruption when disconnected, and it can help the Fugu video server eliminate all stalling while sacrificing only 6-24% mean resolution.

[1]  Philip Levis,et al.  Learning in situ: a randomized experiment in video streaming , 2019, NSDI.

[2]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[3]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[4]  Mahadev Satyanarayanan,et al.  Agile application-aware adaptation for mobility , 1997, SOSP.

[5]  Ramesh Govindan,et al.  Odessa: enabling interactive perception applications on mobile devices , 2011, MobiSys '11.

[6]  James D. Herbsleb,et al.  Simplifying cyber foraging for mobile devices , 2007, MobiSys '07.

[7]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[8]  Landon P. Cox,et al.  The Emerging Landscape of Edge Computing , 2020, GetMobile Mob. Comput. Commun..

[9]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[10]  Ion Stoica,et al.  Chameleon: scalable adaptation of video analytics , 2018, SIGCOMM.

[11]  Abhishek Verma,et al.  Large-scale cluster management at Google with Borg , 2015, EuroSys.

[12]  Walter Willinger,et al.  Sonata: query-driven streaming network telemetry , 2018, SIGCOMM.

[13]  Brendan Burns,et al.  Kubernetes: Up and Running: Dive into the Future of Infrastructure , 2017 .

[14]  Byung-Gon Chun,et al.  CloneCloud: elastic execution between mobile device and cloud , 2011, EuroSys '11.

[15]  Paramvir Bahl,et al.  Focus: Querying Large Video Datasets with Low Latency and Low Cost , 2018, OSDI.

[16]  Jialin Li,et al.  Eris: Coordination-Free Consistent Transactions Using In-Network Concurrency Control , 2017, SOSP.

[17]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[18]  Alec Wolman,et al.  Outatime: Using Speculation to Enable Low-Latency Continuous Interaction for Mobile Cloud Gaming , 2015, MobiSys.

[19]  Robert Soulé,et al.  Emu: Rapid Prototyping of Networking Services , 2017, USENIX Annual Technical Conference.

[20]  Eric A. Brewer,et al.  Adapting to network and client variability via on-demand dynamic distillation , 1996, ASPLOS VII.

[21]  Krishna R. Pattipati,et al.  ABR streaming of VBR-encoded videos: characterization, challenges, and solutions , 2018, CoNEXT.

[22]  Alec Wolman,et al.  MAUI: making smartphones last longer with code offload , 2010, MobiSys '10.

[23]  George Varghese,et al.  P4: programming protocol-independent packet processors , 2013, CCRV.

[24]  Alec Wolman,et al.  Demo: Kahawai: high-quality mobile gaming using GPU offload , 2015, MobiSys.

[25]  Jialin Li,et al.  Just Say NO to Paxos Overhead: Replacing Consensus with Network Ordering , 2016, OSDI.

[26]  G.J. Minden,et al.  A survey of active network research , 1997, IEEE Communications Magazine.

[27]  Vyas Sekar,et al.  Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE , 2012, CoNEXT '12.

[28]  Ellen W. Zegura,et al.  Evaluation of data communication opportunities from oil field locations at remote areas , 2011, IMC '11.