INT Based Network-Aware Task Scheduling for Edge Computing

Edge computing promises low-latency computation for delay sensitive applications by processing data close to its source. Task scheduling in edge computing is however not immune to performance fluctuations as dynamic and unpredictable nature of network traffic can adversely affect the data transfer performance between end devices and edge servers. In this paper, we leverage In-band Network Telemetry (INT) to gather fine-grained, temporal statistics about network conditions and incorporate network-awareness into task scheduling for edge computing. Unlike legacy network monitoring techniques that collect port-level or flow-level statistics at the order of tens of seconds, INT offers highly accurate network visibility by capturing network telemetry at packet-level granularity, thereby presenting a unique opportunity to detect network congestion precisely. Our experimental analysis using various workload types and network congestion scenarios reveal that enhancing task scheduling of edge computing with high-precision network telemetry can lead up to 40% reduction in data transfer times and up to 30% reduction in total task execution times by favoring edge servers in uncongested (or mildly congested) sections of network when scheduling tasks.

[1]  E. Hart Fabric , 2003, Prop Building for Beginners.

[2]  Roberto Bifulco,et al.  A Survey on the Programmable Data Plane: Abstractions, Architectures, and Open Problems , 2018, 2018 IEEE 19th International Conference on High Performance Switching and Routing (HPSR).

[3]  Dimitrios P. Pezaros,et al.  Dynamic, Latency-Optimal vNF Placement at the Network Edge , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[4]  Deval Bhamare,et al.  Programmable Event Detection for In-Band Network Telemetry , 2019, 2019 IEEE 8th International Conference on Cloud Networking (CloudNet).

[5]  Qian Wang,et al.  MR-Edge: a MapReduce-based Protocol for IoT Edge Computing with Resource Constraints , 2019, 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[6]  Na Li,et al.  In-band Network Telemetry: A Survey , 2021, Comput. Networks.

[7]  Chin-Teng Lin,et al.  Edge of Things: The Big Picture on the Integration of Edge, IoT and the Cloud in a Distributed Computing Environment , 2018, IEEE Access.

[8]  Youlong Luo,et al.  Collaborative cache allocation and task scheduling for data-intensive applications in edge computing environment , 2019, Future Gener. Comput. Syst..

[9]  Saeed Sharifian,et al.  Cloudlet dynamic server selection policy for mobile task off-loading in mobile cloud computing using soft computing techniques , 2017, The Journal of Supercomputing.

[10]  Nick McKeown,et al.  A network in a laptop: rapid prototyping for software-defined networks , 2010, Hotnets-IX.

[11]  Keyan Cao,et al.  An Overview on Edge Computing Research , 2020, IEEE Access.

[12]  Minlan Yu,et al.  PINT: Probabilistic In-band Network Telemetry , 2020, SIGCOMM.

[13]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[14]  Anirudh Sivaraman,et al.  In-band Network Telemetry via Programmable Dataplanes , 2015 .

[15]  James Won-Ki Hong,et al.  Towards ONOS-based SDN monitoring using in-band network telemetry , 2017, 2017 19th Asia-Pacific Network Operations and Management Symposium (APNOMS).

[16]  Zhisheng Niu,et al.  A Cooperative Scheduling Scheme of Local Cloud and Internet Cloud for Delay-Aware Mobile Cloud Computing , 2015, 2015 IEEE Globecom Workshops (GC Wkshps).

[17]  Sangheon Pack,et al.  Selective In-band Network Telemetry for Overhead Reduction , 2018, 2018 IEEE 7th International Conference on Cloud Networking (CloudNet).

[18]  M. H. Gunes,et al.  Latency Comparison of Cloud Datacenters and Edge Servers , 2020, GLOBECOM 2020 - 2020 IEEE Global Communications Conference.

[19]  Minlan Yu,et al.  HPCC: high precision congestion control , 2019, SIGCOMM.

[20]  Giancarlo Fortino,et al.  Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA , 2020, IEEE Access.

[21]  Jae-Hyoung Yoo,et al.  Best nexthop Load Balancing Algorithm with Inband network telemetry , 2020, 2020 16th International Conference on Network and Service Management (CNSM).

[22]  Luciano Paschoal Gaspary,et al.  An optimization-based approach for efficient network monitoring using in-band network telemetry , 2019, Journal of Internet Services and Applications.

[23]  Ishai Menache,et al.  Network-Aware Scheduling for Data-Parallel Jobs: Plan When You Can , 2015, SIGCOMM.

[24]  Bin Liu,et al.  INT-path: Towards Optimal Path Planning for In-band Network-Wide Telemetry , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[25]  Filippo Cugini,et al.  Telemetry-Driven Optical 5G Serverless Architecture for Latency-Sensitive Edge Computing , 2020, 2020 Optical Fiber Communications Conference and Exhibition (OFC).

[26]  George Varghese,et al.  P4: programming protocol-independent packet processors , 2013, CCRV.

[27]  Luciano Baresi,et al.  Towards a Serverless Platform for Edge Computing , 2019, 2019 IEEE International Conference on Fog Computing (ICFC).