Reducing Latency in Virtual Machines: Enabling Tactile Internet for Human-Machine Co-Working

Software-defined networking (SDN) and network function virtualization (NFV) processed in multi-access edge computing (MEC) cloud systems have been proposed as critical paradigms for achieving the low latency requirements of the tactile Internet. While virtual network functions (VNFs) allow greater flexibility compared to hardware-based solutions, the VNF abstraction also introduces additional packet processing delays. In this paper, we investigate the practical feasibility of NFV with respect to the tactile Internet latency requirements. We develop, implement, and evaluate Chain-based Low latency VNF ImplemeNtation (CALVIN), a low-latency management framework for distributed Service Function Chains (SFCs). CALVIN classifies VNFs into elementary, basic, and advanced VNFs; moreover, CALVIN implements elementary and basic VNFs in the kernel space, while the advanced VNFs are implemented in the user space. Throughout, CALVIN employs a distributed mapping with one VNF per Virtual Machine (VM) in a MEC system. Furthermore, CALVIN avoids the metadata structure processing and batch processing of packets in the conventional Linux networking stack so as to achieve short per-packet latencies. Our rigorous measurements on off-the-shelf conventional networking and computing hardware demonstrate that CALVIN achieves round-trip times from a MEC ingress point via two elementary forwarding VNFs (one in kernel space and one in user space) and a MEC server to a MEC egress point on the order of 0.32 ms. Our measurements also indicate that MEC network coding and encryption are feasible for small 256 byte packets with an MEC latency budget of 0.35 ms; whereas, large 1400 byte packets can complete the network coding, but not the encryption within the 0.35 ms.

[1]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[2]  Sajal K. Das,et al.  Software Defined Networking Meets Information Centric Networking: A Survey , 2018, IEEE Access.

[3]  Victor Chang,et al.  AI-based software-defined virtual network function scheduling with delay optimization , 2018, Cluster Computing.

[4]  Wolfgang Kellerer,et al.  Flexibility in Softwarized Networks: Classifications and Research Challenges , 2019, IEEE Communications Surveys & Tutorials.

[5]  Younghan Kim,et al.  An experimental study of security for service function chaining , 2017, 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).

[6]  Branka Vucetic,et al.  Burstiness-Aware Bandwidth Reservation for Ultra-Reliable and Low-Latency Communications in Tactile Internet , 2018, IEEE Journal on Selected Areas in Communications.

[7]  Paul Veitch,et al.  A Low-Latency NFV Infrastructure for Performance-Critical Applications , 2017 .

[8]  Anthony M Zador,et al.  Differences in Sensitivity to Neural Timing among Cortical Areas , 2012, The Journal of Neuroscience.

[9]  Heng Yang,et al.  Queue-Aware Dynamic Placement of Virtual Network Functions in 5G Access Network , 2018, IEEE Access.

[10]  Yang Hu,et al.  Towards efficient server architecture for virtualized network function deployment: Implications and implementations , 2016, 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[11]  Mikhail M. Rovnyagin,et al.  Application of hybrid computing technologies for high-performance distributed NFV systems , 2017, 2017 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus).

[12]  Paul Emmerich,et al.  User Space Network Drivers , 2019, 2019 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[13]  Marcin Wójcik,et al.  Where Has My Time Gone? , 2017, PAM.

[14]  Luca Veltri,et al.  Implementation of virtual network function chaining through segment routing in a linux-based NFV infrastructure , 2017, 2017 IEEE Conference on Network Softwarization (NetSoft).

[15]  Ju Ren,et al.  Distributed and Efficient Object Detection in Edge Computing: Challenges and Solutions , 2018, IEEE Network.

[16]  Ning Weng,et al.  NF-switch: VNFs-enabled SDN switches for high performance service function chaining , 2017, 2017 IEEE 25th International Conference on Network Protocols (ICNP).

[17]  Adrienne Porter Felt,et al.  Measuring HTTPS Adoption on the Web , 2017, USENIX Security Symposium.

[18]  Tarik Taleb,et al.  Towards Edge Slicing: VNF Placement Algorithms for a Dynamic & Realistic Edge Cloud Environment , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[19]  Guy Pujolle,et al.  Fast Packet Processing: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[20]  Daniel E. Lucani,et al.  Fulcrum: Flexible Network Coding for Heterogeneous Devices , 2018, IEEE Access.

[21]  Wolfgang Kellerer,et al.  Towards optimal adaptation of NFV packet processing to modern CPU memory architectures , 2017, CAN@CoNEXT.

[22]  David Hay,et al.  FTvNF: fault tolerant virtual network functions , 2018, ANCS.

[23]  Tiago Ferreto,et al.  An Unikernels Provisioning Architecture for OpenStack , 2018, 2018 IEEE Symposium on Computers and Communications (ISCC).

[24]  Hassan Halabian,et al.  Distributed Resource Allocation Optimization in 5G Virtualized Networks , 2019, IEEE Journal on Selected Areas in Communications.

[25]  Daniel Enrique Lucani,et al.  Integrating Sparsity into Fulcrum Codes: Investigating Throughput, Complexity and Overhead , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[26]  Tarik Taleb,et al.  A Survey on the Placement of Virtual Resources and Virtual Network Functions , 2019, IEEE Communications Surveys & Tutorials.

[27]  Geyong Min,et al.  Stochastic Performance Analysis of Network Function Virtualization in Future Internet , 2019, IEEE Journal on Selected Areas in Communications.

[28]  Daniel E. Lucani,et al.  Towards the Tactile Internet: Decreasing Communication Latency with Network Coding and Software Defined Networking , 2015 .

[29]  Giuseppe Lettieri,et al.  A Survey of Fast Packet I/O Technologies for Network Function Virtualization , 2017, ISC Workshops.

[30]  Andrew W. Moore,et al.  FEC Killed The Cut-Through Switch , 2018, NEAT@SIGCOMM.

[31]  Leonardo Linguaglossa,et al.  High-Speed Software Data Plane via Vectorized Packet Processing , 2018, IEEE Communications Magazine.

[32]  Bo Yi,et al.  A comprehensive survey of Network Function Virtualization , 2018, Comput. Networks.

[33]  Xiaoxiao Li,et al.  A kernel-space POF virtual switch , 2017, Comput. Electr. Eng..

[34]  Mubashir Husain Rehmani,et al.  Mobile Edge Computing: Opportunities, solutions, and challenges , 2017, Future Gener. Comput. Syst..

[35]  Georgios Xilouris,et al.  SDN-based service function chaining mechanism and service prototype implementation in NFV scenario , 2017, Comput. Stand. Interfaces.

[36]  Bo Han,et al.  ParaBox: Exploiting Parallelism for Virtual Network Functions in Service Chaining , 2017, SOSR.

[37]  Florian Schmidt,et al.  On the Fly Orchestration of Unikernels: Tuning and Performance Evaluation of Virtual Infrastructure Managers , 2018, IEEE Transactions on Cloud Computing.

[38]  Toke Høiland-Jørgensen,et al.  The eXpress data path: fast programmable packet processing in the operating system kernel , 2018, CoNEXT.

[39]  Branka Vucetic,et al.  Ultra-Reliable Low Latency Cellular Networks: Use Cases, Challenges and Approaches , 2017, IEEE Communications Magazine.

[40]  Tarik Taleb,et al.  Traffic Steering for Service Function Chaining , 2019, IEEE Communications Surveys & Tutorials.

[41]  Petar Popovski,et al.  Towards Massive, Ultra-Reliable, and Low-Latency Wireless Communication with Short Packets , 2015 .

[42]  Frank H. P. Fitzek,et al.  Caterpillar RLNC With Feedback (CRLNC-FB): Reducing Delay in Selective Repeat ARQ Through Coding , 2018, IEEE Access.

[43]  Tarik Taleb,et al.  Network Slicing and Softwarization: A Survey on Principles, Enabling Technologies, and Solutions , 2018, IEEE Communications Surveys & Tutorials.

[44]  Abdallah Shami,et al.  Network Function Virtualization-Aware Orchestrator for Service Function Chaining Placement in the Cloud , 2019, IEEE Journal on Selected Areas in Communications.

[45]  Giacomo Verticale,et al.  Impact of Processing-Resource Sharing on the Placement of Chained Virtual Network Functions , 2017, IEEE Transactions on Cloud Computing.

[46]  Weihua Zhuang,et al.  End-to-End Delay Modeling for Embedded VNF Chains in 5G Core Networks , 2019, IEEE Internet of Things Journal.

[47]  Kai Han,et al.  Application-Driven End-to-End Slicing: When Wireless Network Virtualization Orchestrates With NFV-Based Mobile Edge Computing , 2018, IEEE Access.

[48]  Tarik Taleb,et al.  Conformal Mapping for Optimal Network Slice Planning Based on Canonical Domains , 2018, IEEE Journal on Selected Areas in Communications.

[49]  Xinghuo Yu,et al.  Survey on Recent Advances in Networked Control Systems , 2016, IEEE Transactions on Industrial Informatics.

[50]  Xin Chen,et al.  VNF Placement in Hybrid NFV Environment: Modeling and Genetic Algorithms , 2016, 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS).

[51]  Chen Sun,et al.  GEN: A GPU-Accelerated Elastic Framework for NFV , 2018, APNet '18.

[52]  Chadi Assi,et al.  A Reliability-Aware Network Service Chain Provisioning With Delay Guarantees in NFV-Enabled Enterprise Datacenter Networks , 2017, IEEE Transactions on Network and Service Management.

[53]  Daniel Raumer,et al.  Performance implications for intra-node placement of network function chains , 2017, 2017 IEEE 6th International Conference on Cloud Networking (CloudNet).

[54]  Roberto Bifulco,et al.  Can the Network be the AI Accelerator? , 2018, NetCompute@SIGCOMM.

[55]  Wenwu Zhu,et al.  Multimedia Content Delivery with Network Function Virtualization: The Energy Perspective , 2017, IEEE MultiMedia.

[56]  Tarik Taleb,et al.  Service Function Chaining in Next Generation Networks: State of the Art and Research Challenges , 2017, IEEE Communications Magazine.

[57]  Julije Ozegovic,et al.  Enhancing VNF's performance using DPDK driven OVS user-space forwarding , 2017, 2017 25th International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[58]  Fulvio Risso,et al.  Accelerating Linux Security with eBPF iptables , 2018, SIGCOMM Posters and Demos.

[59]  Tarik Taleb,et al.  Performance benchmark of transcoding as a virtual network function in CDN as a service slicing , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[60]  Tarik Taleb,et al.  Follow me cloud: interworking federated clouds and distributed mobile networks , 2013, IEEE Network.

[61]  Jianping Wu,et al.  HyperVDP: High-Performance Virtualization of the Programmable Data Plane , 2019, IEEE Journal on Selected Areas in Communications.

[62]  James Won-Ki Hong,et al.  Architecture for building hybrid kernel-user space virtual network functions , 2017, 2017 13th International Conference on Network and Service Management (CNSM).

[63]  Daniel Raumer,et al.  Performance Implications of Packet Filtering with Linux eBPF , 2018, 2018 30th International Teletraffic Congress (ITC 30).

[64]  Muriel Medard,et al.  Tunable sparse network coding , 2012 .

[65]  Albert Y. Zomaya,et al.  Virtual Network Function Placement: Towards Minimizing Network Latency and Lead Time , 2017, 2017 IEEE International Conference on Cloud Computing Technology and Science (CloudCom).

[66]  Zongpeng Li,et al.  Virtualized Network Coding Functions on the Internet , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[67]  Bo Yi,et al.  Dynamic heuristic for the recomposition of service function chain , 2018, IET Commun..

[68]  Franck Le,et al.  NFVactor: A Resilient NFV System Using the Distributed Actor Model , 2018, IEEE Journal on Selected Areas in Communications.

[69]  Xiao Xu,et al.  Toward Haptic Communications Over the 5G Tactile Internet , 2018, IEEE Communications Surveys & Tutorials.

[70]  Leonardo Linguaglossa,et al.  High-speed data plane and network functions virtualization by vectorizing packet processing , 2019, Comput. Networks.

[71]  Giuseppe Durisi,et al.  Short-Packet Communications Over Multiple-Antenna Rayleigh-Fading Channels , 2016, IEEE Transactions on Communications.

[72]  Franck Le,et al.  NetStar: A Future/Promise Framework for Asynchronous Network Functions , 2019, IEEE Journal on Selected Areas in Communications.

[73]  Chen Ding,et al.  Quantifying the cost of context switch , 2007, ExpCS '07.

[74]  Tarik Taleb,et al.  Coalitional Game for the Creation of Efficient Virtual Core Network Slices in 5G Mobile Systems , 2018, IEEE Journal on Selected Areas in Communications.

[75]  Martin Reisslein,et al.  Ultra-Low Latency (ULL) Networks: The IEEE TSN and IETF DetNet Standards and Related 5G ULL Research , 2018, IEEE Communications Surveys & Tutorials.

[76]  Victor C. M. Leung,et al.  Network Slicing Based 5G and Future Mobile Networks: Mobility, Resource Management, and Challenges , 2017, IEEE Communications Magazine.

[77]  Min Chen,et al.  Cloud-based Wireless Network: Virtualized, Reconfigurable, Smart Wireless Network to Enable 5G Technologies , 2015, Mob. Networks Appl..

[78]  Alberto Ceselli,et al.  T-NOVA: An Open-Source MANO Stack for NFV Infrastructures , 2017, IEEE Transactions on Network and Service Management.

[79]  Tao Zhang,et al.  Ultra-Low Latency Mobile Networking , 2019, IEEE Network.

[80]  Wolfgang Kellerer,et al.  Adaptable and Data-Driven Softwarized Networks: Review, Opportunities, and Challenges , 2019, Proceedings of the IEEE.

[81]  Frank H. P. Fitzek,et al.  Caterpillar RLNC (CRLNC): A Practical Finite Sliding Window RLNC Approach , 2017, IEEE Access.

[82]  Muhammad Hamad Alizai,et al.  InKeV: in-kernel distributed network virtualization for DCN , 2018, CCRV.

[83]  Yang Hu,et al.  Towards "Full Containerization" in Containerized Network Function Virtualization , 2017, ASPLOS.

[84]  Tracey Ho,et al.  A Random Linear Network Coding Approach to Multicast , 2006, IEEE Transactions on Information Theory.

[85]  Chadi Assi,et al.  Dynamic Task Offloading and Scheduling for Low-Latency IoT Services in Multi-Access Edge Computing , 2019, IEEE Journal on Selected Areas in Communications.

[86]  Daniel Raumer,et al.  Feasibility of Compound Chained Network Functions for Flexible Packet Processing , 2017 .

[87]  Francesco Musumeci,et al.  Virtual-network-function placement for dynamic service chaining in metro-area networks , 2018, 2018 International Conference on Optical Network Design and Modeling (ONDM).

[88]  Qian Xu,et al.  Resource Capacity Analysis in Network Slicing with Ensured End-to-End Performance Bound , 2018, 2018 IEEE International Conference on Communications (ICC).

[89]  Alexandros G. Dimakis,et al.  Network Coding for Distributed Storage Systems , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[90]  Jan Rüth,et al.  SymPerf: Predicting Network Function Performance , 2017, SIGCOMM Posters and Demos.

[91]  Baochun Li,et al.  How Practical is Network Coding? , 2006, 200614th IEEE International Workshop on Quality of Service.

[92]  José Luis García-Dorado,et al.  High-Performance Network Traffic Processing Systems Using Commodity Hardware , 2013, Data Traffic Monitoring and Analysis.

[93]  Tarik Taleb,et al.  Optimal VNFs Placement in CDN Slicing Over Multi-Cloud Environment , 2018, IEEE Journal on Selected Areas in Communications.

[94]  Stuart Cheshire,et al.  Latency and the quest for interactivity , 1996 .

[95]  K. Jain,et al.  Practical Network Coding , 2003 .

[96]  Weifa Liang,et al.  Algorithms for Fault-Tolerant Placement of Stateful Virtualized Network Functions , 2018, 2018 IEEE International Conference on Communications (ICC).

[97]  Zaher Dawy,et al.  The IEEE 1918.1 “Tactile Internet” Standards Working Group and its Standards , 2019, Proceedings of the IEEE.

[98]  Saeedeh Parsaeefard,et al.  vSPACE: VNF Simultaneous Placement, Admission Control and Embedding , 2018, IEEE Journal on Selected Areas in Communications.

[99]  Fulvio Risso,et al.  Creating Complex Network Services with eBPF: Experience and Lessons Learned , 2018, 2018 IEEE 19th International Conference on High Performance Switching and Routing (HPSR).

[100]  Tarik Taleb,et al.  On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration , 2017, IEEE Communications Surveys & Tutorials.

[101]  Frank H. P. Fitzek,et al.  PACE: Redundancy Engineering in RLNC for Low-Latency Communication , 2017, IEEE Access.

[102]  Jörg Widmer,et al.  Effective Delay Control in Online Network Coding , 2009, IEEE INFOCOM 2009.

[103]  Raouf Boutaba,et al.  UNiS: A User-space Non-intrusive Workflow-aware Virtual Network Function Scheduler , 2018, 2018 14th International Conference on Network and Service Management (CNSM).

[104]  Morten Videbæk Pedersen,et al.  Kodo: An Open and Research Oriented Network Coding Library , 2011, Networking Workshops.

[105]  Christian Esteve Rothenberg,et al.  Network Service Orchestration: A Survey , 2018, Comput. Commun..

[106]  Dipak Ghosal,et al.  A Survey of End-System Optimizations for High-Speed Networks , 2018, ACM Comput. Surv..

[107]  Vasilis Friderikos,et al.  Delay Sensitive Virtual Network Function Placement and Routing , 2018, 2018 25th International Conference on Telecommunications (ICT).

[108]  Douglas J. Leith,et al.  Low delay random linear coding over a stream , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[109]  K. K. Ramakrishnan,et al.  OpenNetVM: A Platform for High Performance Network Service Chains , 2016, HotMiddlebox@SIGCOMM.

[110]  Xin Wang,et al.  Distributed Placement and Online Optimization of Virtual Machines for Network Service Chains , 2018, 2018 IEEE International Conference on Communications (ICC).

[111]  K. K. Ramakrishnan,et al.  NetVM: High Performance and Flexible Networking Using Virtualization on Commodity Platforms , 2014, IEEE Transactions on Network and Service Management.

[112]  Tarik Taleb,et al.  EASE: EPC as a service to ease mobile core network deployment over cloud , 2015, IEEE Network.

[113]  Jun Bi,et al.  Tripod: Towards a Scalable, Efficient and Resilient Cloud Gateway , 2019, IEEE Journal on Selected Areas in Communications.

[114]  Al Morton Considerations for Benchmarking Virtual Network Functions and Their Infrastructure , 2017, RFC.

[115]  EDDIE KOHLER,et al.  The click modular router , 2000, TOCS.

[116]  Swades De,et al.  VNF Placement and Resource Allocation for the Support of Vertical Services in 5G Networks , 2018, IEEE/ACM Transactions on Networking.

[117]  Chadi Assi,et al.  Delay-Aware Scheduling and Resource Optimization With Network Function Virtualization , 2016, IEEE Transactions on Communications.

[118]  Frank H. P. Fitzek,et al.  Practical deployment of network coding for real-time applications in 5G networks , 2018, 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[119]  Huijun Gao,et al.  Network-Induced Constraints in Networked Control Systems—A Survey , 2013, IEEE Transactions on Industrial Informatics.

[120]  Carlos Galdamez,et al.  On efficient virtual network function chaining in NFV-based telecommunications networks , 2018, Cluster Computing.

[121]  Shui Yu,et al.  Tuna: An Efficient and Practical Scheme for Wireless Access Point in 5G Networks Virtualization , 2018, IEEE Communications Letters.

[122]  Francesco Musumeci,et al.  Protection strategies for virtual network functions placement and service chains provisioning , 2017, Networks.

[123]  Kate Ching-Ju Lin,et al.  Deploying chains of virtual network functions: On the relation between link and server usage , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[124]  Biswanath Mukherjee,et al.  On service-chaining strategies using Virtual Network Functions in operator networks , 2016, Comput. Networks.

[125]  Georgios Xilouris,et al.  Enhancing VNF performance by exploiting SR-IOV and DPDK packet processing acceleration , 2015, 2015 IEEE Conference on Network Function Virtualization and Software Defined Network (NFV-SDN).

[126]  Sebastian Gallenmüller,et al.  High-performance packet processing and measurements , 2018, 2018 10th International Conference on Communication Systems & Networks (COMSNETS).

[127]  Daniel Raumer,et al.  Comparison of frameworks for high-performance packet IO , 2015, 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[128]  Frank H. P. Fitzek,et al.  Latency Measurement of Service Function Chaining on OpenStack Platform , 2018, 2018 IEEE 43rd Conference on Local Computer Networks (LCN).

[129]  Daniel Raumer,et al.  Throughput and Latency of Virtual Switching with Open vSwitch: A Quantitative Analysis , 2018, Journal of Network and Systems Management.