Performance benchmarking of a software-based LTE SGW

Network Functions Virtualization (NFV) is a concept that aims at providing network operators with benefits in terms of cost, flexibility, and vendor independence by utilizing virtualization techniques to run network functions as software on commercial off-the-shelf (COTS) hardware. In contrast, prior solutions rely on specialized hardware for each function. Performance evaluation of such systems usually requires a dedicated testbed for each individual component. Rather than analyzing these proprietary black-box components, Virtualized Network Functions (VNFs) are pieces of software that run on COTS hardware and whose properties can be investigated in a generic testbed. However, depending on the underlying hardware, operating system, and implementation, VNFs might behave differently. Therefore, mechanisms for the performance evaluation of VNFs should be similar to benchmarking of software, where different implementations are compared by applying them to predefined test cases and scenarios. This work presents a first step towards a benchmarking framework for VNFs. Given two different implementations of a VNF that acts as LTE Serving Gateway (SGW), influence factors and key performance indicators are identified and a comparison between the two mechanisms is drawn.

[1]  Scott O. Bradner,et al.  Benchmarking Methodology for Network Interconnect Devices , 1999, RFC.

[2]  Jamal Hadi Salim,et al.  Beyond Softnet , 2001, Annual Linux Showcase & Conference.

[3]  Carlos Pignataro,et al.  Device Reset Characterization , 2011, RFC.

[4]  Luigi Rizzo,et al.  netmap: A Novel Framework for Fast Packet I/O , 2012, USENIX ATC.

[5]  Scott O. Bradner,et al.  Applicability Statement for RFC 2544: Use on Production Networks Considered Harmful , 2012, RFC.

[6]  Yuping Zhao,et al.  OpenANFV: accelerating network function virtualization with a consolidated framework in openstack , 2015, SIGCOMM 2015.

[7]  Paul Chow,et al.  FPGAs in the Cloud: Booting Virtualized Hardware Accelerators with OpenStack , 2014, FCCM 2014.

[8]  Daniel Raumer,et al.  Performance characteristics of virtual switching , 2014, 2014 IEEE 3rd International Conference on Cloud Networking (CloudNet).

[9]  Roberto Bifulco,et al.  ClickOS and the Art of Network Function Virtualization , 2014, NSDI.

[10]  K. K. Ramakrishnan,et al.  NetVM: High Performance and Flexible Networking Using Virtualization on Commodity Platforms , 2014, IEEE Transactions on Network and Service Management.

[11]  Antonio Ken Iannillo,et al.  Dependability evaluation and benchmarking of Network Function Virtualization Infrastructures , 2015, Proceedings of the 2015 1st IEEE Conference on Network Softwarization (NetSoft).

[12]  Jinwei Xia,et al.  Uniform handling and abstraction of NFV hardware accelerators , 2015, IEEE Network.

[13]  David Hausheer,et al.  Open, elastic provisioning of hardware acceleration in NFV environments , 2015, 2015 International Conference and Workshops on Networked Systems (NetSys).

[14]  Daniel Raumer,et al.  Comparison of frameworks for high-performance packet IO , 2015, 2015 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[15]  Al Morton Considerations for Benchmarking Virtual Network Functions and Their Infrastructure , 2017, RFC.