Looking Glass of NFV: Inferring the Structure and State of NFV Network from External Observations

The rapid development of network function virtualization (NFV) enables a communication network to provide in-network services using virtual network functions (VNFs) deployed on general IT hardware. While existing studies on NFV focused on how to provision VNFs from the provider’s perspective, little is known about how to validate the provisioned resources from the user’s perspective. In this work, we take a first step towards this problem by developing an inference framework designed to “look into” the NFV network. Our framework infers the structure and state of the overlay formed by VNF instances, ingress/egress points of measurement flows, and critical points on their paths (branching/joining points). Our solution only uses external observations such as the required service chains and the end-to-end performance measurements. Besides the novel application scenario, our work also fundamentally advances the state of the art on topology discovery by considering (i) general topologies with general measurement paths, and (ii) information of service chains. Evaluations based on real network topologies show that the proposed solution significantly improves the accuracy over existing solutions, and service chaining information is critical in revealing the structure of the underlying topology.

[1]  Jian Ni,et al.  Network tomography based on additive metrics , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[2]  Ratul Mahajan,et al.  Measuring ISP topologies with Rocketfuel , 2004, IEEE/ACM Transactions on Networking.

[3]  Rong Zheng,et al.  A Binary Independent Component Analysis Approach to Tree Topology Inference , 2013, IEEE Transactions on Signal Processing.

[4]  Kate Ching-Ju Lin,et al.  Deploying chains of virtual network functions: On the relation between link and server usage , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[5]  Robert D. Nowak,et al.  Multiple-Source Internet Tomography , 2006, IEEE Journal on Selected Areas in Communications.

[6]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[7]  Jaime Llorca,et al.  Approximation algorithms for the NFV service distribution problem , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[8]  Alexandre P. Francisco,et al.  Not Seeing the Forest for the Trees: Size of the Minimum Spanning Trees (MSTs) Forest and Branch Significance in MST-Based Phylogenetic Analysis , 2015, PloS one.

[9]  Donald F. Towsley,et al.  Multicast topology inference from measured end-to-end loss , 2002, IEEE Trans. Inf. Theory.

[10]  Nick G. Duffield,et al.  Network tomography from measured end-to-end delay covariance , 2004, IEEE/ACM Transactions on Networking.

[11]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[12]  Robert D. Nowak,et al.  Maximum likelihood network topology identification from edge-based unicast measurements , 2002, SIGMETRICS '02.

[13]  Nick G. Duffield,et al.  Adaptive multicast topology inference , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[14]  Aditya Akella,et al.  On the treeness of internet latency and bandwidth , 2009, SIGMETRICS '09.

[15]  Akshay Krishnamurthy,et al.  Robust multi-source network tomography using selective probes , 2012, 2012 Proceedings IEEE INFOCOM.

[16]  Sylvia Ratnasamy,et al.  A Survey of Enterprise Middlebox Deployments , 2012 .

[17]  Athina Markopoulou,et al.  Active Learning of Multiple Source Multiple Destination Topologies , 2013, IEEE Transactions on Signal Processing.

[18]  Donald F. Towsley,et al.  OCCAM: An Optimization Based Approach to Network Inference , 2018, PERV.

[19]  Jaime Llorca,et al.  The cloud service distribution problem in distributed cloud networks , 2015, 2015 IEEE International Conference on Communications (ICC).

[20]  Ram Rajagopal,et al.  Network delay inference from additive metrics , 2006, Random Struct. Algorithms.

[21]  Darryl Veitch,et al.  Finding the Right Tree: Topology Inference Despite Spatial Dependences , 2018, IEEE Transactions on Information Theory.

[22]  Avinatan Hassidim,et al.  Topology discovery of sparse random graphs with few participants , 2011, SIGMETRICS '11.

[23]  Tamás Lukovszki,et al.  Online Admission Control and Embedding of Service Chains , 2015, SIROCCO.

[24]  Don Towsley,et al.  Multicast Topology Inference from End-to-end Measurements , 2013 .

[25]  Jian Ni,et al.  Efficient and Dynamic Routing Topology Inference From End-to-End Measurements , 2010, IEEE/ACM Transactions on Networking.

[26]  Shiqiang Wang,et al.  Looking Glass of NFV: Inferring the Structure and State of NFV Network From External Observations , 2020, IEEE/ACM Transactions on Networking.

[27]  Filip De Turck,et al.  VNF-P: A model for efficient placement of virtualized network functions , 2014, 10th International Conference on Network and Service Management (CNSM) and Workshop.

[28]  Jithin Ravi,et al.  Exact topology inference for DAGs using network coding , 2012, 2012 International Symposium on Network Coding (NetCod).

[29]  Raouf Boutaba,et al.  On orchestrating virtual network functions , 2015, 2015 11th International Conference on Network and Service Management (CNSM).

[30]  Kyriakos Manousakis,et al.  Graph reconstruction from path correlation data , 2018, Inverse Problems.

[31]  Christina Fragouli,et al.  Active topology inference using network coding , 2010, Phys. Commun..

[32]  Joseph Naor,et al.  Near optimal placement of virtual network functions , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[33]  N. Duffield,et al.  Network loss tomography using striped unicast probes , 2006, IEEE/ACM Transactions on Networking.

[34]  Robert D. Nowak,et al.  Likelihood based hierarchical clustering , 2004, IEEE Transactions on Signal Processing.

[35]  Steven McCanne,et al.  Inference of multicast routing trees and bottleneck bandwidths using end-to-end measurements , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[36]  Holger Karl,et al.  Specifying and placing chains of virtual network functions , 2014, 2014 IEEE 3rd International Conference on Cloud Networking (CloudNet).

[37]  Robert D. Nowak,et al.  Multiple source, multiple destination network tomography , 2004, IEEE INFOCOM 2004.

[38]  Paul Barford,et al.  Network discovery from passive measurements , 2008, SIGCOMM '08.

[39]  Meral Shirazipour,et al.  Network Function Placement for NFV Chaining in Packet/Optical Datacenters , 2015, Journal of Lightwave Technology.

[40]  R. Caceres,et al.  Loss-based inference of multicast network topology , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).