OTMEN: Offloading Traffic Monitoring to Edge Nodes in Software-Defined Datacenter Networks

Network traffic monitoring is an essential component of many SDN applications, especially in the datacenter environment, where tenants' applications are often distributed over the computing resources. The conventional SDN procedures for flow-level monitoring force the network controller to install fine-grained forwarding rules on switches for the initiated flows, and they rely on the pull-based mechanism to collect traffic statistics from the network switches. Such an approach overwhelms the controller and faces challenges when deployed in datacenter networks, which can have millions of distinct active flows per second. Therefore, in this paper, we introduce the design and implementation of OTMEN, a scalable traffic monitoring system for SDN-enabled datacenter networks. OTMEN decouples the forwarding and monitoring configurations in the data plane to relax the controller, while allowing fine-grained flow-level monitoring at the edge switches. In the OTMEN system, the controller can offload traffic monitoring operations to edge nodes based on the monitoring rules as it provides a rich set of RESTful APIs for monitoring applications. We evaluated our proposed system on a realistic testbed, and the results show that OTMEN provides significant improvements and monitoring overhead reduction compared to the existing solutions.

[1]  Xiang-Yang Li,et al.  Minimizing Flow Statistics Collection Cost Using Wildcard-Based Requests in SDNs , 2017, IEEE/ACM Transactions on Networking.

[2]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[3]  Qiang Xu,et al.  Software-Defined Latency Monitoring in Data Center Networks , 2015, PAM.

[4]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[5]  Ramesh Govindan,et al.  Trumpet: Timely and Precise Triggers in Data Centers , 2016, SIGCOMM.

[6]  Ying Zhang,et al.  An adaptive flow counting method for anomaly detection in SDN , 2013, CoNEXT.

[7]  Lawrence Kreeger,et al.  Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks , 2014, RFC.

[8]  Raouf Boutaba,et al.  PayLess: A low cost network monitoring framework for Software Defined Networks , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[9]  Xin Li,et al.  Distributed and collaborative traffic monitoring in software defined networks , 2014, HotSDN.

[10]  Praveen Yalagandula,et al.  Mahout: Low-overhead datacenter traffic management using end-host-based elephant detection , 2011, 2011 Proceedings IEEE INFOCOM.

[11]  Martín Casado,et al.  Network Virtualization in Multi-tenant Datacenters , 2014, NSDI.

[12]  Shicong Meng,et al.  Enhanced Monitoring-as-a-Service for Effective Cloud Management , 2013, IEEE Transactions on Computers.

[13]  C. Edward Chow,et al.  Pathseer: a centralized tracer of packet trajectories in software-defined datacenter networks , 2016, 2016 Principles, Systems and Applications of IP Telecommunications (IPTComm).

[14]  Rafael Rodrigues Obelheiro,et al.  Escada: Predicting Virtual Machine Network Bandwidth Demands for Elastic Provisioning in IaaS Clouds , 2017, 2017 International Conference on Cloud and Autonomic Computing (ICCAC).

[15]  Pankaj Garg,et al.  NVGRE: Network Virtualization Using Generic Routing Encapsulation , 2015, RFC.

[16]  Minlan Yu,et al.  HONE: Joint Host-Network Traffic Management in Software-Defined Networks , 2014, Journal of Network and Systems Management.

[17]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[18]  Yehuda Afek,et al.  Sampling and Large Flow Detection in SDN , 2015, SIGCOMM.

[19]  Fernando A. Kuipers,et al.  OpenNetMon: Network monitoring in OpenFlow Software-Defined Networks , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[20]  Vijay Mann,et al.  Living on the edge: Monitoring network flows at the edge in cloud data centers , 2013, 2013 Fifth International Conference on Communication Systems and Networks (COMSNETS).

[21]  Daniel S. Marcon,et al.  Achieving minimum bandwidth guarantees and work-conservation in large-scale, SDN-based datacenter networks , 2017, Comput. Networks.

[22]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.