Traffic engineering of high-rate large-sized flows

High-rate large-sized (α) flows have adverse effects on delay-sensitive flows. Research-and-education network providers are interested in identifying such flows within their networks, and directing these flows to traffic-engineered QoS-controlled virtual circuits. To achieve this goal, a design is proposed for a hybrid network traffic engineering system (HNTES) that would run on an external server, gather NetFlow reports from routers, analyze these reports to identify α-flow source/destination address prefixes, configure firewall filter rules at ingress routers to extract future flows and redirect them to previously provisioned intra-domain virtual circuits. This paper presents an evaluation of this HNTES design using NetFlow reports collected over a 7-month period from four ESnet routers. Our analysis shows that had HNTES been deployed, it would have been highly effective, e.g., > 90% of α-bytes that arrived at the four routers over the 7-month period would have been redirected to virtual circuits. Design aspects such as whether to use /24 subnet IDs or /32 addresses in firewall filters, and which router interfaces' NetFlow reports to include in the HNTES analysis, are studied.

[1]  Hao Wu,et al.  Tracking millions of flows in high speed networks for application identification , 2012, 2012 Proceedings IEEE INFOCOM.

[2]  Konstantina Papagiannaki,et al.  A pragmatic definition of elephants in internet backbone traffic , 2002, IMW '02.

[3]  Malathi Veeraraghavan,et al.  On How to Provision Quality of Service (QoS) for Large Dataset Transfers , 2013 .

[4]  Anja Feldmann,et al.  A methodology for studying persistency aspects of internet flows , 2005, CCRV.

[5]  Chin Guok,et al.  Inter-domain Controller (IDC) Protocol Specification , 2008 .

[6]  Pere Barlet-Ros,et al.  Traffic Classification with Sampled NetFlow , 2009 .

[7]  Matthew Roughan,et al.  Class-of-service mapping for QoS: a statistical signature-based approach to IP traffic classification , 2004, IMC '04.

[8]  Richard G. Baraniuk,et al.  Connection-level analysis and modeling of network traffic , 2001, IMW '01.

[9]  Marco Canini,et al.  Tracking elephant flows in internet backbone traffic with an FPGA-based cache , 2009, 2009 International Conference on Field Programmable Logic and Applications.

[10]  Dario Rossi,et al.  Fine-grained traffic classification with netflow data , 2010, IWCMC.

[11]  Malathi Veeraraghavan,et al.  A hybrid network traffic engineering system , 2012, 2012 IEEE 13th International Conference on High Performance Switching and Routing.

[12]  C.-C. Jay Kuo,et al.  Internet Traffic Classification for Scalable QOS Provision , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  Grenville J. Armitage,et al.  A survey of techniques for internet traffic classification using machine learning , 2008, IEEE Communications Surveys & Tutorials.

[14]  Kun-Chan Lan,et al.  A measurement study of correlations of Internet flow characteristics , 2006, Comput. Networks.