A high-speed cheetah flow identification network function (CFINF)

Cheetah flows, which are high-rate flows, can cause increased packet delays and losses in other flows. Leveraging the flexibility offered by the NFV paradigm, our proposed Cheetah Flow Identification Network Function (CFINF) uses a novel method in which a new measure, short-duration flight rate, which is the rate of a flight of packets received over a fixed (short) time interval, is computed and compared against a threshold to identify cheetah flows from packets mirrored to the CFINF by a router. A Cheetah Flow Traffic Engineering System (CFTES) and SDN controller use the CFINF-identified cheetah flow identifiers to set filter rules in the router to isolate cheetah-flow packets. We evaluated the CFINF on a commodity ×86 processor based server. When using 10 cores, CFINF could handle a 1-min 10-Gbps real Center for Applied Internet Data Analysis (CAIDA) traffic trace that contained 1.5M flows and 38M packets. To improve efficiency, we ran CFINF in an 8-core configuration. However, there were packet drops (max. rate of 0.036%) with this configuration. When we added an optimization, i.e., flows with only small packets were filtered out, the median number of CFINF-dropped packets fell by 83%, with only 10% loss in accuracy of reported cheetahs.

[1]  Shigeki Goto,et al.  Identifying elephant flows through periodically sampled packets , 2004, IMC '04.

[2]  Viktor K. Prasanna,et al.  High Throughput Sketch Based Online Heavy Hitter Detection on FPGA , 2016, SIGARCH Comput. Archit. News.

[3]  Kun-Chan Lan,et al.  A measurement study of correlations of Internet flow characteristics , 2006, Comput. Networks.

[4]  A. Bechtolsheim,et al.  Why Big Data Needs Big Buffer Switches , 2016 .

[5]  Scott Shenker,et al.  On the characteristics and origins of internet flow rates , 2002, SIGCOMM.

[6]  Hao Wu,et al.  Efficient Large Flow Detection over Arbitrary Windows: An Algorithm Exact Outside an Ambiguity Region , 2014, Internet Measurement Conference.

[7]  Luca Deri,et al.  High speed network traffic analysis with commodity multi-core systems , 2010, IMC '10.

[8]  Hong Liu,et al.  Predicting Inter-Data-Center Network Traffic Using Elephant Flow and Sublink Information , 2016, IEEE Transactions on Network and Service Management.

[9]  Benoit Claise,et al.  Specification of the IP Flow Information Export (IPFIX) Protocol for the Exchange of IP Traffic Flow Information , 2008, RFC.

[10]  Saverio Niccolini,et al.  Implementation of an IPFIX compliant flow traffic meter: challenges and performance assessment , 2003, Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM 2003) (IEEE Cat. No.03EX764).

[11]  Malathi Veeraraghavan,et al.  On How to Provision Quality of Service (QoS) for Large Dataset Transfers , 2013 .

[12]  Yi Lu,et al.  ElephantTrap: A low cost device for identifying large flows , 2007, 15th Annual IEEE Symposium on High-Performance Interconnects (HOTI 2007).

[13]  Tatsuya Mori,et al.  Simple and Accurate Identification of High-Rate Flows by Packet Sampling , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[14]  Zhen Zhang,et al.  Identifying elephant flows in internet backbone traffic with bloom filters and LRU , 2015, Comput. Commun..

[15]  Min Chen,et al.  Software-Defined Network Function Virtualization: A Survey , 2015, IEEE Access.

[16]  Yongzheng Zhang,et al.  Identifying high-rate flows based on Bayesian single sampling , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[17]  Chita R. Das,et al.  Design of a Dynamic Priority-Based Fast Path Architecture for On-Chip Interconnects , 2007 .

[18]  Filip De Turck,et al.  Network Function Virtualization: State-of-the-Art and Research Challenges , 2015, IEEE Communications Surveys & Tutorials.

[19]  Benoit Claise,et al.  Specification of the IP Flow Information Export (IPFIX) Protocol for the Exchange of Flow Information , 2013, RFC.

[20]  Srinivas Shakkottai,et al.  A Study of Burstiness in TCP Flows , 2005, PAM.

[21]  Fang Hao,et al.  Fast, memory-efficient traffic estimation by coincidence counting , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[22]  Richard A. Lethin,et al.  High-performance many-core networking: design and implementation , 2015, INDIS '15.