Metroflux: A high performance system for analysing flow at very fine-grain

Researches in network traffic analysis embrace a large diversity of goals and are based on a variety of methodologies and tools. To have a better insight on the real nature and on the evolution of network traffic we argue that fine-grain analysis of real traffic traces have to complement simulations studies as well as coarse grain measurement performed by classical flow measurement systems. In particular, packet level measurements and analysis are needed. However, such methodologies are resource consuming and require very high performance devices to be operational in real high speed networks. In this paper we present the Metroflux system which aims at providing researchers and network operators with a very flexible and accurate packet-level traffic analysis toolkit configured for 1 Gbps and 10 Gbps speed links. This system is based on the GtrcNet FPGA-based device technology and on specific statistical analysis tools. We show that the association of the unique fully reconfigurable grid testbed Grid5000 (up to 5000 independant high speed fully controllable sources) with a highly flexible packet capture tool allows us to achieve a unique and innovative large scale experimental potential. We also present the Network eXperiment Engine (NXE) we have developed to automate the excecution of experiments in real networks. We illustrate the application of the Metroflux system with the practical validation of the theoretical prediction relating self-similarity and heavy tails given by Taqqu theorem. We also illustrate several usages of this toolset, such as the investigation of conditions under which several traffic theories apply, as well as studies on traffic, protocols and systems interactions.

[1]  P. Gonçalves,et al.  Diverging Moments and Parameter Estimation , 2005 .

[2]  Paulo Gonçalves,et al.  Investigating Self-Similarity and Heavy-Tailed Distributions on a Large-Scale Experimental Facility , 2010, IEEE/ACM Transactions on Networking.

[3]  Franck Cappello,et al.  Grid'5000: A Large Scale And Highly Reconfigurable Experimental Grid Testbed , 2006, Int. J. High Perform. Comput. Appl..

[4]  David L. Mills,et al.  Network Time Protocol (Version 3) Specification, Implementation and Analysis , 1992, RFC.

[5]  Pascale Vicat-Blanc Primet,et al.  Methodologies and Tools for Exploring Transport Protocols in the Context of High-Speed Networks , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[6]  Stéphane Girard,et al.  Maximum likelihood estimation of the flow size distribution tail index from sampled packet data , 2009, SIGMETRICS '09.

[7]  M. Arlitt,et al.  Full Packet Capture and Offline Analysis on 1 and 10 Gb/s Networks , 2006 .

[8]  Anja Feldmann,et al.  Packet Capture in 10-Gigabit Ethernet Environments Using Contemporary Commodity Hardware , 2007, PAM.

[9]  Evangelos P. Markatos,et al.  Design of an application programming interface for IP network monitoring , 2004, 2004 IEEE/IFIP Network Operations and Management Symposium (IEEE Cat. No.04CH37507).

[10]  Walter Willinger,et al.  Proof of a fundamental result in self-similar traffic modeling , 1997, CCRV.

[11]  Patrice Abry,et al.  Wavelets for the Analysis, Estimation, and Synthesis of Scaling Data , 2002 .

[12]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[13]  Yuetsu Kodama,et al.  GNET-1: gigabit Ethernet network testbed , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).