How to validate traffic generators?

Network traffic generators are widely used in networking research and they are validated by a very broad range of metrics (mainly traffic characteristics). In this paper we overview the state of the art of these metrics and unveil that there is no consensus in the research community how to validate these traffic generators and which metric to choose for validation purpose. This situation makes it extremely difficult to evaluate validation results and compare different traffic generators. We advocate the research for finding a common set of metrics for the validation and comparative evaluation of traffic generators.

[1]  Sebastian Zander,et al.  KUTE A high performance Kernel-based UDP traffic engine , 2005 .

[2]  S. Giordano,et al.  BRUNO: A high performance traffic generator for network processor , 2008, 2008 International Symposium on Performance Evaluation of Computer and Telecommunication Systems.

[3]  Bruno Baynat,et al.  Using LiTGen, a realistic IP traffic model, to evaluate the impact of burstiness on performance , 2008, SimuTools.

[4]  Paul Barford,et al.  Self-configuring network traffic generation , 2004, IMC '04.

[5]  Michele C. Weigle,et al.  Tmix: a tool for generating realistic TCP application workloads in ns-2 , 2006, CCRV.

[6]  Torsten Braun,et al.  A flow trace generator using graph-based traffic classification techniques , 2010, IWCMC.

[7]  Klaus Wehrle,et al.  Proceedings of the ACM SIGCOMM workshop on Models, methods and tools for reproducible network research , 2003, SOSP 2003.

[8]  Giordano Stefano,et al.  BRUTE: A High Performance and Extensibile Traffic Generator , 2005 .

[9]  R. Khayari,et al.  ParaSynTG: A parameterized synthetic trace generator for representation of WWW traffic , 2008, 2008 International Symposium on Performance Evaluation of Computer and Telecommunication Systems.

[10]  Amin Vahdat,et al.  Swing: Realistic and Responsive Network Traffic Generation , 2009, IEEE/ACM Transactions on Networking.

[11]  Francis Lepage,et al.  Application-oriented network metrology: metrics and active measurement tools , 2005, IEEE Communications Surveys & Tutorials.

[12]  Kate Ching-Ju Lin,et al.  Real traffic replay over WLAN with environment emulation , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[13]  Abdolreza Abhari,et al.  Workload generation for YouTube , 2009, Multimedia Tools and Applications.

[14]  Wu-chi Feng,et al.  TCPivo: a high-performance packet replay engine , 2003, MoMeTools '03.

[15]  Tao Ye,et al.  Divide and conquer: PC-based packet trace replay at OC-48 speeds , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.

[16]  Patrice Abry,et al.  Wavelets for the Analysis, Estimation, and Synthesis of Scaling Data , 2002 .

[17]  Antonio Pescapè,et al.  Do you trust your software-based traffic generator? , 2010, IEEE Communications Magazine.

[18]  Antonio Pescapè,et al.  A tool for the generation of realistic network workload for emerging networking scenarios , 2012, Comput. Networks.