Verification of Network Simulators : The good, the bad and the ugly

The purpose of a simulation is to try to get an indication on how a given system will behave in a range of different scenarios. For this kind of research to have any value, it is important that the simulator models reality in a reliable way. In this thesis, we have chosen a common test suite through which we evaluate the TCP functionality of three major opensource simulators: ns-2, ns-3 and OMNeT++. As our set of test cases, we have used the TCP evaluation suite, which is meant to become a standardized test suite for evaluating TCP extensions. The suite already exists for ns-2, while we have implemented elements of the suite in both ns3, and in OMNeT++. As a consequence of this, we have had to implement the tmix traffic generator as well for OMNeT++, and we have also worked on improving tmix for ns-3. These implementations of the test suite lead to some interesting observations regarding the TCP functionality of each network simulator. Through working with the test suite however, we have revealed several weaknesses in it. We have identified a range of items that need improvement before the test suite may become a useful tool.

[1]  Michele C. Weigle,et al.  Tmix: a tool for generating realistic TCP application workloads in ns-2 , 2006, CCRV.

[2]  Sally Floyd,et al.  Simulation-based comparisons of Tahoe, Reno and SACK TCP , 1996, CCRV.

[3]  Lachlan L. H. Andrew,et al.  Common TCP Evaluation Suite , 2009 .

[4]  Lixia Zhang,et al.  Stream Control Transmission Protocol , 2000, RFC.

[5]  Teerawat Issariyakul,et al.  Introduction to Network Simulator NS2 , 2008 .

[6]  W. Makasiranondh,et al.  Pedagogical evaluation of simulation tools usage in Network Technology Education , 2010 .

[7]  Vern Paxson,et al.  End-to-end Internet packet dynamics , 1997, SIGCOMM '97.

[8]  Wang Jun,et al.  Application of NS2 in Education of Computer Networks , 2008, 2008 International Conference on Advanced Computer Theory and Engineering.

[9]  Doreid Ammar,et al.  A new tool for generating realistic internet traffic in NS-3 , 2011, SimuTools.

[10]  Colin Allison,et al.  A comparison of TCP behaviour at high speeds using ns-2 and Linux , 2008, CNS '08.

[11]  Injong Rhee,et al.  Towards a common TCP evaluation suite , 2008 .

[12]  Sally Floyd,et al.  Difficulties in simulating the internet , 2001, TNET.

[13]  Anthony McGregor,et al.  Validation of simulated real world TCP stacks , 2007, 2007 Winter Simulation Conference.

[14]  Klaus Wehrle,et al.  Modeling and Tools for Network Simulation , 2010, Modeling and Tools for Network Simulation.

[15]  John Nagle,et al.  Congestion control in IP/TCP internetworks , 1995, CCRV.