ROSENET: a remote server-based network emulation system

Network emulation has been widely used to aid in the development and evaluation of real-time applications. Many of today's applications and protocols need to be tested and evaluated in large scale network environments such as the Internet, which requires emulation tools that meet the requirements of scale, accuracy, timeliness. Due to physical resource constraints in network emulators, existing emulation tools fail to meet these requirements as they are either limited to small and static networks, use simplified network models, or fail to deliver timely emulation results. If more physical resources are devoted to network emulation by utilizing high performance computing facilities, the accuracy and scalability of network emulation can be greatly improved. However, for many users, high performance computing facilities may not be readily available in a local laboratory environment, and co-locating application code with a remote high performance computing facility may be cumbersome and inconvenient. This thesis proposes a network emulation approach called ROSENET (RemOte SErver-based Network EmulaTion) that utilizes a distributed server-based architecture in which local low-fidelity emulators provide real-time QoS predictions to distributed applications, coupled with a remote large scale high-fidelity simulator that continuously updates and calibrates the local low-fidelity emulators. A library-based modeling approach based on online simulation data collection is proposed and a system identification modeling technique is presented. Experimental results examining emulation end-to-end delay and loss show that ROSENET provides a promising approach to network emulation supporting accuracy and scale while meeting real-time constraints. Challenges faced in applying ROSENET to real world applications are addressed through two case studies including applying synthetic workload on DARPA's NMS network topology for large scale network simulation and a contemporary real-time distributed VoIP application Skype.

[1]  Jean-Chrysotome Bolot.  End-to-end packet delay and loss behavior in the internet , 1993, SIGCOMM 1993.

[2]  Vern Paxson,et al.  How to Own the Internet in Your Spare Time , 2002, USENIX Security Symposium.

[3]  David M. Nicol,et al.  Towards Realistic Million-Node Internet Simulation , 1999, PDPTA.

[4]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[5]  Predicting Internet End-to-End Delay : A Statistical Study † , 2005 .

[6]  Lionel M. Ni,et al.  EMPOWER: a cluster architecture supporting network emulation , 2004, IEEE Transactions on Parallel and Distributed Systems.

[7]  Ken Tang,et al.  An Accurate, Scalable Communication Effects Server for the FCS System of Systems Simulation Environment , 2006, Proceedings of the 2006 Winter Simulation Conference.

[8]  O. M. Mevassvik,et al.  JADE - An Experimenting in Distributed Simulation Based Joint Tactical Training , 2006 .

[9]  Mostafa H. Ammar,et al.  Split protocol stack network simulations using the dynamic simulation backplane , 2001, MASCOTS 2001, Proceedings Ninth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[10]  Mineo Takai,et al.  Looking ahead of real time in hybrid component networks , 2001, Proceedings 15th Workshop on Parallel and Distributed Simulation.

[11]  Kun-Chan Lan,et al.  Rapid model parameterization from traffic measurements , 2002, TOMC.

[12]  Raj Jain,et al.  Packet Trains-Measurements and a New Model for Computer Network Traffic , 1986, IEEE J. Sel. Areas Commun..

[13]  Richard M. Fujimoto,et al.  Performance Evaluation of the ROSENET Network Emulation System , 2007, 11th IEEE International Symposium on Distributed Simulation and Real-Time Applications (DS-RT'07).

[14]  Mary K. Vernon,et al.  Improving multirate congestion control using a TCP Vegas throughput model , 2005, Comput. Networks.

[15]  Kalyan S. Perumalla,et al.  Parallel and Distributed Simulation: Traditional Techniques and Recent Advances , 2006, Proceedings of the 2006 Winter Simulation Conference.

[16]  Luigi Rizzo,et al.  Dummynet: a simple approach to the evaluation of network protocols , 1997, CCRV.

[17]  Richard M. Fujimoto,et al.  Applying parallel and distributed simulation to remote network emulation , 2007, 2007 Winter Simulation Conference.

[18]  Kurt Rothermel,et al.  On Node Virtualization for Scalable Network Emulation , 2001 .

[19]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[20]  Srikanth Sundaragopalan,et al.  High-fidelity modeling of computer network worms , 2004, 20th Annual Computer Security Applications Conference.

[21]  Walter Willinger,et al.  Self-similar traffic and network dynamics , 2002, Proc. IEEE.

[22]  Manpreet Singh,et al.  Overview of the ORBIT radio grid testbed for evaluation of next-generation wireless network protocols , 2005, IEEE Wireless Communications and Networking Conference, 2005.

[23]  B. Melamed,et al.  Traffic modeling for telecommunications networks , 1994, IEEE Communications Magazine.

[24]  Hiroyuki Ohsaki,et al.  Modeling end-to-end packet delay dynamics of the internet using system identification , 2001 .

[25]  Andrew A. Chien,et al.  The MicroGrid: using online simulation to predict application performance in diverse grid network environments , 2004, Proceedings of the Second International Workshop on Challenges of Large Applications in Distributed Environments, 2004. CLADE 2004..

[26]  Jean-Chrysostome Bolot,et al.  End-to-end packet delay and loss behavior in the internet , 1993, SIGCOMM '93.

[27]  Jason Liu,et al.  An Open and Scalable Emulation Infrastructure for Large-Scale Real-Time Network Simulations , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[28]  Yin Zhang,et al.  On the constancy of internet path properties , 2001, IMW '01.

[29]  Hao Wu,et al.  Large-scale network simulation: how big? how fast? , 2003, 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, 2003. MASCOTS 2003..

[30]  Judith S. Dahmann,et al.  Creating Computer Simulation Systems: An Introduction to the High Level Architecture , 1999 .

[31]  Vern Paxson,et al.  End-to-end Internet packet dynamics , 1997, SIGCOMM '97.

[32]  David E. Culler,et al.  A blueprint for introducing disruptive technology into the Internet , 2003, CCRV.

[33]  David M. Nicol,et al.  RINSE: The Real-Time Immersive Network Simulation Environment for Network Security Exercises (Extended Version) , 2006, Simul..

[34]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[35]  Mostafa H. Ammar,et al.  A generic framework for parallelization of network simulations , 1999, MASCOTS '99. Proceedings of the Seventh International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[36]  L. Benmohamed,et al.  On a global information grid simulation platform for investigations of end-to-end performance , 2005, MILCOM 2005 - 2005 IEEE Military Communications Conference.

[37]  James Cowie Hongbo Liu Jason Liu David Nicol Andy Ogielski.  Towards Realistic Million-Node Internet Simulations , 1999 .

[38]  R. M. Fujimoto,et al.  Parallel discrete event simulation , 1989, WSC '89.

[39]  Brian W. Unger,et al.  Towards scalable network emulation , 2001, SPIE ITCom.

[40]  Mostafa H. Ammar,et al.  Distributed network simulations using the dynamic simulation backplane , 2001, Proceedings 21st International Conference on Distributed Computing Systems.

[41]  Mineo Takai,et al.  MAYA: Integrating hybrid network modeling to the physical world , 2004, TOMC.

[42]  David B. Ingham,et al.  Delayline: A Wide-Area Network Emulation Tool , 1994, Comput. Syst..

[43]  Henning Schulzrinne,et al.  An Analysis of the Skype Peer-to-Peer Internet Telephony Protocol , 2004, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[44]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[45]  Brian W. Unger,et al.  Improving scalability of network emulation through parallelism and abstraction , 2005, 38th Annual Simulation Symposium.

[46]  J. W. Wong,et al.  Queueing Network Modeling of Computer Communication Networks , 1978, CSUR.

[47]  Richard M. Fujimoto,et al.  Remote Network Emulation for Defense Applications , 2008 .

[48]  Richard G. Baraniuk,et al.  A Multifractal Wavelet Model with Application to Network Traffic , 1999, IEEE Trans. Inf. Theory.

[49]  D. Mitra,et al.  Stochastic theory of a data-handling system with multiple sources , 1982, The Bell System Technical Journal.

[50]  Kevin R. Fall,et al.  Network emulation in the VINT/NS simulator , 1999, Proceedings IEEE International Symposium on Computers and Communications (Cat. No.PR00250).

[51]  Yu Liu,et al.  Genesis: A scalable distributed system for large-scale parallel network simulation , 2006, Comput. Networks.

[52]  Richard M. Fujimoto,et al.  A flexible architecture for remote server-based emulation , 2004, The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings..

[53]  Kurt Rothermel,et al.  Distributed Emulation of Shared Media Networks , 2003 .

[54]  Jingsha He,et al.  Statistical Modeling and Correlation Analysis of End-to-End Delay in Wide Area Networks , 2007 .

[55]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[56]  George F. Riley,et al.  The Georgia Tech Network Simulator , 2003, MoMeTools '03.

[57]  Martin H. Folly,et al.  The United States at work , 1938 .

[58]  Kihong Park,et al.  Multiple Time Scale Congestion Control for Self-Similar Network Traffic , 1999, Perform. Evaluation.

[59]  R.M. Fujimoto,et al.  Parallel and distributed simulation systems , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[60]  A. L. Narasimha Reddy,et al.  ENDE: An End-to-end Network Delay Emulator Tool for Multimedia Protocol Development , 2001, Multimedia Tools and Applications.

[61]  Mario Gerla,et al.  GloMoSim: a library for parallel simulation of large-scale wireless networks , 1998 .

[62]  Patrice Abry,et al.  Wavelet Analysis of Long-Range-Dependent Traffic , 1998, IEEE Trans. Inf. Theory.

[63]  Amin Vahdat,et al.  Realistic and responsive network traffic generation , 2006, SIGCOMM 2006.

[64]  Mark Carson,et al.  NIST Net: a Linux-based network emulation tool , 2003, CCRV.

[65]  Richard M. Fujimoto,et al.  Design of high performance RTI software , 2000, Proceedings Fourth IEEE International Workshop on Distributed Simulation and Real-Time Applications (DS-RT 2000).

[66]  Mike Hibler,et al.  An integrated experimental environment for distributed systems and networks , 2002, OSDI '02.

[67]  Srikar Doddi,et al.  Empirical modeling of end-to-end delay dynamics in best-effort networks , 2005 .

[68]  J.H. Cowie,et al.  Modeling the global Internet , 1999, Comput. Sci. Eng..