Eve: a measurement-centric emulation environment for adaptive internet servers

Emulation plays a central role in the performance evaluation, capacity planning, and workload characterization of servers and data centers. Emulation tools usually require developers to focus on mimicking application behavior as well as to deal with system-level details of managing the emulation. With the continuing increase in computing capacity and complexity, capturing the interactions between different parts of an emulation (e.g., clients' reactions to server reconfiguration) increases the complexity and overhead of emulation design. Furthermore, since the amount of measurement data can easily be huge, efficient data management is becoming a key requirement to the proper scalability of any emulation tool. In this paper, we propose Eve, an efficient emulation environment that provides rapid development of distributed and adaptive emulators. By incorporating in-path data processing and custom triggers into a distributed shared variable (DSV) core, Eve provides full and customizable control of how and when measurement data is moved from the source to the DSV, where the data is stored. Both functions simplify data management and minimize the overhead of frequent updates, thus enhancing the created emulator's scalability. They also simplify feedback monitoring and control when creating adaptive emulators. The capabilities of Eve are shown to allow emulation designers to focus on application behavior rather than on system-level details.

[1]  James Arthur Kohl,et al.  PVM and MPI: a Comparison of Features , 2007 .

[2]  George C. Necula,et al.  Capriccio: scalable threads for internet services , 2003, SOSP '03.

[3]  Miguel Castro,et al.  SCRIBE: The Design of a Large-Scale Event Notification Infrastructure , 2001, Networked Group Communication.

[4]  Eddie Kohler,et al.  The Click modular router , 1999, SOSP.

[5]  Brian N. Bershad,et al.  The Midway distributed shared memory system , 1993, Digest of Papers. Compcon Spring.

[6]  L. Cherkasova,et al.  Session-based admission control: a mechanism for improving performance of commercial Web sites , 1999, 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354).

[7]  Alex Rapaport,et al.  Mpi-2: extensions to the message-passing interface , 1997 .

[8]  Willy Zwaenepoel,et al.  Munin: distributed shared memory based on type-specific memory coherence , 1990, PPOPP '90.

[9]  Kang G. Shin,et al.  Persistent dropping: an efficient control of traffic aggregates , 2003, SIGCOMM '03.

[10]  Prashant J. Shenoy,et al.  Dynamic resource allocation for shared data centers using online measurements , 2003, IWQoS'03.

[11]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[12]  Nicholas Carriero,et al.  Distributed data structures in Linda , 1986, POPL '86.

[13]  Thorsten von Eicken,et al.  U-Net: a user-level network interface for parallel and distributed computing , 1995, SOSP.

[14]  Miguel Castro,et al.  Lightweight logging for lazy release consistent distributed shared memory , 1996, OSDI '96.

[15]  Eric A. Brewer,et al.  USENIX Association Proceedings of HotOS IX : The 9 th Workshop on Hot Topics in Operating Systems , 2003 .

[16]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[17]  Robbert van Renesse,et al.  Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining , 2003, TOCS.