A new perspective on experimental analysis of N-tier systems: Evaluating database scalability, multi-bottlenecks, and economical operation

Economical configuration planning, component performance evaluation, and analysis of bottleneck phenomena in N-tier applications are serious challenges due to design requirements such as non-stationary workloads, complex non-modular relationships, and global consistency management when replicating database servers, for instance. We have conducted an extensive experimental evaluation of N-tier applications, which adopts a purely empirical approach the aforementioned challenges, using the RUBBoS benchmark. As part of the analysis of our exceptionally rich dataset, we have experimentally investigated database server scalability, bottleneck phenomena identification, and iterative data refinement for configuration planning. The experiments detailed in this paper are comprised of a full scale-out mesh with up to nine database servers and three application servers. Additionally, the four-tier system was run in a variety of configurations, including two database management systems (MySQL and PostgreSQL), two hardware node types (normal and low-cost), two replication strategies (wait-all and wait-first—which approximates primary/ secondary), and two database replication techniques (C-JDBC and MySQL Cluster). Herein, we present an analysis survey of results mainly generated with a read/write mix pattern in the client emulator.

[1]  Gustavo Alonso,et al.  MIDDLE-R: Consistent database replication at the middleware level , 2005, TOCS.

[2]  Gustavo Alonso,et al.  Ganymed: Scalable Replication for Transactional Web Applications , 2004, Middleware.

[3]  Markus Hedwig,et al.  Datacenter Investment Support System (DAISY) , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[4]  Calton Pu,et al.  Mulini: an automated staging framework for QoS of distributed multi-tier applications , 2007, WRASQ '07.

[5]  Calton Pu,et al.  Bottleneck Detection Using Statistical Intervention Analysis , 2007, DSOM.

[6]  Willy Zwaenepoel,et al.  C-JDBC: Flexible Database Clustering Middleware , 2004, USENIX Annual Technical Conference, FREENIX Track.

[7]  Ricardo Jiménez-Peris,et al.  Adaptive Middleware for Data Replication , 2004, Middleware.

[8]  Dennis Shasha,et al.  The dangers of replication and a solution , 1996, SIGMOD '96.

[9]  Dirk Neumann,et al.  Taming Energy Costs of Large Enterprise Systems Through Adaptive Provisioning , 2009, ICIS.

[10]  Akhil Sahai,et al.  Automated generation of resource configurations through policies , 2004, Proceedings. Fifth IEEE International Workshop on Policies for Distributed Systems and Networks, 2004. POLICY 2004..

[11]  Alan L. Cox,et al.  A comparative evaluation of transparent scaling techniques for dynamic content servers , 2005, 21st International Conference on Data Engineering (ICDE'05).

[12]  George Candea,et al.  Middleware-based database replication: the gaps between theory and practice , 2007, SIGMOD Conference.

[13]  Calton Pu,et al.  Experimental evaluation of N-tier systems: Observation and analysis of multi-bottlenecks , 2009, 2009 IEEE International Symposium on Workload Characterization (IISWC).

[14]  Calton Pu,et al.  An Observation-Based Approach to Performance Characterization of Distributed n-Tier Applications , 2007, 2007 IEEE 10th International Symposium on Workload Characterization.

[15]  C. Amza,et al.  Specification and implementation of dynamic Web site benchmarks , 2002, 2002 IEEE International Workshop on Workload Characterization.

[16]  Fernando Pedone,et al.  Tashkent: uniting durability with transaction ordering for high-performance scalable database replication , 2006, EuroSys.

[17]  Willy Zwaenepoel,et al.  Partial Replication: Achieving Scalability in Redundant Arrays of Inexpensive Databases , 2003, OPODIS.