Automated cluster-based Web service performance tuning

Active harmony provides a way to automate performance tuning. We apply the Active Harmony system to improve the performance of a cluster-based web service system. The performance improvement cannot easily be achieved by tuning individual components for such a system. The experimental results show that there is no single configuration for the system that performs well for all kinds of workloads. By tuning the parameters, Active Harmony helps the system adapt to different workloads and improve the performance up to 16%. For scalability, we demonstrate how to reduce the time when tuning a large system with many tunable parameters. Finally an algorithm is proposed to automatically adjust the structure of cluster-based web systems, and the system throughput is improved up to 70% using this technique.

[1]  Philip S. Yu,et al.  On balancing the load in a clustered web farm , 2001, TOIT.

[2]  Tzi-cker Chiueh,et al.  Performance guarantee for cluster-based Internet services , 2002, Ninth International Conference on Parallel and Distributed Systems, 2002. Proceedings..

[3]  Al Young.  Providence, Rhode Island , 1975 .

[4]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[5]  M. Gribaudo,et al.  2002 , 2001, Cell and Tissue Research.

[6]  Jeffrey S. Vetter,et al.  Autopilot: adaptive control of distributed applications , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[7]  Mahadev Satyanarayanan,et al.  Agile application-aware adaptation for mobility , 1997, SOSP.

[8]  Asser N. Tantawi,et al.  Performance management for cluster based Web services , 2003 .

[9]  Jack J. Dongarra,et al.  Automatically Tuned Linear Algebra Software , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[10]  Li Xiao,et al.  Adaptive and virtual reconfigurations for effective dynamic job scheduling in cluster systems , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[11]  Jeffrey K. Hollingsworth,et al.  Exposing application alternatives , 1999, Proceedings. 19th IEEE International Conference on Distributed Computing Systems (Cat. No.99CB37003).

[12]  Daniel A. Reed,et al.  The Autopilot Performance-Directed Adaptive Control System , 1997 .

[13]  Jeffrey K. Hollingsworth,et al.  Prediction and adaptation in Active Harmony , 2004, Cluster Computing.

[14]  Louise E. Moser,et al.  Dynamic migration algorithms for distributed object systems , 2001, Proceedings 21st International Conference on Distributed Computing Systems.

[15]  I-Hsin Chung,et al.  Active Harmony: Towards Automated Performance Tuning , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[16]  Wei Sun,et al.  ADAPTLOAD: effective balancing in clustered web servers under transient load conditions , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[17]  Gang Peng,et al.  Performance guarantees for cluster-based internet services , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[18]  Francine Berman,et al.  Scheduling from the perspective of the application , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[19]  Andrew Lewis,et al.  An Automatic Design Optimization Tool and its Application to Computational Fluid Dynamics , 2001, International Conference on Software Composition.

[20]  R. C. Whaley,et al.  Automatically Tuned Linear Algebra Software (ATLAS) , 2011, Encyclopedia of Parallel Computing.

[21]  Karsten Schwan,et al.  Falcon: on-line monitoring and steering of large-scale parallel programs , 1995, Proceedings Frontiers '95. The Fifth Symposium on the Frontiers of Massively Parallel Computation.

[22]  D. Abramson,et al.  An Automatic Design Optimization Tool and its Application to Computational Fluid Dynamics , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[23]  Laura Carrington,et al.  A Framework for Application Performance Modeling and Prediction , 2002 .

[24]  Asser N. Tantawi,et al.  Performance management for cluster-based web services , 2005, IEEE Journal on Selected Areas in Communications.