Autonomic Management of Internet Services: Experience with Self-Optimization

Autonomic computing is an appealing approach to facilitate the management of distributed systems. However, several challenges remain open among which: (i) How to manage legacy systems? (ii) How to manage complex distributed systems? In this paper, we precisely address these issues. The paper presents the design, implementation and evaluation of Jade, an environment for autonomic management of legacy computing systems. This environment relies on two main frameworks: a framework for administrable elements, which provides the administered legacy system’s elements with a uniform management interface; and a framework for autonomic managers, which regulates a set of managed elements for a specific management aspect. The aspect that we consider in this paper is self-optimization, i.e. preserving the system’s performance in response to wide variations of the load. The main contribution of this paper is a generic architectural model that eases the construction of autonomically managed systems. Thus, integrating a new managed legacy system only necessitates a few hundred lines of code. Another contribution of the paper is the application of this model to self-optimization of complex and multi-tier Internet services. Our experiments on an auction site show that Jade is able to maintain the client perceived performance stable when the workload varies, while, without Jade, the performance continuously decreases. Furthermore, in these experiments Jade allows twice as many client requests to be served as a system with no autonomic management.

[1]  Richard P. Martin,et al.  Understanding and Dealing with Operator Mistakes in Internet Services , 2004, OSDI.

[2]  Tao Yang,et al.  Integrated resource management for cluster-based Internet services , 2002, OSDI.

[3]  Prashant J. Shenoy,et al.  Sharc: managing CPU and network bandwidth in shared clusters , 2004, IEEE Transactions on Parallel and Distributed Systems.

[4]  A. Iyengar,et al.  An analysis of Web server performance , 1997, GLOBECOM 97. IEEE Global Telecommunications Conference. Conference Record.

[5]  Sacha Krakowiak,et al.  Architecture-Based Autonomous Repair Management: Application to J2EE Clusters , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[6]  Benny Rochwerger,et al.  Oceano-SLA based management of a computing utility , 2001, 2001 IEEE/IFIP International Symposium on Integrated Network Management Proceedings. Integrated Network Management VII. Integrated Management Strategies for the New Millennium (Cat. No.01EX470).

[7]  Amin Vahdat,et al.  Managing energy and server resources in hosting centers , 2001, SOSP.

[8]  Wei Jin,et al.  USENIX Association Proceedings of USITS ’ 03 : 4 th USENIX Symposium on Internet Technologies and Systems , 2003 .

[9]  Mon-Yen Luo,et al.  Constructing zero-loss Web services , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[10]  Willy Zwaenepoel,et al.  Cluster reserves: a mechanism for resource management in cluster-based network servers , 2000, SIGMETRICS '00.

[11]  Gilda Pour.  Java 2 Platform Enterprise Edition (J2EE) for Building Web-Based Enterprise Applications , 2001, TOOLS.

[12]  Sameh Elnikety,et al.  Performance Comparison of Middleware Architectures for Generating Dynamic Web Content , 2003, Middleware.

[13]  James Norris,et al.  OnCall: defeating spikes with a free-market application cluster , 2004, International Conference on Autonomic Computing, 2004. Proceedings..

[14]  Thierry Coupaye,et al.  Recursive and Dynamic Software Composition with Sharing , 2002 .

[15]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[16]  S. Ranjan,et al.  QoS-driven server migration for Internet data centers , 2002, IEEE 2002 Tenth IEEE International Workshop on Quality of Service (Cat. No.02EX564).

[17]  Willy Zwaenepoel,et al.  C-JDBC: Flexible Database Clustering Middleware , 2004, USENIX Annual Technical Conference, FREENIX Track.

[18]  Prashant Shenoy,et al.  Cataclysm: Handling Extreme Overloads in Internet Services , 2004, PODC 2004.

[19]  Tao Yang,et al.  Demand-driven service differentiation in cluster-based network servers , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[20]  C. Amza,et al.  Specification and implementation of dynamic Web site benchmarks , 2002, 2002 IEEE International Workshop on Workload Characterization.

[21]  Prashant J. Shenoy,et al.  Dynamic Provisioning of Multi-tier Internet Applications , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[22]  George Candea,et al.  A Microrebootable System - Design, Implementation, and Evaluation , 2004, ArXiv.