Using feedback control to manage QoS for clusters of servers providing service differentiation

This paper considers the use of feedback to improve the performance of computing systems that offer differentiated services. The motivation of the work is based on the increasing demand on application servers. It is not always sufficient to buy high-performance software for the server. Multiple servers may be needed. To guarantee that QoS requirements are satisfied, it is possible to statically assign resources for a specific class. This often results in underutilization of resources. This paper describes a novel technique that is based on control theory principles applied to a server cluster that provides differentiated service. The paper shows that feedback can be used to adjust the number of client requests concurrently being processed based on dynamic information such as CPU utilization. The paper also compares the use of the proposed technique with a dynamic non control-theoretic approach that is not based on control theory principles. Results show a dramatic increase in the number of served users using the control theory principles compared with a non control-theoretic approach during the same experiment duration. The improvement provided by the proposed technique exceeded 20%.

[1]  T. Wonnacott,et al.  Introductory statistics for business and economics , 1972 .

[2]  I. E. Bradley,et al.  Introductory statistics for business and economics , 1981 .

[3]  S. Parekh,et al.  MIMO control of an Apache web server: modeling and controller design , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[4]  Tao Yang,et al.  Demand-driven service differentiation in cluster-based network servers , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[5]  Tao Yang,et al.  Integrated resource management for cluster-based Internet services , 2002, OSDI.

[6]  ByoungSeon Choi,et al.  Arma Model Identification , 1992 .

[7]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[8]  Joseph L. Hellerstein,et al.  Using Control Theory to Achieve Service Level Objectives In Performance Management , 2002, Real-Time Systems.

[9]  Thomas H. Wonnacott,et al.  Student workbook : Introductory statistics for business and economics, fourth edition and Introductory statistics, fifth edition, Thomas H. Wonnacott, Ronald J. Wonnacott , 1990 .

[10]  Katsuhiko Ogata,et al.  Modern Control Engineering , 1970 .