An automated profiling subsystem for QoS-aware services

The advent of QoS-sensitive Internet applications such as multimedia and the proliferation of priced performance-critical applications such as online trading raise a need for building server systems with guaranteed performance. The new applications must run on different heterogeneous platforms, provide soft performance guarantees commensurate with platform capacity and adapt efficiently to upgrades in platform resources over the system's lifetime. Profiling the application for the purposes of providing QoS guarantees on each new platform becomes a significant undertaking. Automated profiling mechanisms must be built to enable efficient computing of QoS guarantees tailored to platform capacity and facilitate wide deployment of soft performance-guaranteed systems on heterogeneous platforms. The article investigates the design of the automated profiling subsystem: an essential component of future "general-purpose" QoS-sensitive systems. The subsystem estimates application resource requirements and adapts the software transparently to the resource capacity of the underlying platform. A novel aspect of the proposed profiling subsystem is its use of estimation theory for profiling. Resource requirements are estimated by correlating applied workload with online resource utilization measurements. We focus explicitly on profiling server software. The convergence and accuracy of our online profiling techniques are evaluated in the context of an Apache Web server serving both static Web pages and dynamic content. Results show the viability of using estimation theory for automated online profiling and for achieving QoS guarantees.

[1]  Zheng Wang,et al.  An Architecture for Differentiated Services , 1998, RFC.

[2]  Kang G. Shin,et al.  End-host architecture for QoS-adaptive communication , 1998, Proceedings. Fourth IEEE Real-Time Technology and Applications Symposium (Cat. No.98TB100245).

[3]  Andrew T. Campbell,et al.  A quality of service architecture , 1994, CCRV.

[4]  Klara Nahrstedt,et al.  An end-to-end QoS model and management architecture , 1997 .

[5]  David Lorge Parnas,et al.  Scheduling Processes with Release Times, Deadlines, Precedence, and Exclusion Relations , 1990, IEEE Trans. Software Eng..

[6]  Thomas F. Lawrence,et al.  Modeling applications for adaptive QoS-based resource management , 1997, Proceedings 1997 High-Assurance Engineering Workshop.

[7]  Krithi Ramamritham,et al.  Preemptive Scheduling Under Time and Resource Constraints , 1987, IEEE Transactions on Computers.

[8]  Daniel Mossé,et al.  V-NET: a framework for a versatile network architecture to support real-time communication performance guarantees , 1995, Proceedings of INFOCOM'95.

[9]  Kang G. Shin,et al.  QoS adaptation in real-time systems , 1999 .

[10]  Eric A. Brewer,et al.  Adapting to network and client variability via on-demand dynamic distillation , 1996, ASPLOS VII.

[11]  Karsten Schwan,et al.  FARA-a framework for adaptive resource allocation in complex real-time systems , 1998, Proceedings. Fourth IEEE Real-Time Technology and Applications Symposium (Cat. No.98TB100245).

[12]  John A. Stankovic.  Decentralized Decision Making for Task Reallocation in a Hard Real-Time System , 1989, IEEE Trans. Computers.

[13]  M. Humphrey,et al.  The DQM Architecture: Middleware for Application-centered QoS Resource Management , 1997 .

[14]  Daniel P. Siewiorek,et al.  Practical solutions for QoS-based resource allocation problems , 1998, Proceedings 19th IEEE Real-Time Systems Symposium (Cat. No.98CB36279).

[15]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[16]  Lakshman Krishnamurthy.  AQUA: an adaptive quality of service architecture for distributed multimedia applications , 1997 .

[17]  Krithi Ramamritham,et al.  The Spring kernel: a new paradigm for real-time systems , 1991, IEEE Software.

[18]  Kang G. Shin,et al.  Combined Task and Message Scheduling in Distributed Real-Time Systems , 1999, IEEE Trans. Parallel Distributed Syst..

[19]  B. Pasik-Duncan,et al.  Adaptive Control , 1996, IEEE Control Systems.

[20]  Karsten Schwan,et al.  FARACost: an adaptation cost model aware of pending constraints , 1999, Proceedings 20th IEEE Real-Time Systems Symposium (Cat. No.99CB37054).

[21]  Mahadev Satyanarayanan,et al.  Experience with adaptive mobile applications in Odyssey , 1999, Mob. Networks Appl..

[22]  Jia Xu,et al.  Multiprocessor Scheduling of Processes with Release Times, Deadlines, Precedence, and Exclusion Relations , 1993, IEEE Trans. Software Eng..

[23]  Klara Nahrstedt,et al.  Design, Implementation, and Experiences of the OMEGA End-Point Architecture , 1996, IEEE J. Sel. Areas Commun..

[24]  Krithi Ramamritham,et al.  Scheduling Tasks with Resource Requirements in Hard Real-Time Systems , 1987, IEEE Transactions on Software Engineering.

[25]  Klara Nahrstedt,et al.  The QOS Broker , 1995, IEEE Multim..

[26]  Scott A. Brandt,et al.  A dynamic quality of service middleware agent for mediating application resource usage , 1998, Proceedings 19th IEEE Real-Time Systems Symposium (Cat. No.98CB36279).

[27]  Aurel A. Lazar,et al.  A Binding Architecture for Multimedia Networks , 1994, J. Parallel Distributed Comput..

[28]  Panos K. Chrysanthis,et al.  Framework for experimenting with QoS for multimedia services , 1996, Electronic Imaging.

[29]  Andrew T. Campbell,et al.  A survey of QoS architectures , 1998, Multimedia Systems.

[30]  T. Shepard,et al.  A Pre-Run-Time Scheduling Algorithm For Hard Real-Time Systems , 1991, IEEE Trans. Software Eng..

[31]  Kang G. Shin,et al.  QoS provisioning with qContracts in web and multimedia servers , 1999, Proceedings 20th IEEE Real-Time Systems Symposium (Cat. No.99CB37054).

[32]  Krithi Ramamritham,et al.  Distributed Scheduling of Tasks with Deadlines and Resource Requirements , 1989, IEEE Trans. Computers.

[33]  Lars C. Wolf,et al.  HeiRAT - Quality-of-service management for distributed multimedia systems , 1998, Multimedia Systems.

[34]  Kang G. Shin,et al.  QoS negotiation in real-time systems and its application to automated flight control , 1997, Proceedings Third IEEE Real-Time Technology and Applications Symposium.

[35]  Sang Hyuk Son,et al.  Design and evaluation of a feedback control EDF scheduling algorithm , 1999, Proceedings 20th IEEE Real-Time Systems Symposium (Cat. No.99CB37054).

[36]  Shirish S. Sathaye,et al.  Generalized rate-monotonic scheduling theory: a framework for developing real-time systems , 1994, Proc. IEEE.

[37]  Krithi Ramamritham,et al.  The Design of the Spring Kernel , 1987, RTSS.

[38]  David L. Black,et al.  An Architecture for Differentiated Service , 1998 .

[39]  John A. Stankovic,et al.  Dynamic end-to-end guarantees in distributed real time systems , 1994, 1994 Proceedings Real-Time Systems Symposium.

[40]  Krithi Ramamritham,et al.  Evaluation of a flexible task scheduling algorithm for distributed hard real-time systems , 1985, IEEE Transactions on Computers.