Web server QoS models: applying scheduling rules from production planning

Most web servers, in practical use, use a queuing policy based on the Best Effort model, which employs the first-in-first-out (FIFO) scheduling rule to prioritize web requests in a single queue. This model does not provide Quality of Service (QoS). In the Differentiated Services (DiffServ) model, separate queues are introduced to differentiate QoS for separate web requests with different priorities. This paper presents web server QoS models that use a single queue, along with scheduling rules from production planning in the manufacturing domain, to differentiate QoS for classes of web service requests with different priorities. These scheduling rules are Weighted Shortest Processing Time (WSPT), Apparent Tardiness Cost (ATC), and Earliest Due Date. We conduct simulation experiments and compare the QoS performance of these scheduling rules with the FIFO scheme used in the basic Best Effort model with only one queue, and the basic DiffServ model with two separate queues. Simulation results demonstrate better QoS performance using WSPT and ATC, especially when requested services exceed the capacity of a web server.

[1]  Scott Shenker,et al.  Specification of Guaranteed Quality of Service , 1997, RFC.

[2]  Thomas F. Lawrence.  The quality of service model and high assurance , 1997, Proceedings 1997 High-Assurance Engineering Workshop.

[3]  Roch Guérin,et al.  Quality-of-Service in Packet Networks: Basic Mechanisms and Directions , 1999, Comput. Networks.

[4]  Dan C. Marinescu,et al.  Modeling and performance analysis of QoS-aware load balancing of Web-server clusters , 2002, Comput. Networks.

[5]  C. Strnadl.  At your service: QoS for the internet [Book Review] , 2002, IEEE MultiMedia.

[6]  Scott Shenker,et al.  Integrated Services in the Internet Architecture : an Overview Status of this Memo , 1994 .

[7]  Tiziana Ferrari,et al.  Differentiated Services , 2002 .

[8]  Nong Ye,et al.  QoS-Centric Stateful Resource Management in Information Systems , 2002, Inf. Syst. Frontiers.

[9]  Hui Zhang,et al.  Service disciplines for guaranteed performance service in packet-switching networks , 1995, Proc. IEEE.

[10]  Paul Izzo.  Gigabit Networks: Standards and Schemes for Next-Generation Networking , 2000 .

[11]  Amin Vahdat,et al.  Application-level differentiated multimedia Web services using quality aware transcoding , 2000, IEEE Journal on Selected Areas in Communications.

[12]  Amit P. Sheth,et al.  At Your Service: QoS for the Internet , 2002 .

[13]  Ludmila Cherkasova,et al.  Session-Based Admission Control: A Mechanism for Peak Load Management of Commercial Web Sites , 2002, IEEE Trans. Computers.

[14]  Tai-Yun Kim,et al.  Connection management for QoS service on the Web , 2002, J. Netw. Comput. Appl..

[15]  Sang Hyuk Son,et al.  A feedback control approach for guaranteeing relative delays in Web servers , 2001, Proceedings Seventh IEEE Real-Time Technology and Applications Symposium.

[16]  Enrico Gregori,et al.  Load distribution among replicated Web servers: a QoS-based approach , 2000, PERV.

[17]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[18]  CherkasovaLudmila,et al.  Session-Based Admission Control , 2002 .

[19]  Abraham Silberschatz,et al.  Operating System Concepts , 1983 .

[20]  John Wroclawski,et al.  Specification of the Controlled-Load Network Element Service , 1997, RFC.

[21]  D. M. Deighton,et al.  Computers in Operations Research , 1977, Aust. Comput. J..

[22]  Allan Kuchinsky,et al.  Integrating user-perceived quality into Web server design , 2000, Comput. Networks.

[23]  Aaron Striegel,et al.  Packet scheduling with delay and loss differentiation , 2002, Comput. Commun..

[24]  Nina Bhatti,et al.  Web server support for tiered services , 1999, IEEE Netw..

[25]  Martin F. Arlitt,et al.  Web server workload characterization: the search for invariants , 1996, SIGMETRICS '96.

[26]  Lixia Zhang,et al.  Resource ReSerVation Protocol (RSVP) - Version 1 Functional Specification , 1997, RFC.

[27]  David L. Black,et al.  Definition of the Differentiated Services Field (DS Field) in the IPv4 and IPv6 Headers , 1998, RFC.

[28]  Von Seggern,et al.  CRC standard curves and surfaces , 1993 .

[29]  Van Jacobson,et al.  A Two-bit Differentiated Services Architecture for the Internet , 1999, RFC.

[30]  Prasant Mohapatra,et al.  Overload control in QoS-aware web servers , 2003, Comput. Networks.

[31]  John Wroclawski,et al.  The Use of RSVP with IETF Integrated Services , 1997, RFC.

[32]  Sugih Jamin,et al.  A measurement-based admission-controlled Web server , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[33]  Abraham Silberschatz,et al.  Operating Systems Concepts , 2005 .

[34]  K. Shin,et al.  Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach , 2002, IEEE Trans. Parallel Distributed Syst..