Feedback Control-Based Database Connection Management for Proportional Delay Differentiation-Enabled Web Application Servers

As an important differentiated service model, proportional delay differentiation (PDD) aims to maintain the queuing delay ratio between different classes of requests or packets according to pre-specified parameters. This paper considers providing PDD service in web application servers through feedback control-based database connection management. To achieve this goal, an approximate linear time-invariant model of the database connection pool (DBCP) is identified experimentally and used to design a proportional-integral (PI) controller. Periodically the controller is invoked to calculate and adjust the probabilities for different classes of dynamic requests to use database connections, according to the error between the measured delay ratio and the reference value. Three kinds of workloads, which follow deterministic, uniform and heavy-tailed distributions respectively, are designed to evaluate the performance of the closed-loop system. Experiment results indicate that, the controller is effective in handling varying workloads, and PDD can be achieved in the DBCP even if the number of concurrent dynamic requests changes abruptly under different kinds of workloads.

[1]  Erich M. Nahum,et al.  A method for transparent admission control and request scheduling in e-commerce web sites , 2004, WWW '04.

[2]  Jeong-dong Ryoo,et al.  Prediction error adaptation of input traffic for absolute and proportional delay differentiated services , 2006, QShine '06.

[3]  Mohammed Abbad,et al.  An algorithm for achieving proportional delay differentiation , 2008, Oper. Res. Lett..

[4]  Peter Druschel,et al.  Resource containers: a new facility for resource management in server systems , 1999, OSDI '99.

[5]  Cheng-Zhong Xu,et al.  Design and implementation of a feedback controller for slowdown differentiation on internet servers , 2005, WWW '05.

[6]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[7]  Chin-Chi Wu,et al.  High-performance packet scheduling to provide relative delay differentiation in future high-speed networks , 2008, Comput. Commun..

[8]  Cheng-Zhong Xu,et al.  Consistent proportional delay differentiation: a fuzzy control approach , 2007, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[9]  Doug Lea,et al.  Concurrent programming in Java - design principles and patterns , 1996, Java series.

[10]  Douglas M. Freimuth,et al.  Kernel Mechanisms for Service Differentiation in Overloaded Web Servers , 2001, USENIX Annual Technical Conference, General Track.

[11]  Chenyang Lu,et al.  Feedback performance control in software services , 2003 .

[12]  Parameswaran Ramanathan,et al.  Proportional differentiated services: delay differentiation and packet scheduling , 2002, TNET.

[13]  Kuang-Ching Wang,et al.  End-to-end throughput and delay assurances in multihop wireless hotspots , 2003, WMASH '03.

[14]  David K. Y. Yau,et al.  A proportional-delay DiffServ-enabled Web server: admission control and dynamic adaptation , 2004, IEEE Transactions on Parallel and Distributed Systems.

[15]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[16]  Jyh-Shing Roger Jang,et al.  Admission control schemes for proportional differentiated services enabled internet servers using machine learning techniques , 2006, Expert Syst. Appl..

[17]  Tarek F. Abdelzaher,et al.  Design, implementation, and evaluation of differentiated caching services , 2004, IEEE Transactions on Parallel and Distributed Systems.

[18]  Pablo Molinero-Fernández,et al.  Systems with multiple servers under heavy-tailed workloads , 2005, Perform. Evaluation.

[19]  K. Shin,et al.  Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach , 2002, IEEE Trans. Parallel Distributed Syst..

[20]  Cheng-Zhong Xu,et al.  Consistent proportional delay differentiation: A fuzzy control approach , 2007, Comput. Networks.

[21]  Mor Harchol-Balter,et al.  Size-based scheduling to improve web performance , 2003, TOCS.

[22]  Nong Ye,et al.  Web server QoS models: applying scheduling rules from production planning , 2005, Comput. Oper. Res..

[23]  Edward W. Knightly,et al.  Ensuring Latency Targets in Multiclass Web Servers , 2003, IEEE Trans. Parallel Distributed Syst..