Accurately modeling workload interactions for deploying prefetching in Web servers

Although Web prefetching is regarded as an effective method to improve client access performance, the associated overhead prevents it from being widely deployed. Specifically, a major weakness in existing Web servers is that prefetching activities are scheduled independently of dynamically changing server workloads. Without proper control and coordination between the two kinds of activities, prefetching can negatively affect the Web services and degrade Web access performance. We first develop an open queuing model to characterize detailed transactions in Web servers. Using this model, we analyze server resource utilization and average response time with different request arrival rates when prefetching is involved under different kinds of Web services. Guided by this model, we then design a responsive and adaptive prefetching scheme that dynamically adjusts the prefetching aggressiveness in Web servers. Our scheme not only prevents the Web servers from being overloaded, but it can also minimize the average server response time. We have effectively implemented this scheme on an Apache Web server. Our measurement-based performance evaluation shows our model can accurately predict the utilization of Web server resources and the correspondent average response time

[1]  K. Mani Chandy,et al.  Open, Closed, and Mixed Networks of Queues with Different Classes of Customers , 1975, JACM.

[2]  Darrell D. E. Long,et al.  Exploring the Bounds of Web Latency Reduction from Caching and Prefetching , 1997, USENIX Symposium on Internet Technologies and Systems.

[3]  Ian H. Witten,et al.  Data Compression Using Adaptive Coding and Partial String Matching , 1984, IEEE Trans. Commun..

[4]  Dakshi Agrawal,et al.  Inferring client response time at the web server , 2002, SIGMETRICS '02.

[5]  Javed I. Khan,et al.  Partial Prefetch for Faster Surfing in Composite Hypermedia , 2001, USITS.

[6]  Paul Barford,et al.  The network effects of prefetching , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[7]  Virgílio A. F. Almeida,et al.  Capacity Planning for Web Services: Metrics, Models, and Methods , 2001 .

[8]  Arun Venkataramani,et al.  Sys-tem support for background replication , 2002, OSDI 2002.

[9]  Jon Crowcroft,et al.  Prefetching in World Wide Web , 1996, Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference.

[10]  Wei Lin,et al.  Web prefetching between low-bandwidth clients and proxies: potential and performance , 1999, SIGMETRICS '99.

[11]  Arun Venkataramani,et al.  A Non-interfering Deployable Web Prefetching System , 2002 .

[12]  Martin Arlitt,et al.  A workload characterization study of the 1998 World Cup Web site , 2000, IEEE Netw..

[13]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[14]  Leonard Kleinrock,et al.  An adaptive network prefetch scheme , 1998, IEEE J. Sel. Areas Commun..

[15]  Michael D. Smith,et al.  Using Path Profiles to Predict HTTP Requests , 1998, Comput. Networks.

[16]  Martin Arlitt,et al.  Workload Characterization of the 1998 World Cup Web Site , 1999 .

[17]  Jeffrey C. Mogul,et al.  Using predictive prefetching to improve World Wide Web latency , 1996, CCRV.

[18]  Randy H. Katz,et al.  Clustering Web content for efficient replication , 2002, 10th IEEE International Conference on Network Protocols, 2002. Proceedings..

[19]  Xin Chen,et al.  A Popularity-Based Prediction Model for Web Prefetching , 2003, Computer.

[20]  Arun Venkataramani,et al.  NPS: A Non-Interfering Deployable Web Prefetching System , 2003, USENIX Symposium on Internet Technologies and Systems.

[21]  Shlomo Moran,et al.  Optimizing Result Prefetching in Web Search Engines with Segmented Indices , 2002, VLDB.

[22]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[23]  Mahmut T. Kandemir,et al.  Reducing Disk Power Consumption in Servers with DRPM , 2003, Computer.