An HTTP web traffic model based on the top one million visited web pages

The ever-changing behavior of HTTP web pages requires an adjustment of the web models used for simulation and benchmarking. In this paper, we present the statistical data of the one million most visited web sites. Using this data, we examine the changes in size and number of objects by comparing our findings with well-known web traffic models. The results show a trend towards large pages including multimedia content. In addition, today's web pages are created dynamically, i.e., that the content is downloaded from web servers spread all around the world. Finally, we discuss new web traffic models and present the parameters gathered from our measurements.

[1]  D. Klein.  Evaluation methodology. , 1977, The International journal of the addictions.

[2]  Phuoc Tran-Gia,et al.  Traffic Measurement and Analysis of a Broadband Wireless Internet Access , 2009, VTC Spring 2009 - IEEE 69th Vehicular Technology Conference.

[3]  Phuoc Tran-Gia,et al.  Traffic characterization of a residential wireless Internet access , 2011, Telecommun. Syst..

[4]  Amer,et al.  Multiple TCP connections improve HTTP throughput - myth or fact? , 2009, IEEE International Performance, Computing, and Communications Conference.

[5]  John D. Garofalakis,et al.  Measuring the mean Web page size and its compression to limit latency and improve download time , 2001, Internet Res..

[6]  Vivek S. Pai,et al.  Towards understanding modern web traffic , 2011, SIGMETRICS '11.

[7]  D Manyu,et al.  Hypertext transfer protocol , 2009 .

[8]  Maruti Gupta,et al.  A NEW TRAFFIC MODEL FOR CURRENT USER WEB BROWSING BEHAVIOR , 2007 .

[9]  Yu Wang,et al.  Different behavioral characteristics of Web traffic between wireless and wire IP network , 2003, International Conference on Communication Technology Proceedings, 2003. ICCT 2003..

[10]  Hyoung-Kee Choi,et al.  A behavioral model of Web traffic , 1999, Proceedings. Seventh International Conference on Network Protocols.

[11]  Bruce A. Mah,et al.  An empirical model of HTTP network traffic , 1997, Proceedings of INFOCOM '97.

[12]  S. Hadjiefthymiades,et al.  Hypertext Transfer Protocol (HTTP) , 1996 .

[13]  Phuoc Tran-Gia,et al.  Source Traffic Modeling of Wireless Applications , 2001 .

[14]  Ion Stoica,et al.  HTTP as the narrow waist of the future internet , 2010, Hotnets-IX.

[15]  Paul Barford,et al.  Generating representative Web workloads for network and server performance evaluation , 1998, SIGMETRICS '98/PERFORMANCE '98.

[16]  Vyas Sekar,et al.  Understanding website complexity: measurements, metrics, and implications , 2011, IMC '11.

[17]  Phuoc Tran-Gia,et al.  On Traffic Characteristics of a Broadband Wireless Internet Access , 2009, 2009 Next Generation Internet Networks.

[18]  Michael Bolin.  End-user programming for the Web , 2005 .