File allocation for a parallel Webserver

This paper considers the problem of allocating files in a document tree among multiple processors in a parallel webserver. It is assumed that access patterns are characterized by branching probabilities for an access that starts at a node and progresses down the tree. A combinatorial optimization problem is formulated that includes load balancing and communication costs. The general problem is shown to be NP-complete, and a pseudo-polynomial time algorithm is outlined. In addition, two fast heuristic algorithms are presented and evaluated using simulation.

[1]  Philip S. Yu,et al.  On Optimal Site Assignment for Relations in the Distributed Database Environment , 1989, IEEE Trans. Software Eng..

[2]  Olivia R. Liu Sheng.  Dynamic file migration in distributed computer systems , 1990, CACM.

[3]  Daniel A. Reed,et al.  NCSA's World Wide Web Server: Design and Performance , 1995, Computer.

[4]  Dorit S. Hochbaum,et al.  Database Location in Computer Networks , 1980, JACM.

[5]  Hava T. Siegelmann,et al.  Document Allocation In Multiprocessor Information Retrieval Systems , 1993, Advanced Database Systems.

[6]  Bhaba R. Sarker,et al.  Discrete location theory , 1991 .

[7]  Richard S. Hall,et al.  A case for caching file objects inside internetworks , 1993, SIGCOMM 1993.

[8]  Azer Bestavros,et al.  Using speculation to reduce server load and service time on the WWW , 1995, CIKM '95.

[9]  Yelena Yesha,et al.  Towards Flexible Distributed Information Retrieval , 1993, Advanced Database Systems.

[10]  Giancarlo Martella,et al.  Optimal File Allocation in a Computer Network: a Solution Method Based on the Knapsack Problem , 1982, Comput. Networks.

[11]  Tim Berners-Lee,et al.  The World-Wide Web , 1994, CACM.

[12]  Rahul Simha,et al.  A Microeconomic Approach to Optimal Resource Allocation in Distributed Computer Systems , 1989, IEEE Trans. Computers.

[13]  Lawrence W. Dowdy,et al.  Comparative Models of the File Assignment Problem , 1982, CSUR.

[14]  Peter M G Apers,et al.  Data allocation in distributed database systems , 1988, TODS.