SWEB: towards a scalable World Wide Web server on multicomputers

We investigate the issues involved in developing a scalable World Wide Web (WWW) server on a cluster of workstations and parallel machines. The objective is to strengthen the processing capabilities of such a server by utilizing the power of multicomputers to match huge demands in simultaneous access requests from the Internet. We have implemented a system called SWEB on a distributed memory machine, the Meiko CS-2, and networked workstations. The scheduling component of the system actively monitors the usages of CPU, I/O channels and the interconnection network to effectively distribute HTTP requests across processing units to exploit task and I/O parallelism. We present the experimental results on the performance of this system.

[1]  James A. Gosling,et al.  The java language environment: a white paper , 1995 .

[2]  Kun Yang,et al.  An intelligent dynamic load balancer for workstation clusters , 1995, OPSR.

[3]  Peter B. Danzig,et al.  The Harvest Information Discovery and Access System , 1995, Comput. Networks ISDN Syst..

[4]  Ali R. Hurson,et al.  Scheduling and Load Balancing in Parallel and Distributed Systems , 1995 .

[5]  Oscar H. Ibarra,et al.  The WWW Prototype of the Alexandria Digital Library , 1995 .

[6]  Michelle Butler,et al.  A Scalable HTTP Server: The NCSA Prototype , 1994, Comput. Networks ISDN Syst..

[7]  Min-You Wu,et al.  An Incremental Parallel Scheduling Approach to Solving Dynamic and Irregular Problems , 1995, ICPP.

[8]  Ed Zaluska,et al.  Parallel Load-Balancing: An Extension to the Gradient Model , 1995, Parallel Comput..

[9]  Mukesh Singhal,et al.  Measures of the Potential for Load Sharing in Distributed Computing Systems , 1995, IEEE Trans. Software Eng..

[10]  Francine Berman,et al.  Developing Heterogeneous Applications Using Zoom and HeNCE , 1995 .

[11]  Jonathan C. L. Liu,et al.  Performance of a Mass-Storage System for Video-on-Demand , 1995, J. Parallel Distributed Comput..

[12]  V. Rich.  Personal communication , 1989, Nature.

[13]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[14]  Ravishankar K. Iyer,et al.  Prediction-Based Dynamic Load-Sharing Heuristics , 1993, IEEE Trans. Parallel Distributed Syst..

[15]  Anthony P. Reeves,et al.  Strategies for Dynamic Load Balancing on Highly Parallel Computers , 1993, IEEE Trans. Parallel Distributed Syst..