A completely distributed architecture for cluster-based Web servers

While content-aware distribution policies getting more popular in cluster-based Web systems, they make the dispatching node a bottleneck. To achieve scalable server performance, we present a completely distributed architecture named CODA. In CODA, we employ both layer-4 and layer-7 Web switching techniques. While the front-end layer-4 switch distributes the client requests among the server nodes using some simple dispatching algorithm, the server nodes may forward the incoming request to another server node according to some content-aware policy. By eliminating the centralized dispatcher, CODA affords better scalability and fault tolerance. Moreover, we have implemented this architecture on the basis of Linux IP stack and evaluated its performance with trace-based workloads. Our performance results show it can achieve favorable throughput compared to existing architectures.

[1]  Sampath Rangarajan,et al.  On the Performance of TCP Splicing for URL-Aware Redirection , 1999, USENIX Symposium on Internet Technologies and Systems.

[2]  Yi-Min Wang,et al.  ONE-IP: Techniques for Hosting a Service on a Cluster of Machines , 1997, Comput. Networks.

[3]  Peter Druschel,et al.  Measuring the Capacity of a Web Server , 1997, USENIX Symposium on Internet Technologies and Systems.

[4]  Willy Zwaenepoel,et al.  Scalable Content-aware Request Distribution in Cluster-based Network Servers , 2000, USENIX ATC, General Track.

[5]  Mon-Yen Luo,et al.  A content placement and management system for distributed Web-server systems , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[6]  Byrav Ramamurthy,et al.  LSMAC: An improved load sharing network service dispatcher , 2004, World Wide Web.

[7]  Guerney D. H. Hunt,et al.  Network Dispatcher: A Connection Router for Scalable Internet Services , 1998, Comput. Networks.

[8]  Philip S. Yu,et al.  The state of the art in locally distributed Web-server systems , 2002, CSUR.

[9]  David A. Maltz,et al.  TCP Splice for application layer proxy performance , 1999, J. High Speed Networks.

[10]  Margo Seltzer,et al.  HACC: an architecture for cluster-based web servers , 1999 .

[11]  Erich M. Nahum,et al.  Locality-aware request distribution in cluster-based network servers , 1998, ASPLOS VIII.

[12]  Magnus Karlsson,et al.  Scalable Web server cluster design with workload-aware request distribution strategy WARD , 2001, Proceedings Third International Workshop on Advanced Issues of E-Commerce and Web-Based Information Systems. WECWIS 2001.

[13]  Mon-Yen Luo,et al.  Efficient Support for Content-based Routing in Web Server Clusters , 1999, USENIX Symposium on Internet Technologies and Systems.

[14]  Azer Bestavros,et al.  Distributed packet rewriting and its application to scalable server architectures , 1998, Proceedings Sixth International Conference on Network Protocols (Cat. No.98TB100256).