On the Use of Resource Reservation for Web Services Load Balancing

Abstract A key issue for good performance of worldwide distributed web services is the efficiency of the load balancing mechanism used to distribute client requests among the replicated servers. The load balancing solution allows providers to make better use of their resources, soften the need for over-provision, and help tolerate abrupt load peaks. In this paper, we propose a new load balancing solution that reduces service response times by applying a protocol for the reservation of remote resources. This protocol prevents the overload of remote servers by limiting the amount of load each server can redirect to the others. We describe a middleware that supports this protocol by managing the trade of resources among a set of servers, allowing them to share their spare capacity in a transparent way. We also present the results of a large set of simulations that encompass an exhaustive set of workload scenarios based on realistic internet traffic models.

[1]  Rajkumar Buyya,et al.  Inter‐Cloud architectures and application brokering: taxonomy and survey , 2014, Softw. Pract. Exp..

[2]  Philip S. Yu,et al.  A Performance Study of Robust Load Sharing Strategies for Distributed Heterogeneous Web Server Systems , 2002, IEEE Trans. Knowl. Data Eng..

[3]  Ray Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[4]  E BustamanteFabián,et al.  Drafting behind Akamai (travelocity-based detouring) , 2006 .

[5]  Z. Tari,et al.  A task-based adaptive TTL approach for Web server load balancing , 2004, 10th IEEE Symposium on Computers and Communications (ISCC'05).

[6]  Marco Conti,et al.  Content Delivery Policies in Replicated Web Services: Client-Side vs. Server-Side , 2004, Cluster Computing.

[7]  Luiz Eduardo Buzato,et al.  Lab4WS: A Testbed for Web Services , 2009, 2009 2nd International Conference on Computer Science and its Applications.

[8]  Kay A. Robbins,et al.  An empirical evaluation of client-side server selection algorithms , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[9]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[10]  S. Y. Kim,et al.  DNS-based load balancing in distributed Web-server systems , 2006, The Fourth IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, and the Second International Workshop on Collaborative Computing, Integration, and Assurance (SEUS-WCCIA'06).

[11]  Atul Garg,et al.  Collective Intelligence based Framework for Load Balancing of Web Servers , 2012 .

[12]  Azer Bestavros,et al.  DNS-based Internet client clustering and characterization , 2001 .

[13]  Marco Conti,et al.  QoS-based Architectures for Geographically Replicated Web Servers , 2001, Cluster Computing.

[14]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.

[15]  Liming Liu,et al.  Dynamic traffic controls for Web-server networks , 2004, Comput. Networks.

[16]  Supranamaya Ranjan,et al.  High-Performance Resource Allocation and Request Redirection Algorithms for Web Clusters , 2008, IEEE Transactions on Parallel and Distributed Systems.

[17]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[18]  Dennis Shasha,et al.  Statistics is Easy! , 2008, Statistics is Easy!.

[19]  Hiroshi Yokota,et al.  A proposal of DNS-based adaptive load balancing method for mirror server systems and its implementation , 2004, 18th International Conference on Advanced Information Networking and Applications, 2004. AINA 2004..

[20]  Philip S. Yu,et al.  Dynamic Load Balancing on Web-Server Systems , 1999, IEEE Internet Comput..

[21]  Nitin,et al.  Load Balancing of Nodes in Cloud Using Ant Colony Optimization , 2012, 2012 UKSim 14th International Conference on Computer Modelling and Simulation.

[22]  Edmundo Roberto Mauro Madeira,et al.  Load Balancing for Internet Distributed Services Using Limited Redirection Rates , 2011, 2011 5th Latin-American Symposium on Dependable Computing.

[23]  Rajkumar Buyya,et al.  Resource discovery and request-redirection for dynamic load sharing in multi-provider peering content delivery networks , 2009, J. Netw. Comput. Appl..

[24]  Michele Colajanni,et al.  Autonomic Request Management Algorithms for Geographically Distributed Internet-Based Systems , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[25]  Philip S. Yu,et al.  Analysis of Task Assignment Policies in Scalable Distributed Web-Server Systems , 1998, IEEE Trans. Parallel Distributed Syst..

[26]  Edmundo Roberto Mauro Madeira,et al.  DNS-based Load Balancing for Web Services , 2010, WEBIST.

[27]  Philip S. Yu,et al.  Request Redirection Algorithms for Distributed Web Systems , 2003, IEEE Trans. Parallel Distributed Syst..

[28]  Marco Conti,et al.  Client-side content delivery policies in replicated web services: parallel access versus single server approach , 2005, Perform. Evaluation.

[29]  Jin Cao,et al.  Stochastic models for generating synthetic HTTP source traffic , 2004, IEEE INFOCOM 2004.

[30]  Luiz André Barroso,et al.  Web Search for a Planet: The Google Cluster Architecture , 2003, IEEE Micro.

[31]  Stefan Savage,et al.  Modeling TCP latency , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[32]  Michele Colajanni,et al.  Algorithms for Web service selection with static and dynamic requirements , 2012, Service Oriented Computing and Applications.

[33]  Tomoya Enokido,et al.  The fourth IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, SEUS 2006 and the second International Workshop on Collaborative Computing, Integration, and Assurance, WCCIA 2006 : proceedings : 27-28 April 2006, Gyeongju, Korea , 2006 .

[34]  Michele Colajanni,et al.  Models and framework for supporting runtime decisions in Web-based systems , 2008, TWEB.

[35]  Johan Tordsson,et al.  Efficient provisioning of bursty scientific workloads on the cloud using adaptive elasticity control , 2012, ScienceCloud '12.

[36]  Jianping Pan,et al.  An overview of DNS-based server selections in content distribution networks , 2003, Comput. Networks.

[37]  Balachander Krishnamurthy,et al.  On network-aware clustering of Web clients , 2000, SIGCOMM.

[38]  Myung Ho Kim,et al.  Dynamic Load Balancing Method Based on DNS for Distributed Web Systems , 2005, EC-Web.

[39]  Barbara Panicucci,et al.  Flexible Distributed Capacity Allocation and Load Redirect Algorithms for Cloud Systems , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[40]  Barbara Panicucci,et al.  Multi-timescale Distributed Capacity Allocation and Load Redirect Algorithms for Cloud System , 2011 .

[41]  Richard Wang,et al.  OpenFlow-Based Server Load Balancing Gone Wild , 2011, Hot-ICE.

[42]  Carlos Juiz,et al.  An up-to-date survey in web load balancing , 2011, World Wide Web.

[43]  Nabor das Chagas Mendonça,et al.  Client-side selection of replicated web services: An empirical assessment , 2008, J. Syst. Softw..

[44]  Aleksandar Kuzmanovic,et al.  Drafting behind Akamai (travelocity-based detouring) , 2006, SIGCOMM 2006.

[45]  Anees Shaikh,et al.  On the effectiveness of DNS-based server selection , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).