A sliding window based Self-Learning and Adaptive Load Balancer

A load balancer distributes load among individual resources to minimize the response time, maximize the throughput and efficiently utilize the resources. Static load balancers distribute requests based on pre-known server capability ratios. Dynamic load balancers either observe or collect the performance indicating attributes of the servers, and distribute the load based on the analysis performed on the observed or collected data. The observation based load balancers use the quickest response time and the least number of connections to select a server to process an arrived request. Both the static load balancing and observation based models do not produce optimal throughput when the server capabilities change over time. This paper introduces a Sliding window based Self-learning and Adaptive Load Balancer (SSAL) that optimizes throughput in both the stable and unstable server environments. The SSAL logically divides time into fixed size intervals, assigns the requests in batches and makes corrections based on the performance of the servers observed in each interval. The SSAL (i) discovers the initial capabilities of the servers and perform incremental corrections needed in the subsequent intervals, (ii) produces throughput, better than the static load balancing model in stable environments, and (iii) produces throughput better than the quickest response time and least connections based models in unsteady environments. Experiments are conducted to compare the performance of the SSAL to other models under various stable and unstable server environments. The experimental results confirm that the SSAL produces optimal throughput in both stable and unstable environments, and the turnaround time similar to or better than that of the observation based models. The proposed model is useful where the capabilities of the servers change over time and the optimal throughput is required.

[1]  Leili Mohammad Khanli,et al.  A new step toward load balancing based on competency rank and transitional phases in Grid networks , 2012, Future Gener. Comput. Syst..

[2]  Yalin Ding,et al.  A dynamic load balancing strategy with the push and pull approaches in DHT networks , 2012, Comput. Electr. Eng..

[3]  Kam-Wing Ng,et al.  Resilient and efficient load balancing in distributed hash tables , 2009, J. Netw. Comput. Appl..

[4]  Jiann-Liang Chen,et al.  Load-balancing mechanism for the RFID middleware applications over grid networking , 2011, J. Netw. Comput. Appl..

[5]  Ümit V. Çatalyürek,et al.  A repartitioning hypergraph model for dynamic load balancing , 2009, J. Parallel Distributed Comput..

[6]  Rui Li,et al.  A Load-balancing method for network GISs in a heterogeneous cluster-based system using access density , 2013, Future Gener. Comput. Syst..

[7]  Jameela Al-Jaroodi,et al.  A dual-direction technique for fast file downloads with dynamic load balancing in the Cloud , 2013, J. Netw. Comput. Appl..

[8]  Valli Kumari Vatsavayi,et al.  A model view controller based Self-Adjusting Clustering Framework , 2014, J. Syst. Softw..

[9]  Limin Xiao,et al.  A dynamic and adaptive load balancing strategy for parallel file system with large-scale I/O servers , 2012, J. Parallel Distributed Comput..

[10]  Guanfeng Liu,et al.  An enhanced load balancing mechanism based on deadline control on GridSim , 2012, Future Gener. Comput. Syst..

[11]  Raju Nedunchezhian,et al.  A hybrid policy for fault tolerant load balancing in grid computing environments , 2012, J. Netw. Comput. Appl..

[12]  Maode Ma,et al.  A hybrid load balancing strategy of sequential tasks for grid computing environments , 2009, Future Gener. Comput. Syst..

[13]  Asser N. Tantawi,et al.  Design, Implementation, and Performance of a Load Balancer for SIP Server Clusters , 2012, IEEE/ACM Transactions on Networking.

[14]  Hasan U. Akay,et al.  Dynamic load balancing on a network of workstations for solving computational fluid dynamics problems , 1994 .

[15]  Valeria V. Krzhizhanovskaya,et al.  Dynamic workload balancing of parallel applications with user-level scheduling on the Grid , 2009, Future Gener. Comput. Syst..

[16]  Yichuan Jiang,et al.  Locality-sensitive task allocation and load balancing in networked multiagent systems: Talent versus centrality , 2011, J. Parallel Distributed Comput..

[17]  Zhong Zhou,et al.  Replica-aided load balancing in overlay networks , 2013, J. Netw. Comput. Appl..

[18]  Zhiling Lan,et al.  A novel dynamic load balancing scheme for parallel systems , 2002, J. Parallel Distributed Comput..

[19]  Azzedine Boukerche,et al.  Dynamic balancing of communication and computation load for HLA-based simulations on large-scale distributed systems , 2011, J. Parallel Distributed Comput..

[20]  Jie Lin,et al.  Agent scheduling model for adaptive dynamic load balancing in agent-based distributed simulations , 2011, Simul. Model. Pract. Theory.

[21]  Takashi Isobe,et al.  Load balancer for high efficient VOD system achieving quick seek , 2011, 2011 1st International Symposium on Access Spaces (ISAS).

[22]  Behdis Eslamnour,et al.  A case for on-machine load balancing , 2011, J. Parallel Distributed Comput..

[23]  Salma A. Ghoneim,et al.  Load balancing in distributed multi-agent computing systems , 2012 .