A Survey on Load Balancing in Cloud Systems for Big Data Applications

Today’s ever-growing information world, in which we witness the juggernaut of information explosion stemming from social networks, medical records, diverse medias, IoT, and so forth, has called for a solution—encompassing boundless resources for this voluminous information’s storing as well as processing in a distributed manner. To do so, although cloud computing has come up with an applicable remedy, it has overwhelmingly required a well-defined load-balancing mechanism, lifeblood of any given distributed system; a load-balancing algorithm has consistently strove to pinpoint overloaded nodes so as to disseminate and shift the burden of extra workload towards the under-loaded ones—by which the overall system performance in terms of resource utilization, throughput, cost, and response time will be guaranteed after all. In the interests of placing a high premium on load-balancing issue in distributed systems, in this study, we have provided a review concerning load-balancing algorithms in cloud environment for Big Data environment.

[1]  Shyan-Ming Yuan,et al.  A small world based overlay network for improving dynamic load-balancing , 2015, J. Syst. Softw..

[2]  Ekta Gupta,et al.  A Technique Based on Ant Colony Optimization for Load Balancing in Cloud Data Center , 2014, 2014 International Conference on Information Technology.

[3]  Kai Zhu,et al.  Hybrid Genetic Algorithm for Cloud Computing Applications , 2011, 2011 IEEE Asia-Pacific Services Computing Conference.

[4]  Carlo Curino,et al.  Apache Hadoop YARN: yet another resource negotiator , 2013, SoCC.

[5]  Kai Pan,et al.  Load balancing in cloud computing environment based on an improved particle swarm optimization , 2015, 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[6]  Anthony T. Chronopoulos,et al.  Noncooperative load balancing in distributed systems , 2005, J. Parallel Distributed Comput..

[7]  Mr.Gaurav Sharma,et al.  A REVIEW ON DIFFERENT APPROACHES FOR LOAD BALANCING IN COMPUTATIONAL GRID , 2013 .

[8]  Wei-Tsong Lee,et al.  Dynamic load balancing mechanism based on cloud storage , 2012, 2012 Computing, Communications and Applications Conference.

[9]  Rodney S. Tucker,et al.  Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport , 2011, Proceedings of the IEEE.

[10]  Ck Cheng,et al.  The Age of Big Data , 2015 .

[11]  Bradley R. Schmerl,et al.  Big Data in Cloud Computing: Features and Issues , 2016, IoTBD.

[12]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[13]  Mohammed Farik,et al.  Static Load Balancing Algorithms In Cloud Computing: Challenges & Solutions , 2015 .

[14]  L. D. Dhinesh Babu,et al.  Honey bee behavior inspired load balancing of tasks in cloud computing environments , 2013, Appl. Soft Comput..

[15]  Kuo-Qin Yan,et al.  Towards a Load Balancing in a three-level cloud computing network , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[16]  Yi Zhao,et al.  Adaptive Distributed Load Balancing Algorithm Based on Live Migration of Virtual Machines in Cloud , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[17]  V. Hayward,et al.  Big data: The next Google , 2008, Nature.

[18]  Scott Froberg.  Distributed and cloud computing from parallel processing to the internet of things by Kai Hwang, Geoffry C. Fox, and Jack J. Dongarra , 2013, SOEN.

[19]  Patrick Wendell,et al.  Sparrow: distributed, low latency scheduling , 2013, SOSP.

[20]  Ning Zhang,et al.  SAACO: A Self Adaptive Ant Colony Optimization in Cloud Computing , 2015, 2015 IEEE Fifth International Conference on Big Data and Cloud Computing.

[21]  Dan Wang,et al.  Cloud Task Scheduling Based on Load Balancing Ant Colony Optimization , 2011, 2011 Sixth Annual Chinagrid Conference.

[22]  Carlo Curino,et al.  Mercury: Hybrid Centralized and Distributed Scheduling in Large Shared Clusters , 2015, USENIX Annual Technical Conference.

[23]  R. Shankar,et al.  A Survey of Load Balancing Techniques in Cloud Computing , 2013 .

[24]  V. K. Yadav,et al.  Reliable Task Allocation in Heterogeneous Distributed System with Random Node Failure: Load Sharing Approach , 2012, 2012 International Conference on Computing Sciences.

[25]  Abhishek Verma,et al.  Large-scale cluster management at Google with Borg , 2015, EuroSys.

[26]  Amir Masoud Rahmani,et al.  Load-balancing algorithms in cloud computing: A survey , 2017, J. Netw. Comput. Appl..

[27]  Mohsen Sharifi,et al.  Improving Learning-Based Request Forwarding in Resource Discovery through Load-Awareness , 2011, Globe.

[28]  T. Kokilavani,et al.  Load Balanced MinMin Algorithm for Static MetaTask Scheduling in Grid Computing , 2011 .

[29]  Yon Dohn Chung,et al.  Parallel data processing with MapReduce: a survey , 2012, SGMD.

[30]  Zenon Chaczko,et al.  Load balancing optimization in cloud computing: Applying Endocrine-particale swarm optimization , 2015, 2015 IEEE International Conference on Electro/Information Technology (EIT).

[31]  Chang-Dong Wang,et al.  An ACO-based Scheduling Strategy on Load Balancing in Cloud Computing Environment , 2015, 2015 Ninth International Conference on Frontier of Computer Science and Technology.

[32]  Mohsen Sharifi,et al.  An Efficient Live Process Migration Approach for High Performance Cluster Computing Systems , 2011 .

[33]  Inderveer Chana,et al.  Cloud Load Balancing Techniques : A Step Towards Green Computing , 2012 .

[34]  Said Ghoniemy,et al.  A Survey of Load Balancing In High-Performance Distributed Computing Systems , 2014 .

[35]  Tingting Wang,et al.  Load Balancing Task Scheduling Based on Genetic Algorithm in Cloud Computing , 2014, 2014 IEEE 12th International Conference on Dependable, Autonomic and Secure Computing.

[36]  Inderveer Chana,et al.  Load Balancing and Job Migration Techniques in Grid: A Survey of Recent Trends , 2014, Wireless Personal Communications.

[37]  Sajal Kabiraj,et al.  Going Green: A Holistic Approach to Transform Business , 2010, ArXiv.

[38]  Scott Shenker,et al.  Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling , 2010, EuroSys '10.

[39]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[40]  Kavita Shinde,et al.  Challenges of Big Data Processing and Scheduling of Processes Using Various Hadoop Schedulers: A Survey , 2017 .

[41]  Nader Mohamed,et al.  A Survey of Load Balancing in Cloud Computing: Challenges and Algorithms , 2012, 2012 Second Symposium on Network Cloud Computing and Applications.

[42]  Jing Yao,et al.  Load balancing strategy of cloud computing based on artificial bee algorithm , 2012, 2012 8th International Conference on Computing Technology and Information Management (NCM and ICNIT).

[43]  Kemafor Anyanwu,et al.  Scheduling Hadoop Jobs to Meet Deadlines , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[44]  T. Kokilavani,et al.  Load Balanced Min-Min Algorithm for Static Meta-Task Scheduling in Grid Computing , 2011 .

[45]  Xuejie Zhang,et al.  A load balancing mechanism based on ant colony and complex network theory in open cloud computing federation , 2010, 2010 The 2nd International Conference on Industrial Mechatronics and Automation.

[46]  P. Santhi Thilagam,et al.  Load balancing in cloud based on live migration of virtual machines , 2013, 2013 Annual IEEE India Conference (INDICON).

[47]  Philip Samuel,et al.  Load Balancing of Tasks in Cloud Computing Environment Based on Bee Colony Algorithm , 2015, 2015 Fifth International Conference on Advances in Computing and Communications (ICACC).

[48]  Michael Abd-El-Malek,et al.  Omega: flexible, scalable schedulers for large compute clusters , 2013, EuroSys '13.

[49]  Nitin,et al.  Load Balancing of Nodes in Cloud Using Ant Colony Optimization , 2012, 2012 UKSim 14th International Conference on Computer Modelling and Simulation.

[50]  Geoffrey C. Fox,et al.  Big Data, Simulations and HPC Convergence , 2015, WBDB.

[51]  R. K. Pateriya,et al.  Cloud Computing Overview with Load Balancing Techniques , 2013 .

[52]  A. Khiyaita,et al.  Load balancing cloud computing: State of art , 2012, 2012 National Days of Network Security and Systems.

[53]  Rama Sushil,et al.  Analytical literature survey on existing load balancing schemes in cloud computing , 2015, 2015 International Conference on Green Computing and Internet of Things (ICGCIoT).

[54]  Lucio Grandinetti,et al.  Dynamic load balancing in distributed exascale computing systems , 2017, Cluster Computing.

[55]  Rajkumar Buyya,et al.  Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers , 2011, J. Parallel Distributed Comput..

[56]  Saurabh Bilgaiyan,et al.  A study on load balancing in cloud computing environment using evolutionary and swarm based algorithms , 2014, 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).

[57]  Aarti Singh,et al.  Autonomous Agent Based Load Balancing Algorithm in Cloud Computing , 2015 .

[58]  Pranshu Gupta,et al.  Green data center: how green can we perform? , 2010 .

[59]  Paramartha Dutta,et al.  Genetic algorithm and gravitational emulation based hybrid load balancing strategy in cloud computing , 2015, Proceedings of the 2015 Third International Conference on Computer, Communication, Control and Information Technology (C3IT).