Multi-Capacity Combinatorial Ordering GA in Application to Cloud resources allocation and efficient virtual machines consolidation

Abstract This paper describes a novel approach making use of genetic algorithms to find optimal solutions for multi-dimensional vector bin packing problems with the goal to improve cloud resource allocation and Virtual Machines (VMs) consolidation. Two algorithms, namely Combinatorial Ordering First-Fit Genetic Algorithm (COFFGA) and Combinatorial Ordering Next Fit Genetic Algorithm (CONFGA) have been developed for that and combined. The proposed hybrid algorithm targets to minimise the total number of running servers and resources wastage per server. The solutions obtained by the new algorithms are compared with latest solutions from literature. The results show that the proposed algorithm COFFGA outperforms other previous multi-dimension vector bin packing heuristics such as Permutation Pack (PP), First Fit (FF) and First Fit Decreasing (FFD) by 4%, 34%, and 39%, respectively. It also achieved better performance than the existing genetic algorithm for multi-capacity resources virtual machine consolidation (RGGA) in terms of performance and robustness. A thorough explanation for the improved performance of the newly proposed algorithm is given.

[1]  Graham Kendall,et al.  Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques , 2013 .

[2]  El-Ghazali Talbi,et al.  Self-adaptive metaheuristics for solving a multi-objective 2-dimensional vector packing problem , 2014, Appl. Soft Comput..

[3]  Roger L. Wainwright,et al.  Using LibGA to Develop Genetic Algorithms for Solving Combinatorial Optimization Problems , 1995 .

[4]  Hitoshi Iima,et al.  A new design of genetic algorithm for bin packing , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[5]  G. Karagiannis,et al.  Cloud computing services: taxonomy and comparison , 2011, Journal of Internet Services and Applications.

[6]  Wei Wang,et al.  A novel energy-efficient resource allocation algorithm based on immune clonal optimization for green cloud computing , 2014, EURASIP Journal on Wireless Communications and Networking.

[7]  Andreas Wolke,et al.  Improving Enterprise VM Consolidation with High-Dimensional Load Profiles , 2014, 2014 IEEE International Conference on Cloud Engineering.

[8]  Shriram Raghunathan,et al.  Heterogeneity and thermal aware adaptive heuristics for energy efficient consolidation of virtual machines in infrastructure clouds , 2016, J. Comput. Syst. Sci..

[9]  A. Taleb-Bendiab,et al.  A Comparative Study into Distributed Load Balancing Algorithms for Cloud Computing , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[10]  Armin Scholl,et al.  Bison: A fast hybrid procedure for exactly solving the one-dimensional bin packing problem , 1997, Comput. Oper. Res..

[11]  Henri Casanova,et al.  Virtual Machine Resource Allocation for Service Hosting on Heterogeneous Distributed Platforms , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium.

[12]  Jing Xu,et al.  Multi-Objective Virtual Machine Placement in Virtualized Data Center Environments , 2010, 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing.

[13]  Liang Liu,et al.  Energy efficient scheduling of virtual machines in cloud with deadline constraint , 2015, Future Gener. Comput. Syst..

[14]  S. K. Chang,et al.  A general packing algorithm for multidimensional resource requirements , 1977, International Journal of Computer & Information Sciences.

[15]  Parisa Ghodous,et al.  Enhanced First-Fit Decreasing Algorithm for Energy-Aware Job Scheduling in Cloud , 2014, 2014 International Conference on Computational Science and Computational Intelligence.

[16]  Maunika M Ramani,et al.  Energy Aware Load Balancing In Cloud Computing Using Virtual Machines , 2015 .

[17]  Hitesh A. Bheda,et al.  Genetic Algorithm Based Resource Scheduling Technique in Cloud Computing , 2013 .

[18]  Lionel Eyraud-Dubois,et al.  Optimizing Resource allocation while handling SLA violations in Cloud Computing platforms , 2013, 2013 IEEE 27th International Symposium on Parallel and Distributed Processing.

[19]  Chien-Hung Chen,et al.  Integrating QoS awareness with virtualization in cloud computing systems for delay-sensitive applications , 2014, Future Gener. Comput. Syst..

[20]  Robert T. Sumichrast,et al.  Impact of the replacement heuristic in a grouping genetic algorithm , 2003, Comput. Oper. Res..

[21]  Kevin D. Seppi,et al.  Solving virtual machine packing with a Reordering Grouping Genetic Algorithm , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[22]  Roger L. Wainwright,et al.  LibGA: a user-friendly workbench for order-based genetic algorithm research , 1993, SAC '93.

[23]  Thibaut Vidal,et al.  An iterated local search heuristic for multi-capacity bin packing and machine reassignment problems , 2013, Expert Syst. Appl..

[24]  R Yesodha A Comparative Study On Heuristic Procedures To Solve Bin Packing Problems , 2012, FOCS 2012.

[25]  Xiujuan Xu,et al.  Task Scheduling Based on Multi-objective Genetic Algorithm in Cloud Computing ? , 2015 .

[26]  Marc Frîncu,et al.  Scheduling highly available applications on cloud environments , 2014, Future Gener. Comput. Syst..

[27]  Rajeev Motwani,et al.  Approximation algorithms for scheduling problems , 1998 .

[28]  Akansha Jain,et al.  Implementation of a Fast Vector Packing Algorithm and its Application for Server Consolidation , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[29]  Julien Gossa,et al.  Cost-Wait Trade-Offs in Client-Side Resource Provisioning with Elastic Clouds , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[30]  Vipin Kumar,et al.  Multi-capacity bin packing algorithms with applications to job scheduling under multiple constraints , 1999, Proceedings of the 1999 International Conference on Parallel Processing.

[31]  Ian Sommerville,et al.  Understanding Tradeoffs between Power Usage and Performance in a Virtualized Environment , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[32]  Wenzhi Chen,et al.  Efficient consolidation-aware VCPU scheduling on multicore virtualization platform , 2016, Future Gener. Comput. Syst..

[33]  K. Chandrasekaran,et al.  Load Balancing of Virtual Machine Resources in Cloud Using Genetic Algorithm , 2013 .

[34]  Henri Casanova,et al.  Resource allocation algorithms for virtualized service hosting platforms , 2010, J. Parallel Distributed Comput..

[35]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[36]  Chen Jin,et al.  LIF: A Dynamic Scheduling Algorithm for Cloud Data Centers Considering Multi-dimensional Resources ⋆ , 2013 .

[37]  Zhang,et al.  Book Review "William R. Spillers and Keith M. MacBain. Structural Optimization, Springer Dordrecht Heidelberg London New York, 2009" , 2010 .

[38]  Mihai Barbulescu,et al.  A comparison of the performance and scalability of Xen and KVM hypervisors , 2013, 2013 RoEduNet International Conference 12th Edition: Networking in Education and Research.

[39]  José Torres-Jiménez,et al.  A grouping genetic algorithm with controlled gene transmission for the bin packing problem , 2015, Comput. Oper. Res..

[40]  Rajkumar Buyya,et al.  Virtual Machine Consolidation in Cloud Data Centers Using ACO Metaheuristic , 2014, Euro-Par.

[41]  Borko Furht,et al.  Handbook of Cloud Computing , 2010 .

[42]  Jianhua Gu,et al.  A New Resource Scheduling Strategy Based on Genetic Algorithm in Cloud Computing Environment , 2012, J. Comput..

[43]  Yaduvir Singh,et al.  Genetic Algorithms: Concepts, Design for Optimization of Process Controllers , 2011, Comput. Inf. Sci..

[44]  Zoltán Ádám Mann,et al.  A taxonomy for the virtual machine allocation problem∗ , 2015 .