An Algorithm for Network and Data-aware Placement of Multi-Tier Applications in Cloud Data Centers

Today's Cloud applications are dominated by composite applications comprising multiple computing and data components with strong communication correlations among them. Although Cloud providers are deploying large number of computing and storage devices to address the ever increasing demand for computing and storage resources, network resource demands are emerging as one of the key areas of performance bottleneck. This paper addresses network-aware placement of virtual components (computing and data) of multi-tier applications in data centers and formally defines the placement as an optimization problem. The simultaneous placement of Virtual Machines and data blocks aims at reducing the network overhead of the data center network infrastructure. A greedy heuristic is proposed for the on-demand application components placement that localizes network traffic in the data center interconnect. Such optimization helps reducing communication overhead in upper layer network switches that will eventually reduce the overall traffic volume across the data center. This, in turn, will help reducing packet transmission delay, increasing network performance, and minimizing the energy consumption of network components. Experimental results demonstrate performance superiority of the proposed algorithm over other approaches where it outperforms the state-of-the-art network-aware application placement algorithm across all performance metrics by reducing the average network cost up to 67% and network usage at core switches up to 84%, as well as increasing the average number of application deployments up to 18%.

[1]  Stuart Walker,et al.  Data intensive, computing and network aware (DCN) cloud VMs scheduling algorithm , 2016, 2016 Future Technologies Conference (FTC).

[2]  Xin Li,et al.  Traffic and failure aware VM placement for multi-tenant cloud computing , 2015, 2015 IEEE 23rd International Symposium on Quality of Service (IWQoS).

[3]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[4]  Antonio Corradi,et al.  VM consolidation: A real case based on OpenStack Cloud , 2014, Future Gener. Comput. Syst..

[5]  Anton Beloglazov,et al.  Energy-efficient management of virtual machines in data centers for cloud computing , 2013 .

[6]  Ann L. Chervenak,et al.  Characterizing and profiling scientific workflows , 2013, Future Gener. Comput. Syst..

[7]  Zhuzhong Qian,et al.  Minimizing Communication Traffic in Data Centers with Power-Aware VM Placement , 2012, 2012 Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[8]  Ofer Biran,et al.  VM Placement Strategies for Cloud Scenarios , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[9]  Eric Bouillet,et al.  Efficient resource provisioning in compute clouds via VM multiplexing , 2010, ICAC '10.

[10]  Dzmitry Kliazovich,et al.  DENS: data center energy-efficient network-aware scheduling , 2010, Cluster Computing.

[11]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[12]  Li-Chun Wang,et al.  EQVMP: Energy-efficient and QoS-aware virtual machine placement for software defined datacenter networks , 2014, The International Conference on Information Networking 2014 (ICOIN2014).

[13]  Luís Henrique Maciel Kosmalski Costa,et al.  Online traffic-aware virtual machine placement in data center networks , 2012, 2012 Global Information Infrastructure and Networking Symposium (GIIS).

[14]  Hongke Zhang,et al.  Energy-aware virtual machine placement in data centers , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[15]  Lisandro Zambenedetti Granville,et al.  Using Empirical Estimates of Effective Bandwidth in Network-Aware Placement of Virtual Machines in Datacenters , 2016, IEEE Transactions on Network and Service Management.

[16]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, Cluster Computing.

[17]  Nair Maria Maia de Abreu,et al.  A survey for the quadratic assignment problem , 2007, Eur. J. Oper. Res..

[18]  Hannu Tenhunen,et al.  Using Ant Colony System to Consolidate VMs for Green Cloud Computing , 2015, IEEE Transactions on Services Computing.

[19]  Hieu Trong Vu,et al.  A Traffic and Power-aware Algorithm for Virtual Machine Placement in Cloud Data Center , 2014 .

[20]  Aameek Singh,et al.  Coupled placement in modern data centers , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[21]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[22]  Manzur Murshed,et al.  Energy-Aware Virtual Machine Consolidation in IaaS Cloud Computing , 2014 .

[23]  Satish Narayana Srirama,et al.  Optimal Resource Provisioning for Scaling Enterprise Applications on the Cloud , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[24]  D AssunçãoMarcos,et al.  Big Data computing and clouds , 2015 .

[25]  Susmit Bagchi,et al.  Emerging Research in Cloud Distributed Computing Systems , 2015 .

[26]  Antti Ylä-Jääski,et al.  A Multi-resource Selection Scheme for Virtual Machine Consolidation in Cloud Data Centers , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[27]  Soumya K. Ghosh,et al.  A Demand Based Resource Provisioner for Cloud Infrastructure , 2014 .

[28]  Teofilo F. Gonzalez,et al.  P-Complete Approximation Problems , 1976, J. ACM.

[29]  Rajkumar Buyya,et al.  Big Data computing and clouds: Trends and future directions , 2013, J. Parallel Distributed Comput..

[30]  Dzmitry Kliazovich,et al.  DENS: Data Center Energy-Efficient Network-Aware Scheduling , 2010, GreenCom/CPSCom.

[31]  Panos M. Pardalos,et al.  Quadratic Assignment Problem , 1997, Encyclopedia of Optimization.

[32]  Kang-Won Lee,et al.  Application-aware virtual machine migration in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[33]  Weijia Jia,et al.  PLAN: Joint Policy- and Network-Aware VM Management for Cloud Data Centers , 2017, IEEE Transactions on Parallel and Distributed Systems.

[34]  Sheng Wang,et al.  Joint VM placement and topology optimization for traffic scalability in dynamic datacenter networks , 2015, Comput. Networks.

[35]  Hongke Zhang,et al.  Multi-objective virtual machine migration in virtualized data center environments , 2013, 2013 IEEE International Conference on Communications (ICC).

[36]  Abdel Nasser,et al.  A Survey of the Quadratic Assignment Problem , 2014 .

[37]  Dejan S. Milojicic,et al.  HPC-Aware VM Placement in Infrastructure Clouds , 2013, 2013 IEEE International Conference on Cloud Engineering (IC2E).

[38]  Hua Wang,et al.  An Energy-Aware Ant Colony Algorithm for Network-Aware Virtual Machine Placement in Cloud Computing , 2016, 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS).

[39]  Rajkumar Buyya,et al.  Virtual Machine Consolidation in Cloud Data Centers Using ACO Metaheuristic , 2014, Euro-Par.

[40]  Asser N. Tantawi,et al.  An analytical model for multi-tier internet services and its applications , 2005, SIGMETRICS '05.

[41]  Huaglory Tianfield,et al.  Energy-Aware Virtual Machine Consolidation for Cloud Data Centers , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[42]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[43]  Gang Wu,et al.  A New Approach to Multi-objective Virtual Machine Placement in Virtualized Data Center , 2013, 2013 IEEE Eighth International Conference on Networking, Architecture and Storage.

[44]  Vasudeva Varma,et al.  Network-aware virtual machine consolidation for large data centers , 2013, NDM '13.

[45]  Jun Yan,et al.  A Network-aware Virtual Machine Placement and Migration Approach in Cloud Computing , 2010, 2010 Ninth International Conference on Grid and Cloud Computing.

[46]  Antonio Corradi,et al.  A Stable Network-Aware VM Placement for Cloud Systems , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[47]  Stefanos Georgiou,et al.  Exploiting Network-Topology Awareness for VM Placement in IaaS Clouds , 2013, 2013 International Conference on Cloud and Green Computing.

[48]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[49]  Zaigham Mahmood,et al.  Cloud Computing: Challenges, Limitations and R&D Solutions , 2014 .

[50]  Olaf David,et al.  Dynamic Scaling for Service Oriented Applications: Implications of Virtual Machine Placement on IaaS Clouds , 2014, 2014 IEEE International Conference on Cloud Engineering.

[51]  BuyyaRajkumar,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012 .

[52]  Hui He,et al.  Network-aware virtual machine migration in an overcommitted cloud , 2017, Future Gener. Comput. Syst..

[53]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[54]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[55]  Hannu Tenhunen,et al.  Energy-Aware Dynamic VM Consolidation in Cloud Data Centers Using Ant Colony System , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[56]  Christine Morin,et al.  Energy-Aware Ant Colony Based Workload Placement in Clouds , 2011, 2011 IEEE/ACM 12th International Conference on Grid Computing.

[57]  Quanwang Wu,et al.  Heterogeneous Virtual Machine Consolidation Using an Improved Grouping Genetic Algorithm , 2015, 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems.

[58]  Ilsun You,et al.  Application-Aware Virtual Machine Placement in Data Centers , 2012, 2012 Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[59]  Roberto Rojas-Cessa,et al.  Communication-Aware and Energy-Efficient Scheduling for Parallel Applications in Virtualized Data Centers , 2013, 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing.

[60]  Liang Liu,et al.  A multi-objective ant colony system algorithm for virtual machine placement in cloud computing , 2013, J. Comput. Syst. Sci..