Joint flow and virtual machine placement in hybrid cloud data centers

With the advance of virtualization technology, the current generation of cloud data centers contains diverse applications which generate massive inter-rack traffic in a distributed and unpredicted manner. However, since existing network architectures are not suitable to supply enough network capacity, there have been several research trials to improve the network capacity with augmented wireless links. Especially, architectural design and link scheduling of wireless-cum-wired hybrid data center networks are of their main interests. However, the existing approaches for hybrid data center networks with direct wireless links have limited performance improvements, since virtual machines are typically placed with less consideration of traffic locality.To this end, in this paper, we conduct a novel approach to flow and virtual machine placement problems in hybrid data center networks. We first design a threshold-based, wireless link-aware flow placement algorithm with low complexity. To enhance traffic locality, we also suggest a set of virtual machine placement algorithms under the flow placement algorithm. To fully exploit the extra capacity of the wireless links, we propose a new clustering metric for the algorithms. Extensive simulation results in hybrid data center networks with 60 gigahertz wireless links shows that combination of the proposed algorithms achieves better performance compared to baseline algorithms in flow completion time, aggregate throughput, and computational complexity.

[1]  Praveen Yalagandula,et al.  Mahout: Low-overhead datacenter traffic management using end-host-based elephant detection , 2011, 2011 Proceedings IEEE INFOCOM.

[2]  Shafii Muhammad Abdulhamid,et al.  Resource scheduling for infrastructure as a service (IaaS) in cloud computing: Challenges and opportunities , 2016, J. Netw. Comput. Appl..

[3]  Amin Vahdat,et al.  Helios: a hybrid electrical/optical switch architecture for modular data centers , 2010, SIGCOMM '10.

[4]  Xiang-Yang Li,et al.  Diamond: Nesting the Data Center Network With Wireless Rings in 3-D Space , 2016, IEEE/ACM Transactions on Networking.

[5]  Ravi Prakash,et al.  Wireless Data Center with Millimeter Wave Network , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[6]  Joongheon Kim,et al.  Fast millimeter-wave beam training with receive beamforming , 2014, Journal of Communications and Networks.

[7]  Himanshu Shah,et al.  FireFly: a reconfigurable wireless data center fabric using free-space optics , 2015, SIGCOMM 2015.

[8]  Sujata Banerjee,et al.  DevoFlow: scaling flow management for high-performance networks , 2011, SIGCOMM 2011.

[9]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[10]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[11]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[12]  Meng Wang,et al.  Consolidating virtual machines with dynamic bandwidth demand in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[13]  Shigeki Goto,et al.  Identifying elephant flows through periodically sampled packets , 2004, IMC '04.

[14]  Xiuzhen Cheng,et al.  Wireless link scheduling for data center networks , 2011, ICUIMC '11.

[15]  Ben Y. Zhao,et al.  Mirror mirror on the ceiling: flexible wireless links for data centers , 2012, SIGCOMM.

[16]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[17]  Paramvir Bahl,et al.  Augmenting data center networks with multi-gigabit wireless links , 2011, SIGCOMM 2011.

[18]  Shan Huang,et al.  VirtualKnotter: Online virtual machine shuffling for congestion resolving in virtualized datacenter , 2014, Comput. Networks.

[19]  Christian E. Hopps,et al.  Analysis of an Equal-Cost Multi-Path Algorithm , 2000, RFC.

[20]  David Breitgand,et al.  Improving consolidation of virtual machines with risk-aware bandwidth oversubscription in compute clouds , 2012, 2012 Proceedings IEEE INFOCOM.

[21]  Nima Jafari Navimipour,et al.  Load balancing mechanisms and techniques in the cloud environments: Systematic literature review and future trends , 2016, J. Netw. Comput. Appl..

[22]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[23]  Yongqiang Liu,et al.  VirtualKnotter: Online Virtual Machine Shuffling for Congestion Resolving in Virtualized Datacenter , 2012, 2012 IEEE 32nd International Conference on Distributed Computing Systems.

[24]  Holger Karl,et al.  DCT2Gen: A traffic generator for data centers , 2016, Comput. Commun..

[25]  Lei Shi,et al.  Dcell: a scalable and fault-tolerant network structure for data centers , 2008, SIGCOMM '08.

[26]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[27]  Peter Phaal,et al.  InMon Corporation's sFlow: A Method for Monitoring Traffic in Switched and Routed Networks , 2001, RFC.

[28]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[29]  Kang-Won Lee,et al.  Application-aware virtual machine migration in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[30]  Wonjun Lee,et al.  Flow and Virtual Machine Placement in Wireless Cloud Data Centers , 2016, QSHINE.

[31]  Ali Ghaffari,et al.  Software defined networks: A survey , 2016, J. Netw. Comput. Appl..

[32]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[33]  Brian W. Kernighan,et al.  An efficient heuristic procedure for partitioning graphs , 1970, Bell Syst. Tech. J..

[34]  Daiju Nakano,et al.  Wireless data center networking with steered-beam mmWave links , 2011, 2011 IEEE Wireless Communications and Networking Conference.

[35]  Darko Kirovski,et al.  On the feasibility of completely wireless datacenters , 2012, 2012 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[36]  Konstantina Papagiannaki,et al.  c-Through: part-time optics in data centers , 2010, SIGCOMM '10.

[37]  Xiuzhen Cheng,et al.  Channel allocation in wireless data center networks , 2011, 2011 Proceedings IEEE INFOCOM.

[38]  Ramesh Krishnamurti,et al.  An approximation algorithm for max k-uncut with capacity constraints , 2012 .

[39]  Keqiang He,et al.  Next stop, the cloud: understanding modern web service deployment in EC2 and azure , 2013, Internet Measurement Conference.