SSNF: Shared Datacenter Mechanism for Inter-datacenter Bulk Transfer

Cloud service providers (CSP) usually deploy geographically distributed data centers to improve QoS for colocated customers. Inter-Data center traffic constitutes almost half of the data center's export traffic and occupies significant part of the operational cost. Many store-and-forward mechanisms have been proposed to improve the efficiency of inter-data center transfer. However, existing store-and-forward solutions to the inter-datacenter traffic problem need sufficient and suitable intermediate nodes for transferring data, which is much more difficult for both the small and the big CSPs. In this paper, we present a shared datacenter scheduling mechanism called SSNF, which focus on providing more idle intermediates to increase the transmission success ratio for the inter-datacenter traffic. In SSNF, CSPs share datacenters which have idle storage resource and provide these idle datacenters as intermediate nodes for other CSP's data transmission. We compared our scheme with existing bulk data transfer mechanism under several different simulation settings. The results demonstrate our solution has a better transmission success ratio and achieves high efficiency for inter-datacenter traffic.

[1]  Xiaoyuan Yang,et al.  Inter-datacenter bulk transfers with netstitcher , 2011 .

[2]  Peng Zhang,et al.  D4D: Inter-datacenter Bulk Transfers with ISP Friendliness , 2012, 2012 IEEE International Conference on Cluster Computing.

[3]  Bo Li,et al.  Postcard: Minimizing Costs on Inter-Datacenter Traffic with Store-and-Forward , 2012, 2012 32nd International Conference on Distributed Computing Systems Workshops.

[4]  Thyaga Nandagopal,et al.  Lowering Inter-datacenter Bandwidth Costs via Bulk Data Scheduling , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[5]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[6]  Diomidis Spinellis,et al.  A survey of peer-to-peer content distribution technologies , 2004, CSUR.

[7]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[8]  Michael Sirivianos,et al.  Inter-datacenter bulk transfers with netstitcher , 2011, SIGCOMM.

[9]  Zhi-Li Zhang,et al.  A first look at inter-data center traffic characteristics via Yahoo! datasets , 2011, 2011 Proceedings IEEE INFOCOM.