SCDA: SLA-Aware Cloud Datacenter Architecture for Efficient Content Storage and Retrieval

With the fast growth of (online) content and the need for high quality content services, cloud data centers are increasingly becoming the preferred places to store data and retrieve it from. With a highly variable network traffic and limited resources, efficient server selection and data transfer rate allocation mechanisms become necessary. However, current approaches rely on random server selection schemes and inefficient data transmission rate control mechanisms. In this paper we present SCDA, an efficient server selection, resource allocation and enforcement mechanism with many salient features. SCDA has prioritized rate allocation mechanism to satisfy different service level agreements (SLA)s on throughput and delays. The allocation scheme can achieve max/min fairness. SCDA has a mechanism to detect and hence mitigate SLA violation in realtime. We have implemented SCDA in the NS2 simulator. Extensive experimental results confirm some of the design goals of SCDA to obtain a lower content transfer time and a higher throughput. The design of SCDA can achieve a content transfer time which is about 50% lower than the existing schemes and a throughput which is higher than existing approaches by upto than 60%.

[1]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[2]  Laurent Mathy,et al.  Proceedings of the 9th ACM SIGCOMM conference on Internet measurement conference , 2009, IMC 2009.

[3]  Marco Mellia,et al.  Dissecting Video Server Selection Strategies in the YouTube CDN , 2011, 2011 31st International Conference on Distributed Computing Systems.

[4]  Christian E. Hopps,et al.  Analysis of an Equal-Cost Multi-Path Algorithm , 2000, RFC.

[5]  Ming Zhang,et al.  MicroTE: fine grained traffic engineering for data centers , 2011, CoNEXT '11.

[6]  GhemawatSanjay,et al.  The Google file system , 2003 .

[7]  Tatsuya Mori,et al.  Characterizing Traffic Flows Originating from Large-Scale Video Sharing Services , 2010, TMA.

[8]  Rahul Malik,et al.  A Scalable Distributed File System for Cloud Computing , 2010 .

[9]  Jiangchuan Liu,et al.  Statistics and Social Network of YouTube Videos , 2008, 2008 16th Interntional Workshop on Quality of Service.

[10]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[11]  Jie Gao,et al.  Moving beyond end-to-end path information to optimize CDN performance , 2009, IMC '09.

[12]  Alejandro López-Ortiz Valiant Load Balancing, Benes Networks and Resilient Backbone Design , 2007, CAAN.

[13]  Rahul Malik,et al.  Efficient Distributed File System (EDFS) , 2010 .

[14]  박성현,et al.  NS-2를 이용한 네트워크 시뮬레이션 방법론 , 2007 .

[15]  Klara Nahrstedt,et al.  SCDA: SLA-Aware Cloud Datacenter Architecture for Efficient Content Storage and Retrieval , 2014, IEEE CLOUD.

[16]  Rini T. Kaushik,et al.  GreenHDFS: towards an energy-conserving, storage-efficient, hybrid Hadoop compute cluster , 2010 .

[17]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[18]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[19]  Rahul Malik,et al.  EDFS: a semi-centralized efficient distributed file system , 2009, Middleware.

[20]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[21]  Nick McKeown,et al.  Why flow-completion time is the right metric for congestion control , 2006, CCRV.

[22]  Klara Nahrstedt,et al.  T*: A data-centric cooling energy costs reduction approach for Big Data analytics cloud , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[23]  Hairong Kuang,et al.  The Hadoop Distributed File System , 2010, 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST).

[24]  Padma Pillay-Esnault,et al.  OSPFv3 as a Provider Edge to Customer Edge (PE-CE) Routing Protocol , 2012, RFC.

[25]  Indranil Gupta,et al.  A Cross-layer Routing and Congestion Control for Distributed Systems , 2008 .

[26]  Michael Rabinovich,et al.  Measuring a commercial content delivery network , 2011, WWW.

[27]  Mark Handley,et al.  Congestion control for high bandwidth-delay product networks , 2002, SIGCOMM '02.

[28]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[29]  Van Jacobson,et al.  Congestion avoidance and control , 1988, SIGCOMM '88.