Usage patterns in multi-tenant data centers: a temporal perspective

Data centers, hosted either on-site or by a third party, have become a dominant computing platform. Here, we focus on the usage patterns of in-production data centers that are hosted by a third party and serve several corporate customers. We characterize the data center workload and concentrate especially on the temporal evolution of utilization of basic resource components. We especially focus on the autonomic aspect of this characterization as it can be used to identify how loads across components change in order to identify conditions that can trigger resource reallocation toward better workload management. To this end, we focus on the resource demands of six distinct corporate customers on two specific data centers, highlight the workload diversity across these customers, and especially focus on how resources are used in time scales that range from minutes to days, weeks, and months. This study fills an important gap in our understanding on how data center resources are used and provides helpful insights for the development of autonomous resource management in multi-tenant data centers.

[1]  Prashant J. Shenoy,et al.  Autonomic mix-aware provisioning for non-stationary data center workloads , 2010, ICAC '10.

[2]  Vanish Talwar,et al.  Monalytics: online monitoring and analytics for managing large scale data centers , 2010, ICAC '10.

[3]  Sujata Banerjee,et al.  ElasticTree: Saving Energy in Data Center Networks , 2010, NSDI.

[4]  Anand Sivasubramaniam,et al.  Managing server energy and operational costs in hosting centers , 2005, SIGMETRICS '05.

[5]  Suman Nath,et al.  Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services , 2008, NSDI.

[6]  Evgenia Smirni,et al.  Data Centers in the Cloud: A Large Scale Performance Study , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[7]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[8]  Xiaoyun Zhu,et al.  1000 islands: an integrated approach to resource management for virtualized data centers , 2009, Cluster Computing.

[9]  Anand Sivasubramaniam,et al.  Statistical profiling-based techniques for effective power provisioning in data centers , 2009, EuroSys '09.

[10]  Paramvir Bahl,et al.  Augmenting data center networks with multi-gigabit wireless links , 2011, SIGCOMM 2011.

[11]  Lei Shi,et al.  Dcell: a scalable and fault-tolerant network structure for data centers , 2008, SIGCOMM '08.

[12]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[13]  Bianca Schroeder,et al.  Temperature management in data centers: why some (might) like it hot , 2012, SIGMETRICS '12.