An Investigation into the Usage-trends of Canada’s Research Computing Clouds

Cloud platforms are gaining more footprint in many Information Technology sectors, including research computing. Infrastructure as a service (IaaS) remains a popular cloud delivery model for research computing clouds, enabling researchers to create isolated computing, storage, and network environments on demand. Despite the maturity of the IaaS model, cloud providers face several challenges due to the lack of insight into usage-trends of their platforms, including sub-optimal VM placement and arbitrary selection of adopted technologies. These problems become more difficult in the research computing domain, where the resource requirements and nature of computational workloads of VMs are highly diverse.In this paper, we illustrate the value of usage-trends’ analysis in VM placement decisions and technology adoption choices by IaaS providers. We examine the usage-trends of four of Canada’s research computing clouds, presenting our analysis of usage metrics that were collected since their inception and up to early 2019. We focus on examining the usage metrics with potential in guiding VM placement and technology adoption choices, namely the lifetime of VMs, the frequency of VMs’ creation, and the VMs’ resource allocations.

[1]  Arif Merchant,et al.  Projecting disk usage based on historical trends in a cloud environment , 2012, ScienceCloud '12.

[2]  Rajkumar Buyya,et al.  Dynamic Voltage and Frequency Scaling‐aware dynamic consolidation of virtual machines for energy efficient cloud data centers , 2017, Concurr. Comput. Pract. Exp..

[3]  Manish Marwah,et al.  Hybrid resource provisioning for minimizing data center SLA violations and power consumption , 2012, Sustain. Comput. Informatics Syst..

[4]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[5]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[6]  Gargi Dasgupta,et al.  Server Workload Analysis for Power Minimization using Consolidation , 2009, USENIX Annual Technical Conference.

[7]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[8]  Violeta Holmes,et al.  Orchestrating Docker Containers in the HPC Environment , 2015, ISC.

[9]  Xiaofei Wang,et al.  Dynamic Resource Prediction and Allocation for Cloud Data Center Using the Multiobjective Genetic Algorithm , 2018, IEEE Systems Journal.

[10]  Daniel M. Batista,et al.  Consolidation of VMs to Improve Energy Efficiency in Cloud Computing Environments , 2015, 2015 XXXIII Brazilian Symposium on Computer Networks and Distributed Systems.

[11]  Enda Barrett,et al.  An energy efficient anti-correlated virtual machine placement algorithm using resource usage predictions , 2019, Simul. Model. Pract. Theory.

[12]  Dharmender Singh Kushwaha,et al.  Analysis of Workloads for Cloud Infrastructure Capacity Planning , 2019 .

[13]  Arun Venkataramani,et al.  Sandpiper: Black-box and gray-box resource management for virtual machines , 2009, Comput. Networks.

[14]  Nam Thoai,et al.  A Genetic Algorithm for Power-Aware Virtual Machine Allocation in Private Cloud , 2013, ICT-EurAsia.

[15]  Bernard Butler,et al.  Provisioning of requests for virtual machine sets with placement constraints in IaaS clouds , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[16]  Paolo Cremonesi,et al.  A Constraint Programming Approach for the Service Consolidation Problem , 2010, CPAIOR.

[17]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[18]  Ivona Brandic,et al.  Take a Break: Cloud Scheduling Optimized for Real-Time Electricity Pricing , 2013, 2013 International Conference on Cloud and Green Computing.

[19]  Ajay Gulati,et al.  Storage Workload Characterization and Consolidation in Virtualized Environments , 2008 .

[20]  Jing Xu,et al.  Multi-Objective Virtual Machine Placement in Virtualized Data Center Environments , 2010, 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing.

[21]  Daniel M. Batista,et al.  A green network-aware VMs placement mechanism , 2014, 2014 IEEE Global Communications Conference.