A Bi-objective Scheduling Approach for Energy Optimisation of Executing and Transmitting HPC Applications in Decentralised Multi-cloud Systems

Although cloud computing greatly utilises virtualised environments for applications to be executed efficiently in low-cost hosting, it has turned energy wasting and overconsumption issues into major concerns. Cloud infrastructure is built on a great amount of server equipment, including high performance computing (HPC), and the servers are naturally prone to failures.In this paper, we report on an energy optimisation approach for scheduling HPC applications, applied to decentralised clouds system, that takes dataset transmission energy into account. The optimisation supports combining two conflicting objectives: minimising energy consumption in conjunction with the avoidance of application deadline violations caused by resource failures. Furthermore, we propose two decision strategies for weighing these conflicting objectives dynamically to account for their significance towards producing an ideal energy efficiency and resource utilisation. Through our developed simulation and experimental analysis using real parallel workloads from large-scale systems, the results illustrate that our approach provides promising energy savings with acceptable level of resource reliability.

[1]  Manish Parashar,et al.  Energy-efficient application-aware online provisioning for virtualized clouds and data centers , 2010, International Conference on Green Computing.

[2]  Rajkumar Buyya,et al.  Energy-Efficient Management of Data Center Resources for Cloud Computing: A Vision, Architectural Elements, and Open Challenges , 2010, PDPTA.

[3]  Andrei Tchernykh,et al.  Multiobjective Workflow Scheduling in a Federation of Heterogeneous Green-Powered Data Centers , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[4]  Thomas Erlebach,et al.  Energy Aware Scheduling of HPC Tasks in Decentralised Cloud Systems , 2016, 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP).

[5]  Athanasios V. Vasilakos,et al.  Cloud Computing , 2014, ACM Comput. Surv..

[6]  Jorge Ejarque,et al.  Dynamic energy-aware scheduling for parallel task-based application in cloud computing , 2018, Future Gener. Comput. Syst..

[7]  Lorenz M. Hilty,et al.  The Energy Intensity of the Internet: Home and Access Networks , 2015, ICT Innovations for Sustainability.

[8]  Dan Tsafrir,et al.  Experience with using the Parallel Workloads Archive , 2014, J. Parallel Distributed Comput..

[9]  Lorenz M. Hilty,et al.  Assessing Internet energy intensity: A review of methods and results , 2014 .

[10]  Inderveer Chana,et al.  Energy Efficiency Techniques in Cloud Computing , 2015, ACM Comput. Surv..

[11]  Meikang Qiu,et al.  Online optimization for scheduling preemptable tasks on IaaS cloud systems , 2012, J. Parallel Distributed Comput..

[12]  Chia-Ming Wu,et al.  A green energy-efficient scheduling algorithm using the DVFS technique for cloud datacenters , 2014, Future Gener. Comput. Syst..

[13]  Lothar Thiele,et al.  Energy efficient DVFS scheduling for mixed-criticality systems , 2014, 2014 International Conference on Embedded Software (EMSOFT).

[14]  Rizos Sakellariou,et al.  Mapping Virtual Machines onto Physical Machines in Cloud Computing , 2016, ACM Comput. Surv..

[15]  Jordi Guitart,et al.  Toward sustainable data centers: a comprehensive energy management strategy , 2017, Computing.

[16]  Yuping Wang,et al.  Energy-efficient Multi-task Scheduling Based on MapReduce for Cloud Computing , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[17]  Daniel Sun,et al.  Reliability and energy efficiency in cloud computing systems: Survey and taxonomy , 2016, J. Netw. Comput. Appl..

[18]  Laurent Lefèvre,et al.  Energy-Efficient Reservation Infrastructure for Grids, Clouds, and Networks , 2012 .

[19]  Simin Nadjm-Tehrani,et al.  Sharing the Cost of Lunch: Energy Apportionment Policies , 2015, Q2SWinet@MSWiM.

[20]  Bernabé Dorronsoro,et al.  Multiobjective evolutionary algorithms for energy and service level scheduling in a federation of distributed datacenters , 2017, Int. Trans. Oper. Res..