An Efficient Scheduling of HPC Applications on Geographically Distributed Cloud Data Centers

Cloud computing provides a flexible infrastructure for IT industries to run their High Performance Computing (HPC) applications. Cloud providers deliver such computing infrastructures through a set of data centers called a cloud federation. The data centers of a cloud federation are usually distributed over the world. The profit of cloud providers strongly depends on the cost of energy consumption. As the data centers are located in various corners of the world, the cost of energy consumption and the amount of CO2 emission in different data centers varies significantly. Therefore, a proper allocation of HPC applications in such systems can result in a decrease of CO2 emission and a substantial increase of the providers’ profit. Reduction of CO2 emission also mitigates the destructive environmental impacts. In this paper, the problem of scheduling HPC applications on a geographically distributed cloud federation is scrutinized. To address the problem, we propose a two-level scheduler which is able to reach a good compromise between CO2 emission and the profit of cloud provider. The scheduler should also satisfy all HPC applications’ deadline and memory constraints. Simulation results based on a real intensive workload indicate that the proposed scheduler reduces the CO2 emission by 17 % while at the same time it improves the provider’s profit by 9 % on average.

[1]  Rajkumar Buyya,et al.  Energy-Efficient Management of Data Center Resources for Cloud Computing: A Vision, Architectural Elements, and Open Challenges , 2010, PDPTA.

[2]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[3]  Nasser Yazdani,et al.  Communication-aware and energy-efficient resource provisioning for real-time cloud services , 2013, The 17th CSI International Symposium on Computer Architecture & Digital Systems (CADS 2013).

[4]  Maziar Goudarzi,et al.  Energy-aware scheduling algorithm for precedence-constrained parallel tasks of network-intensive applications in a distributed homogeneous environment , 2013, ICCKE 2013.

[5]  Aboozar Rajabi,et al.  An analytical model to evaluate reliability of cloud computing systems in the presence of QoS requirements , 2013, 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS).

[6]  Rajkumar Buyya,et al.  Introduction to Cloud Computing , 2011, CloudCom 2011.

[7]  Rajkumar Buyya,et al.  Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers , 2011, J. Parallel Distributed Comput..

[8]  Chandrakant D. Patel,et al.  Energy Aware Grid: Global Workload Placement Based on Energy Efficiency , 2003 .

[9]  El-Ghazali Talbi,et al.  A Pareto-based metaheuristic for scheduling HPC applications on a geographically distributed cloud federation , 2013, Cluster Computing.

[10]  El-Ghazali Talbi,et al.  A pareto-based GA for scheduling HPC applications on distributed cloud infrastructures , 2011, 2011 International Conference on High Performance Computing & Simulation.

[11]  Sandeep K. S. Gupta,et al.  Thermal-Aware Task Scheduling to Minimize Energy Usage of Blade Server Based Datacenters , 2006, 2006 2nd IEEE International Symposium on Dependable, Autonomic and Secure Computing.

[12]  David E. Irwin,et al.  Balancing risk and reward in a market-based task service , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[13]  Laurent Lefèvre,et al.  Save Watts in Your Grid: Green Strategies for Energy-Aware Framework in Large Scale Distributed Systems , 2008, 2008 14th IEEE International Conference on Parallel and Distributed Systems.

[14]  Rajkumar Buyya,et al.  Green Cloud Framework for Improving Carbon Efficiency of Clouds , 2011, Euro-Par.

[15]  Caro Lucas,et al.  Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition , 2007, 2007 IEEE Congress on Evolutionary Computation.

[16]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[17]  Thomas Nolte,et al.  Towards Energy-Aware Resource Scheduling to Maximize Reliability in Cloud Computing Systems , 2013, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing.

[18]  Jeffrey S. Chase,et al.  Making Scheduling "Cool": Temperature-Aware Workload Placement in Data Centers , 2005, USENIX Annual Technical Conference, General Track.