Multi‐layered simulations at the heart of workflow enactment on clouds

Scientific workflow systems face new challenges when supporting Cloud computing, as the information on the state of the used infrastructures is much less detailed than before. Thus, organising virtual infrastructures in a way that not only supports the workflow execution but also optimises it for several service level objectives (e.g. maximum energy consumption limit, cost, reliability, availability) become reliant on good Cloud modelling and prediction information. While simulators were successfully aiding research on such workflow management systems, the currently available Cloud related simulation toolkits suffer from several issues (e.g. scalability and narrow scope) that hinder their applicability. To address these issues, this article introduces techniques for unifying two existing simulation toolkits by first analysing the problems with the current simulators, and then by illustrating the problems faced by workflow systems. We use for this purpose the example of the ASKALON environment, a scientific workflow composition and execution tool for cloud and grid environments. We illustrate the advantages of a workflow system with directly integrated simulation back‐end and how the unification of the selected simulators does not affect the overall workflow execution simulation performance. Copyright © 2015 John Wiley & Sons, Ltd.

[1]  Radu Prodan,et al.  Scheduling of scientific workflows in the ASKALON grid environment , 2005, SGMD.

[2]  Jesús Carretero,et al.  Design of a New Cloud Computing Simulation Platform , 2011, ICCSA.

[3]  Tram Truong Huu,et al.  Bundle and Pool Architecture for Multi-Language, Robust, Scalable Workflow Executions , 2013, Journal of Grid Computing.

[4]  Péter Kacsuk,et al.  P-GRADE Portal: A generic workflow system to support user communities , 2011, Future Gener. Comput. Syst..

[5]  Radu Prodan,et al.  Using a new event-based simulation framework for investigating resource provisioning in Clouds , 2011, Sci. Program..

[6]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[7]  Norman W. Paton,et al.  Adaptive Workflow Processing and Execution in Pegasus , 2008, 2008 The 3rd International Conference on Grid and Pervasive Computing - Workshops.

[8]  Radu Prodan,et al.  MOHEFT: A multi-objective list-based method for workflow scheduling , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[9]  Rajkumar Buyya,et al.  A toolkit for modelling and simulating data Grids: an extension to GridSim , 2008, Concurr. Comput. Pract. Exp..

[10]  Gregor von Laszewski,et al.  CoG kits: a bridge between commodity distributed computing and high-performance grids , 2000, JAVA '00.

[11]  Alexandru Iosup,et al.  Workflow Monitoring and Analysis Tool for ASKALON , 2008, CoreGRID Workshop on Grid Middleware.

[12]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[13]  Georgia Sakellari,et al.  A survey of mathematical models, simulation approaches and testbeds used for research in cloud computing , 2013, Simul. Model. Pract. Theory.

[14]  Johan Montagnat,et al.  Fine-Grain Interoperability of Scientific Workflows in Distributed Computing Infrastructures , 2013, Journal of Grid Computing.

[15]  Abadhan Saumya Sabyasachi,et al.  Cloud computing simulators: A detailed survey and future direction , 2014, 2014 IEEE International Advance Computing Conference (IACC).

[16]  Edmundo Tovar Caro,et al.  The IT Crowd: Are We Stereotypes? , 2008, IT Professional.

[17]  Carole A. Goble,et al.  The Taverna workflow suite: designing and executing workflows of Web Services on the desktop, web or in the cloud , 2013, Nucleic Acids Res..

[18]  Alexandru Iosup,et al.  The Grid Workloads Archive , 2008, Future Gener. Comput. Syst..

[19]  San Murugesan,et al.  Harnessing Green IT: Principles and Practices , 2008, IT Professional.

[20]  Dennis Gannon,et al.  Workflows for e-Science, Scientific Workflows for Grids , 2014 .

[21]  Henri Casanova,et al.  Versatile, scalable, and accurate simulation of distributed applications and platforms , 2014, J. Parallel Distributed Comput..

[22]  K. Schwarz,et al.  Electronic structure calculations of solids using the WIEN2k package for material sciences , 2002 .

[23]  Jeffrey D. Ullman,et al.  NP-Complete Scheduling Problems , 1975, J. Comput. Syst. Sci..

[24]  Gabor Kecskemeti,et al.  DISSECT-CF: A simulator to foster energy-aware scheduling in infrastructure clouds , 2015, Simul. Model. Pract. Theory.

[25]  Ewa Deelman,et al.  WorkflowSim: A toolkit for simulating scientific workflows in distributed environments , 2012, 2012 IEEE 8th International Conference on E-Science.

[26]  Rajkumar Buyya,et al.  GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing , 2002, Concurr. Comput. Pract. Exp..

[27]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[28]  Radu Prodan,et al.  Integration of an Event-Based Simulation Framework into a Scientific Workflow Execution Environment for Grids and Clouds , 2011, ServiceWave.