Specification of user and provenance-based adaptive control points at workflow composition level

With the increasing capacity and power of distributed computing infrastructures in silico experiments have gained widespread popularity. The different scientific communities (physics, earthquake science, biologists, etc.) have developed their own Scientific Workflow Management Systems (SWfMS) to provide dynamic execution to the scientists. These SWfMSs differ from each other due to the divergent requirements. However, in spite of their diversity they agree on the strongest need that have not been completely fulfilled yet; runtime user-steering and adaptive dynamic execution. Additionally, when provenance data is collected during execution, provenance based steering also emerges as a big challenge. To support the scientists with special interaction mechanism during runtime we have introduced the so called iPoints, special intervention points where the scientist or the system can take over the control and are able to manipulate workflow execution based on provenance and intermediary data. In our current work we specified these iPoints in IWIR language which was targeted to provide interoperability between four existing well-known SWfMS within the framework of the SHIWA project.

[1]  Marta Mattoso,et al.  SciLightning: A Cloud Provenance-Based Event Notification for Parallel Workflows , 2013, ICSOC Workshops.

[2]  Marta Mattoso,et al.  User-steering of HPC workflows: state-of-the-art and future directions , 2013, SWEET '13.

[3]  Johan Montagnat,et al.  Fine-Grain Interoperability of Scientific Workflows in Distributed Computing Infrastructures , 2013, Journal of Grid Computing.

[4]  Marta Mattoso,et al.  Debugging Scientific Workflows with Provenance: Achievements and Lessons Learned , 2014, SBBD.

[5]  Gábor Terstyánszky,et al.  Enabling scientific workflow sharing through coarse-grained interoperability , 2014, Future Gener. Comput. Syst..

[6]  Miklós Kozlovszky,et al.  A novel approach to user-steering in scientific workflows , 2015, 2015 IEEE 10th Jubilee International Symposium on Applied Computational Intelligence and Informatics.

[7]  James C. French,et al.  Proceedings of the 23rd international conference on Scientific and statistical database management , 1994 .

[8]  Miklós Kozlovszky,et al.  Dynamic workflow support in gUSE , 2014, 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[9]  Marta Mattoso,et al.  Supporting dynamic parameter sweep in adaptive and user-steered workflow , 2011, WORKS '11.

[10]  Norman W. Paton,et al.  Adaptive Workflow Processing and Execution in Pegasus , 2008, 2008 The 3rd International Conference on Grid and Pervasive Computing - Workshops.

[11]  Anastasia Ailamaki.  Managing scientific data: lessons, challenges, and opportunities , 2011, SIGMOD '11.

[12]  Ian J. Taylor,et al.  A General Approach to Real-Time Workflow Monitoring , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[13]  Norman W. Paton,et al.  Workflow adaptation as an autonomic computing problem , 2007, WORKS '07.

[14]  Péter Kacsuk,et al.  P‐GRADE portal family for grid infrastructures , 2011, Concurr. Comput. Pract. Exp..