A collaborative scheduling approach for service-driven scientific workflow execution

Scientific workflow execution often spans multiple self-managing administrative domains to obtain specific processing capabilities. Existing (global) analysis techniques tend to mandate every domain-specific application to unveil all private behaviors for scientific collaboration. In practice, it is infeasible for a domain-specific application to disclose its process details (as a private workflow fragment) for privacy or security reasons. Consequently, it is a challenging endeavor to coordinate scientific workflows and its distributed domain-specific applications. To address this problem, we propose a collaborative scheduling approach that can deal with temporal dependencies between a scientific workflow and a private workflow fragment. Under this collaborative scheduling approach, a private workflow fragment could maintain the temporal consistency with a scientific workflow in resource sharing and task enactments. Further, an evaluation is also presented to demonstrate the proposed approach for coordinating multiple scientific workflow executions in a concurrent environment.

[1]  Layuan Li,et al.  A distributed multiple dimensional QoS constrained resource scheduling optimization policy in computational grid , 2006, J. Comput. Syst. Sci..

[2]  Bertram Ludäscher,et al.  CONCURRENCY AND COMPUTATION : PRACTICE AND EXPERIENCE Concurrency Computat , 2008 .

[3]  Shing-Chi Cheung,et al.  Workflow View Driven Cross-Organizational Interoperability in a Web Service Environment , 2004, Inf. Technol. Manag..

[4]  Barbara M. Chapman,et al.  Scientific workflow scheduling in computational grids — Planning, reservation, and data/network-awareness , 2007, 2007 8th IEEE/ACM International Conference on Grid Computing.

[5]  Jinjun Chen,et al.  Temporal dependency-based checkpoint selection for dynamic verification of temporal constraints in scientific workflow systems , 2011, TSEM.

[6]  Radu Prodan,et al.  Scheduling of scientific workflows in the ASKALON grid environment , 2005, SGMD.

[7]  Enrico Motta,et al.  A generic library of problem solving methods for scheduling applications , 2006, IEEE Transactions on Knowledge and Data Engineering.

[8]  Jinjun Chen,et al.  Trust-based robust scheduling and runtime adaptation of scientific workflow , 2009 .

[9]  Jing Hua,et al.  A Reference Architecture for Scientific Workflow Management Systems and the VIEW SOA Solution , 2009, IEEE Transactions on Services Computing.

[10]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[11]  Shawn Bowers,et al.  An approach for pipelining nested collections in scientific workflows , 2005, SGMD.

[12]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[13]  Ghaleb Abdulla,et al.  Data-Preservation in Scientific Workflow Middleware , 2006, 18th International Conference on Scientific and Statistical Database Management (SSDBM'06).

[14]  MengChu Zhou,et al.  Timing constraint workflow nets for workflow analysis , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[15]  Li Chunlin,et al.  A distributed multiple dimensional QoS constrained resource scheduling optimization policy in computational grid , 2006 .

[16]  Cees T. A. M. de Laat,et al.  VLE-WFBus: A Scientific Workflow Bus for Multi e-Science Domains , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[17]  Jeffrey G. Gray,et al.  Grid‐Flow: a Grid‐enabled scientific workflow system with a Petri‐net‐based interface , 2006, Concurr. Comput. Pract. Exp..

[18]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[19]  Paul Roe,et al.  GPFlow: An Intuitive Environment for Web Based Scientific Workflow , 2006, GCC Workshops.

[20]  GranelliFabrizio,et al.  Self-adjustment of resource allocation for grid applications , 2008 .

[21]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.

[22]  Jinjun Chen,et al.  Activity Completion Duration Based Checkpoint Selection for Dynamic Verification of Temporal Constraints in Grid Workflow Systems , 2008 .

[23]  Ian T. Foster,et al.  A model for usage policy-based resource allocation in grids , 2005, Sixth IEEE International Workshop on Policies for Distributed Systems and Networks (POLICY'05).

[24]  David Abramson,et al.  A Computational Economy for Grid Computing and its Implementation in the Nimrod-G Resource Brok , 2001, Future Gener. Comput. Syst..

[25]  Wil M. P. van der Aalst,et al.  The Application of Petri Nets to Workflow Management , 1998, J. Circuits Syst. Comput..

[27]  Johan Tordsson,et al.  Grid resource brokering algorithms enabling advance reservations and resource selection based on performance predictions , 2008, Future Gener. Comput. Syst..

[28]  Philippe Schnoebelen,et al.  The State Explosion Problem from Trace to Bisimulation Equivalence , 2000, FoSSaCS.

[29]  Rajkumar Buyya,et al.  Cost-based scheduling of scientific workflow applications on utility grids , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[30]  Carole A. Goble,et al.  Guest editors' introduction to the special section on scientific workflows , 2005, SGMD.

[31]  Wil M. P. van der Aalst,et al.  Workflow Patterns , 2004, Distributed and Parallel Databases.

[32]  Jia Zhang,et al.  Collaborative Scientific Workflows , 2009, 2009 IEEE International Conference on Web Services.

[33]  Daniel M. Batista,et al.  Self-adjustment of resource allocation for grid applications , 2008, Comput. Networks.

[34]  Geoffrey Fox,et al.  Special Issue: Workflow in Grid Systems , 2006, Concurr. Comput. Pract. Exp..