QoS Support For Workflows In A Volatile Grid

The grid can be seen as a collection of services each of which performs some functionality. Users of the grid seek to use combinations of these services to perform the overall task they need to achieve. In general this can be seen as a set of services with a workflow document describing how these services should be combined. The user may also have certain constraints on the workflow operations, such as execution time or cost to the user, specified in the form of a quality of service (QoS) document. The users submit their workflow to a brokering service along with the QoS document. The brokering service's task is to map any given workflow to a subset of the grid services taking the QoS and state of the grid into account - service availability and performance. We propose in this paper an approach for generating constraint equations describing the workflow, the QoS requirements and the state of the grid. This set of equations may be solved using mixed-integer linear programming (MILP), which is the traditional method. We further develop a novel 2-stage stochastic MILP which is capable of dealing with the volatile nature of the grid and adapting the selection of the services during the lifetime of the workflow. We present experimental results comparing our approaches, showing that the 2-stage stochastic programming approach performs consistently better than other traditional approaches

[1]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[2]  Ali Afzal,et al.  Making the Grid Predictable through Reservations and Performance Modelling , 2005, Comput. J..

[3]  A. Rollett,et al.  The Monte Carlo Method , 2004 .

[4]  John Darlington,et al.  Payment and negotiation for the next generation Grid and Web , 2008, Concurr. Comput. Pract. Exp..

[5]  Rainer Schmidt,et al.  QoS support for time-critical grid workflow applications , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[6]  Yash Patel,et al.  An End-to-end Workflow Pipeline for Large-scale Grid Computing , 2005, Journal of Grid Computing.

[7]  Matthew S. Shields,et al.  Triana: a graphical Web service composition and execution toolkit Web Services , 2004 .

[8]  Ian T. Foster,et al.  Grid Services for Distributed System Integration , 2002, Computer.

[9]  David Abramson,et al.  Economic models for resource management and scheduling in Grid computing , 2002, Concurr. Comput. Pract. Exp..

[10]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.

[11]  Jennifer M. Schopf,et al.  Performance analysis of the Globus Toolkit Monitoring and Discovery Service, MDS2 , 2004, IEEE International Conference on Performance, Computing, and Communications, 2004.

[12]  Ian J. Taylor,et al.  Triana: a graphical Web service composition and execution toolkit , 2004, Proceedings. IEEE International Conference on Web Services, 2004..

[13]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[14]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[15]  Tito Homem-de-Mello,et al.  Monte Carlo Methods for Discrete Stochastic Optimization , 2001 .

[16]  Anna van Raaphorst RDF (Resource Description Framework) , 2006 .

[17]  John Darlington,et al.  Implementations of a Service-Oriented Architecture on Top of Jini, JXTA and OGSI , 2004, European Across Grids Conference.

[18]  D. Owen Handbook of Mathematical Functions with Formulas , 1965 .

[19]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..