A Novel Stochastic Algorithm for Scheduling QoS-Constrained Workflows in a Web Service-Oriented Grid

The success of Web services has influenced the way in which grid applications are being written. Grid users often submit their applications in the form of workflows with certain quality of service (QoS) requirements imposed on the workflows. These workflows detail the composition of Web services and the level of service required from the Grid. This paper addresses scheduling technique, which aims to satisfy QoS requirements of grid workflows with a sufficient guarantee. We model a Web service as a G/G/k queue and obtain scheduling solutions for workflow tasks by solving an ILP (integer linear program), which is the traditional method. We further develop a novel 2-stage stochastic program, which is capable of dealing with the volatile nature of the grid and adapting the selection of the services during the lifetime of the workflows. We also present a stochastic algorithm which obtains scheduling solutions for workflow tasks. We present experimental results comparing our approaches, showing that the 2-stage stochastic programming approach performs consistently better than other traditional approaches

[1]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[2]  Leonard Kleinrock,et al.  Mean Packet Queueing Delay in a Buffered Two-User CSMA/CD System , 1985, IEEE Trans. Commun..

[3]  Leonard Kleinrock,et al.  Theory, Volume 1, Queueing Systems , 1975 .

[4]  Rajkumar Buyya,et al.  A taxonomy and survey of grid resource management systems for distributed computing , 2002, Softw. Pract. Exp..

[5]  Brett D. Fleisch,et al.  Performance evaluation of soft real-time scheduling for multicomputer cluster , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[6]  Alexander Shapiro,et al.  The Sample Average Approximation Method for Stochastic Discrete Optimization , 2002, SIAM J. Optim..

[7]  A. Rollett,et al.  The Monte Carlo Method , 2004 .

[8]  Hector Garcia-Molina,et al.  Scheduling Soft Real-Time Jobs Over Dual Non-Real-Time Servers , 1996, IEEE Trans. Parallel Distributed Syst..

[9]  Andrew S. Grimshaw,et al.  A federated model for scheduling in wide-area systems , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[10]  Yash Patel,et al.  QoS Support For Workflows In A Volatile Grid , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.

[11]  S. Wittevrongel,et al.  Queueing Systems , 2019, Introduction to Stochastic Processes and Simulation.

[12]  D. Owen Handbook of Mathematical Functions with Formulas , 1965 .

[13]  Tito Homem-de-Mello,et al.  Monte Carlo Methods for Discrete Stochastic Optimization , 2001 .