P2PScheMe: a P2P scheduling mechanism for workflows in grid computing

Complex scientific experiments have a growing demand for computational resources, which are expensive to be acquired and maintained. Grid computing has emerged as the mainstream technology to solve this issue. Grids are also adequate for the execution of scientific workflows because they allow the use of heterogeneous and distributed resources. In spite of the progress in grid technology, there are challenges to overcome in workflow scheduling. For instance, centralized scheduling solutions may lead to performance degradation and to problems with scalability. Some scheduling approaches are partially distributed, keeping a few centralized components that may become bottlenecks. Other distributed solutions have a lack of flexibility in the definition of workflows, in which only the use of tasks as steps in the workflow is permitted not high level services. In this work, we present P2PScheMe, a scheduling mechanism for peer‐to‐peer execution of workflows based on the invocation of grid services. The proposal considers information regarding grid execution environment in order to allow workflow scheduling adaptation. This adaptation is performed according to user requirements of quality of service. In this paper, we describe how P2PScheMe works and provides a comparative analysis with existing solutions. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  Rajkumar Buyya,et al.  Multiobjective differential evolution for scheduling workflow applications on global Grids , 2009 .

[2]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[3]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[4]  Rajkumar Buyya,et al.  Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms , 2006, Sci. Program..

[5]  Yolanda Gil From data to knowledge to discoveries: Artificial intelligence and scientific workflows , 2009 .

[6]  Rajkumar Buyya,et al.  Cooperative and decentralized workflow scheduling in global grids , 2010, Future Gener. Comput. Syst..

[7]  Yolanda Gil,et al.  Wings for Pegasus: Creating Large-Scale Scientific Applications Using Semantic Representations of Computational Workflows , 2007, AAAI.

[8]  Danilo Ardagna,et al.  A QoS-based selection approach of autonomic grid services , 2007, SOCP '07.

[9]  Bertram Ludäscher,et al.  Compiling abstract scientific workflows into Web service workflows , 2003, 15th International Conference on Scientific and Statistical Database Management, 2003..

[10]  Yun Yang,et al.  SwinDeW-a p2p-based decentralized workflow management system , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Rajkumar Buyya,et al.  A Decentralized and Cooperative Workflow Scheduling Algorithm , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[12]  Radu Prodan,et al.  Dynamic scheduling of scientific workflow applications on the grid: a case study , 2005, SAC '05.

[13]  Jun Qin,et al.  ASKALON: a Grid application development and computing environment , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[14]  Yolanda Gil,et al.  From data to knowledge to discoveries: Artificial intelligence and scientific workflows , 2009, Sci. Program..

[15]  Edward A. Lee,et al.  CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Concurrency Computat.: Pract. Exper. 2000; 00:1–7 Prepared using cpeauth.cls [Version: 2002/09/19 v2.02] Taverna: Lessons in creating , 2022 .

[16]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[17]  Domenico Ferrari,et al.  An Empirical Investigation of Load Indices for Load Balancing Applications , 1987, Performance.

[18]  Ian J. Taylor,et al.  The Triana Workflow Environment: Architecture and Applications , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[19]  José Neuman de Souza,et al.  A Grid Computing Diagnosis Model for Tolerating Manipulation Attacks , 2006, Int. Trans. Syst. Sci. Appl..

[20]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[21]  Bruno Schulze,et al.  Performance and deployment evaluation of a parallel application on a private Cloud , 2011, Concurr. Comput. Pract. Exp..

[22]  Rajkumar Buyya,et al.  Multiobjective differential evolution for scheduling workflow applications on global Grids , 2009, Concurr. Comput. Pract. Exp..

[23]  Yolanda Gil,et al.  Pegasus: Mapping Scientific Workflows onto the Grid , 2004, European Across Grids Conference.

[24]  Ian T. Foster,et al.  Globus Toolkit Version 4: Software for Service-Oriented Systems , 2005, Journal of Computer Science and Technology.

[25]  Marcos José Santana,et al.  A P2P Hierarchical Metascheduler to Obtain QoS in a Grid Economy Services , 2009, 2009 International Conference on Computational Science and Engineering.

[26]  Jon Crowcroft,et al.  A survey and comparison of peer-to-peer overlay network schemes , 2005, IEEE Communications Surveys & Tutorials.