DSARP: Dependable Scheduling with Active Replica Placement for Workflow Applications in Cloud Computing

As an efficient development for industrial and scientific applications, workflow technologies have received substantial attention in recent decades. To address the issue of workflow scheduling in a state-of-the-art cloud environment, based on analysis of a decentralized architecture for workflow scheduling, a dependable scheduling strategy with active replica placement (DS-ARP) is proposed in this paper. In this proposal, by analyzing control/data dependencies in a workflow, a game-theory-based active replica placement model is first developed to achieve reasonable replica placement; then, a dependable scheduling algorithm is proposed to enhance the system reliability and security. With five well-known workflow applications, CloudSim-based simulations are performed, and the analytical results are shown to demonstrate the performance of DS-ARP on an average number of initiated replicas, costs resulting from canceled replicas, makespans, deadline violation rates and resource utilization rates.

[1]  Ian J. Taylor,et al.  Workflows and e-Science: An overview of workflow system features and capabilities , 2009, Future Gener. Comput. Syst..

[2]  Hai Jin,et al.  Dependable Grid Workflow Scheduling Based on Resource Availability , 2012, Journal of Grid Computing.

[3]  Laurence T. Yang,et al.  Multicloud-Based Evacuation Services for Emergency Management , 2014, IEEE Cloud Computing.

[4]  Rajkumar Buyya,et al.  Meeting Deadlines of Scientific Workflows in Public Clouds with Tasks Replication , 2014, IEEE Transactions on Parallel and Distributed Systems.

[5]  Jörg Schneider,et al.  Heuristic Scheduling of Grid Workflows Supporting Co-Allocation and Advance Reservation , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[6]  Jörg Schneider,et al.  Grid workflow scheduling based on incomplete information , 2010 .

[7]  Yang Zhang,et al.  Hybrid Re-scheduling Mechanisms for Workflow Applications on Multi-cluster Grid , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[8]  R. Buyya,et al.  A budget constrained scheduling of workflow applications on utility Grids using genetic algorithms , 2006, 2006 Workshop on Workflows in Support of Large-Scale Science.

[9]  Jun Zhang,et al.  An Ant Colony Optimization Approach to a Grid Workflow Scheduling Problem With Various QoS Requirements , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[11]  Hai Jin,et al.  Deduplication-Based Energy Efficient Storage System in Cloud Environment , 2015, Comput. J..

[12]  Jun Zhang,et al.  Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches , 2015, ACM Comput. Surv..

[13]  AbrishamiSaeid,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013 .

[14]  Weisong Shi,et al.  Failure-aware workflow scheduling in cluster environments , 2010, Cluster Computing.

[15]  Ming Tao,et al.  Two-tier policy-based consolidation control for workload with soft deadline constrain in virtualized data center , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[16]  Radu Prodan,et al.  A Multi-objective Approach for Workflow Scheduling in Heterogeneous Environments , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[17]  Rajkumar Buyya,et al.  Bandwidth‐aware divisible task scheduling for cloud computing , 2014, Softw. Pract. Exp..

[18]  Jing Li,et al.  Trust-driven and QoS demand clustering analysis based cloud workflow scheduling strategies , 2014, Cluster Computing.

[19]  Rajkumar Buyya,et al.  Adaptive workflow scheduling for dynamic grid and cloud computing environment , 2013, Concurr. Comput. Pract. Exp..

[20]  Radu Prodan,et al.  A Truthful Dynamic Workflow Scheduling Mechanism for Commercial Multicloud Environments , 2013, IEEE Transactions on Parallel and Distributed Systems.

[21]  Hai Jin,et al.  DAGMap: efficient and dependable scheduling of DAG workflow job in Grid , 2010, The Journal of Supercomputing.

[22]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[23]  Qingbo Wu,et al.  Workflow scheduling in cloud: a survey , 2015, The Journal of Supercomputing.

[24]  Sunilkumar S. Manvi,et al.  Resource management for Infrastructure as a Service (IaaS) in cloud computing: A survey , 2014, J. Netw. Comput. Appl..

[25]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[26]  Radu Prodan,et al.  Applying Advance Reservation to Increase Predictability of Workflow Execution on the Grid , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[27]  Shiyong Lu,et al.  Scheduling Scientific Workflows Elastically for Cloud Computing , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[28]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..

[29]  WenAn Tan,et al.  A Trust Service-Oriented Scheduling Model for Workflow Applications in Cloud Computing , 2014, IEEE Systems Journal.

[30]  Liping Zhang,et al.  A multi-strategy collaborative prediction model for the runtime of online tasks in computing cluster/grid , 2010, Cluster Computing.

[31]  Venkatram Vishwanath,et al.  Workflow performance improvement using model-based scheduling over multiple clusters and clouds , 2016, Future Gener. Comput. Syst..

[32]  Ming Tao,et al.  A New Replication Scheduling Strategy for Grid Workflow Applications , 2011, 2011 Sixth Annual Chinagrid Conference.

[33]  Yi Peng,et al.  The analytic hierarchy process: task scheduling and resource allocation in cloud computing environment , 2011, The Journal of Supercomputing.