An Enhanced Workflow Scheduling Strategy for Deadline Guarantee on Hybrid Grid/Cloud Infrastructure

Deadline guarantee is an important QoS requirement for some critical scientific workflow applications. However, the resource heterogeneity and the unpredictable workloads make it difficult for grid system to provide efficient deadline-guarantee service for those applications. Recent IaaS providers, such as Amazon's EC2, provide virtualized on-demand computing resources on a pay-per-use model, which can be aggregated to the existing grid resource pool to enhance deadline-guarantee of scientific workflow. In this paper, a novel workflow scheduling algorithm DGESA is proposed. First, we evaluate the degree of deadline-guarantee for subtasks of workflow in grid system based on proposed probabilistic deadline guarantee model. Then, proper cloud resources are selected as an accelerator to enhance the deadline-guarantee of subtasks. The experimental results show that proposed algorithm achieves better performance than other algorithms on user's deadline guarantee.

[1]  Moni Naor,et al.  Job Scheduling Strategies for Parallel Processing , 2017, Lecture Notes in Computer Science.

[2]  Ewa Deelman,et al.  The cost of doing science on the cloud: the Montage example , 2008, HiPC 2008.

[3]  Yuan-Chun Jiang,et al.  Preventing Temporal Violations in Scientific Workflows: Where and How , 2011, IEEE Transactions on Software Engineering.

[4]  Liang Ding,et al.  Reputation-Enabled Self-Modification for Target Sensing in Wireless Sensor Networks , 2010, IEEE Transactions on Instrumentation and Measurement.

[5]  Shantenu Jha,et al.  Autonomic management of application workflows on hybrid computing infrastructure , 2011, Sci. Program..

[6]  Radu Prodan,et al.  Applying Advance Reservation to Increase Predictability of Workflow Execution on the Grid , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[7]  Alexandru Iosup,et al.  The Characteristics and Performance of Groups of Jobs in Grids , 2007, Euro-Par.

[8]  JiangYuanchun,et al.  Preventing Temporal Violations in Scientific Workflows , 2011 .

[9]  Daniel A. Menascé,et al.  A framework for resource allocation in grid computing , 2004, The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings..

[10]  Luiz Fernando Bittencourt,et al.  HCOC: a cost optimization algorithm for workflow scheduling in hybrid clouds , 2011, Journal of Internet Services and Applications.

[11]  Li-zhen Cui,et al.  A Multiple QoS Constrained Scheduling Strategy of Multiple Workflows for Cloud Computing , 2009, 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications.

[12]  Marios D. Dikaiakos,et al.  Scheduling Workflows with Budget Constraints , 2007, Grid 2007.

[13]  Lavanya Ramakrishnan,et al.  VGrADS: enabling e-Science workflows on grids and clouds with fault tolerance , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[14]  Rajkumar Buyya,et al.  Cost-based scheduling of scientific workflow applications on utility grids , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[15]  Selim G. Akl,et al.  PFAS: A Resource-Performance-Fluctuation-Aware Workflow Scheduling Algorithm for Grid Computing , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[16]  Rizos Sakellariou,et al.  Advance Reservation Policies for Workflows , 2006, JSSPP.

[17]  Morris Riedel,et al.  DEISA—Distributed European Infrastructure for Supercomputing Applications , 2011, Journal of Grid Computing.

[18]  Audun Jøsang,et al.  Dirichlet Reputation Systems , 2007, The Second International Conference on Availability, Reliability and Security (ARES'07).

[19]  P. Balakrishnan,et al.  CHARACTERIZATION AND PROFILING OFSCIENTIFIC WORKFLOWS , 2016 .

[20]  Rajkumar Buyya,et al.  Future Generation Computer Systems Deadline-driven Provisioning of Resources for Scientific Applications in Hybrid Clouds with Aneka , 2022 .

[21]  Mahmoud Naghibzadeh,et al.  Deadline-constrained workflow scheduling in software as a service Cloud , 2012, Sci. Iran..

[22]  Richard Wolski,et al.  QBETS: queue bounds estimation from time series , 2007, SIGMETRICS '07.

[23]  Alexandru Iosup,et al.  How are Real Grids Used? The Analysis of Four Grid Traces and Its Implications , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.

[24]  Xiaoping Li,et al.  Deadline division-based heuristic for cost optimization in workflow scheduling , 2009, Inf. Sci..

[25]  R. Buyya,et al.  A budget constrained scheduling of workflow applications on utility Grids using genetic algorithms , 2006, 2006 Workshop on Workflows in Support of Large-Scale Science.

[26]  Rajkumar Buyya,et al.  Pricing for Utility-Driven Resource Management and Allocation in Clusters , 2007, Int. J. High Perform. Comput. Appl..

[27]  Carlos R. Senna,et al.  Enabling execution of service workflows in grid/cloud hybrid systems , 2010, 2010 IEEE/IFIP Network Operations and Management Symposium Workshops.

[28]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[29]  Ann L. Chervenak,et al.  Characterizing and profiling scientific workflows , 2013, Future Gener. Comput. Syst..