Proposing an Architecture for Scientific Workflow Management System in Cloud

With the growth in IT infrastructure and advances in technologies, workflow scheduling poses many challenging issues for complex applications which require many computing resources. Hence, there is a requirement of a workflow management system adaptable with many cloud environments due to the heterogeneity of resources and applications. In this paper, we have proposed a general workflow management system architecture and a scientific workflow model, followed by a model for monitoring tool in the cloud environment, based on a comprehensive study of literature in cloud computing.

[1]  Jianwu Wang,et al.  Workflow as a Service in the Cloud: Architecture and Scheduling Algorithms , 2014, ICCS.

[2]  Rajkumar Buyya,et al.  Workflow scheduling algorithms for grid computing , 2008 .

[3]  Qingbo Wu,et al.  Workflow scheduling in cloud: a survey , 2015, The Journal of Supercomputing.

[4]  Yves Robert,et al.  Resource-aware allocation strategies for divisible loads on large-scale systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[5]  Ivona Brandic,et al.  Managing and Optimizing Bioinformatics Workflows for Data Analysis in Clouds , 2013, Journal of Grid Computing.

[6]  Y. Ho,et al.  Ordinal Optimization: Soft Optimization for Hard Problems , 2007 .

[7]  Anthony A. Maciejewski,et al.  A stochastic model for robust resource allocation in heterogeneous parallel and distributed computing systems , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[8]  Mario Macías,et al.  Client Classification Policies for SLA Negotiation and Allocation in Shared Cloud Datacenters , 2011, GECON.

[9]  Hai Jin,et al.  Tools and Technologies for Building Clouds , 2010, Cloud Computing.

[10]  Rajkumar Buyya,et al.  Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms , 2006, Sci. Program..

[11]  P. Varalakshmi,et al.  An Optimal Workflow Based Scheduling and Resource Allocation in Cloud , 2011, ACC.

[12]  Albert Y. Zomaya,et al.  Evolutionary Scheduling of Dynamic Multitasking Workloads for Big-Data Analytics in Elastic Cloud , 2014, IEEE Transactions on Emerging Topics in Computing.

[13]  Ravi Iyer,et al.  Shared Resource Monitoring and Throughput Optimization in Cloud-Computing Datacenters , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[14]  Jinjun Chen,et al.  Research on Workflow Scheduling Algorithms in the Cloud , 2014 .

[15]  Jing Hua,et al.  A Reference Architecture for Scientific Workflow Management Systems and the VIEW SOA Solution , 2009, IEEE Transactions on Services Computing.

[16]  Rajkumar Buyya,et al.  Model-Driven Simulation of Grid Scheduling Strategies , 2007, Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007).

[17]  Cheng Wu,et al.  Ordinal Optimized Scheduling of Scientific Workflows in Elastic Compute Clouds , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[18]  Shi Mei.  WFMS:WORKFLOW MANAGEMENT SYSTEM , 1999 .

[19]  Keqin Li,et al.  Adaptive Workflow Scheduling on Cloud Computing Platforms with IterativeOrdinal Optimization , 2015, IEEE Transactions on Cloud Computing.

[20]  Biqing Huang,et al.  A scientific workflow management system architecture and its scheduling based on cloud service platform for manufacturing big data analytics , 2016 .

[21]  Radu Prodan,et al.  Bi-Criteria Scheduling of Scientific Grid Workflows , 2010, IEEE Transactions on Automation Science and Engineering.

[22]  R. F. Freund,et al.  Scheduling resources in multi-user, heterogeneous, computing environments with SmartNet , 1998, Proceedings Seventh Heterogeneous Computing Workshop (HCW'98).

[23]  Antonio Puliafito,et al.  Open and Interoperable Clouds: The Cloud@Home Way , 2010, Cloud Computing.

[24]  Bo Zhang,et al.  Research on the Resource Monitoring Model Under Cloud Computing Environment , 2010, WISM.

[25]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[26]  Ewa Deelman,et al.  Scientific Workflows in the Cloud , 2011 .

[27]  Ian J. Taylor,et al.  A Case Study into Using Common Real-Time Workflow Monitoring Infrastructure for Scientific Workflows , 2013, Journal of Grid Computing.