Taxonomy of workflow partitioning problems and methods in distributed environments

Abstract A workflow model is the computerized representation of a business or scientific process. It defines the starting and ending conditions of the process, the activities in the process, control flow and data flow among these activities, etc. A partitioning method creates workflow fragments that group some of the workflow model elements (activities, control flows, data flows). Workflow partitioning forms the foundation of decentralised workflow execution and increases scalability, and reuse of partitions. In the literature, different methods have been presented for workflow partitioning and offer a variety of execution approaches; however, there is no existing comprehensive survey and taxonomy of workflow partitioning methods. This article presents an overview of taxonomies characterizing the key concepts of the workflow life cycle and workflow partitioning methods through a comprehensive survey of business and scientific domains in decentralised environments. This in-depth analysis of taxonomies can provide researchers, designers and applications developers with clear guideline to compare current workflow partitioning methods to choose, reuse and compose more vigorous approaches. The article further presents research discussions and future challenges in this area .

[1]  Min Zhang,et al.  A Survey of Cloud Workflow , 2013 .

[2]  Nur Izura Udzir,et al.  Adaptable Decentralized Service Oriented Architecture , 2011, J. Syst. Softw..

[3]  Jin-Kao Hao,et al.  An effective multilevel tabu search approach for balanced graph partitioning , 2011, Comput. Oper. Res..

[4]  Matthew R. Pocock,et al.  Taverna: a tool for the composition and enactment of bioinformatics workflows , 2004, Bioinform..

[5]  Wei Tan,et al.  Dynamic workflow model fragmentation for distributed execution , 2007, Comput. Ind..

[6]  Sai Peck Lee,et al.  Cost-aware challenges for workflow scheduling approaches in cloud computing environments: Taxonomy and opportunities , 2015, Future Gener. Comput. Syst..

[7]  Oliver Kopp,et al.  Maintaining Data Dependencies across BPEL Process Fragments , 2008, Int. J. Cooperative Inf. Syst..

[8]  Yong Zhao,et al.  Chimera: a virtual data system for representing, querying, and automating data derivation , 2002, Proceedings 14th International Conference on Scientific and Statistical Database Management.

[9]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[10]  Ewa Deelman,et al.  Integration of Workflow Partitioning and Resource Provisioning , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[11]  Frank Leymann,et al.  E Role-based Decomposition of Business Processes using BPEL , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[12]  Gerhard Weikum,et al.  From Centralized Workflow Specification to Distributed Workflow Execution , 1998, Journal of Intelligent Information Systems.

[13]  José M. Tribolet,et al.  Identification of Services through Functional Decomposition of Business Processes , 2010, BIS.

[14]  Xiao Liu,et al.  A Compromised-Time-Cost Scheduling Algorithm in SwinDeW-C for Instance-Intensive Cost-Constrained Workflows on a Cloud Computing Platform , 2010, Int. J. High Perform. Comput. Appl..

[15]  Faramarz Safi Esfahani,et al.  Run-time Adaptable Business Process Decentralization , 2011 .

[16]  Remco M. Dijkman,et al.  Human and automatic modularizations of process models to enhance their comprehension , 2011, Inf. Syst..

[17]  Yuan-Chun Jiang,et al.  A novel statistical time-series pattern based interval forecasting strategy for activity durations in workflow systems , 2011, J. Syst. Softw..

[18]  Mehran Mohsenzadeh,et al.  ATSDS: adaptive two-stage deadline-constrained workflow scheduling considering run-time circumstances in cloud computing environments , 2017, The Journal of Supercomputing.

[19]  Ian J. Taylor,et al.  Workflows and e-Science: An overview of workflow system features and capabilities , 2009, Future Gener. Comput. Syst..

[20]  Y.-K. Kwok,et al.  Static scheduling algorithms for allocating directed task graphs to multiprocessors , 1999, CSUR.

[21]  Xiao Liu,et al.  Logistics scheduling based on cloud business workflows , 2014, Proceedings of the 2014 IEEE 18th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[22]  Jia Yan,et al.  A Role-Based Approach for Decentralized Dynamic Service Composition , 2005 .

[23]  Frank Leymann,et al.  Towards Classification Criteria for Process Fragmentation Techniques , 2011, Business Process Management Workshops.

[24]  Alessandro Ricci,et al.  Engineering a BPEL orchestration engine as a multi-agent system , 2007, Sci. Comput. Program..

[25]  Mark Lycett,et al.  Service-oriented architecture , 2003, 2003 Symposium on Applications and the Internet Workshops, 2003. Proceedings..

[26]  Bahman Javadi,et al.  Deadline-Constrained Workflow Scheduling in Volunteer Computing Systems , 2013, ICA3PP.

[27]  Rajkumar Buyya,et al.  Cost-based scheduling of scientific workflow applications on utility grids , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[28]  Ishfaq Ahmad,et al.  Benchmarking and Comparison of the Task Graph Scheduling Algorithms , 1999, J. Parallel Distributed Comput..

[29]  Shankar Ponnekanti,et al.  SWORD: A Developer Toolkit for Web Service Composition , 2008 .

[30]  Jing Hua,et al.  A Reference Architecture for Scientific Workflow Management Systems and the VIEW SOA Solution , 2009, IEEE Transactions on Services Computing.

[31]  Luciano Baresi,et al.  Towards Distributed BPEL Orchestrations , 2006, Electron. Commun. Eur. Assoc. Softw. Sci. Technol..

[32]  Mohsen Jahanshahi,et al.  Scheduling Workflow Applications on the Heterogeneous Cloud Resources , 2015 .

[33]  Jie Cheng,et al.  An agent-oriented approach to process partition and planning in migrating workflow systems , 2012, Eng. Appl. Artif. Intell..

[34]  V. Curcin,et al.  Scientific workflow systems - can one size fit all? , 2008, 2008 Cairo International Biomedical Engineering Conference.

[35]  Hans-Arno Jacobsen,et al.  A distributed service-oriented architecture for business process execution , 2010, TWEB.

[36]  Chase Qishi Wu,et al.  High-Throughput Scientific Workflow Scheduling under Deadline Constraint in Clouds , 2014, J. Commun..

[37]  Mathias Weske,et al.  Business Process Management: Concepts, Languages, Architectures , 2007 .

[38]  Vasa Curcin,et al.  Heterogeneous Workflows in Scientific Workflow Systems , 2007, International Conference on Computational Science.

[39]  Adam Barker,et al.  Towards an autonomous decentralized orchestration system , 2016, Concurr. Comput. Pract. Exp..

[40]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[41]  Shazia Wasim Sadiq,et al.  Model Driven Distribution of Collaborative Business Processes , 2006, 2006 IEEE International Conference on Services Computing (SCC'06).

[42]  Yanlong Zhai,et al.  A Data Flow Optimization Based Approach for BPEL Processes Partition , 2007 .

[43]  Tao Yang,et al.  A Comparison of Clustering Heuristics for Scheduling Directed Acycle Graphs on Multiprocessors , 1992, J. Parallel Distributed Comput..

[44]  Gregor von Laszewski,et al.  Java CoG Kit Workflow , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[45]  Xiao Liu,et al.  A market-oriented hierarchical scheduling strategy in cloud workflow systems , 2011, The Journal of Supercomputing.

[46]  Osamu Tatebe,et al.  Workflow Scheduling to Minimize Data Movement Using Multi-constraint Graph Partitioning , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[47]  Huan Liu,et al.  An ECA-based Control-rule formalism for the BPEL Process Modularization , 2011 .

[48]  Sucha Smanchat,et al.  Taxonomies of workflow scheduling problem and techniques in the cloud , 2015, Future Gener. Comput. Syst..

[49]  Faramarz Safi Esfahani Adaptable decentralized orchestration engine for block structured non-transactional workflow in service oriented architecture. , 2011 .

[50]  David Stuart Robertson,et al.  A novel approach for enacting the distributed business workflows using BPEL4WS on the multi-agent platform , 2005, IEEE International Conference on e-Business Engineering (ICEBE'05).

[51]  Ian J. Taylor,et al.  Visual Grid Workflow in Triana , 2005, Journal of Grid Computing.

[52]  Li Liu,et al.  A Survey on Workflow Management and Scheduling in Cloud Computing , 2014, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[53]  Kwanghoon Kim A model-driven workflow fragmentation framework for collaborative workflow architectures and systems , 2012, J. Netw. Comput. Appl..

[54]  Jacek Sroka,et al.  Recent advances in Scalable Workflow Enactment Engines and Technologies , 2015, Future Gener. Comput. Syst..

[55]  Adam Barker,et al.  A Dataflow Language for Decentralised Orchestration of Web Service Workflows , 2013, 2013 IEEE Ninth World Congress on Services.

[56]  Jinjun Chen,et al.  Managing large numbers of business processes with cloud workflow systems , 2012 .