ATSDS: adaptive two-stage deadline-constrained workflow scheduling considering run-time circumstances in cloud computing environments

A significant aspect of cloud computing is scheduling of a large number of real-time concurrent workflow instances. Most of the existing scheduling algorithms are designed for a single complex workflow instance. This study examined instance-intensive workflows bounded by SLA constraints, including user-defined deadlines.The scheduling method for these workflows with dynamic workloads should be able to handle changing conditions and maximize the utilization rate of the cloud resources. The study proposes an adaptive two-stage deadline-constrained scheduling (ATSDS) strategy that considers run-time circumstances of workflows in the cloud environment. The stages are workflow fragmentation and resource allocation.In the first stage, the workflows according to cloud run-time circumstances (number of Virtual Machines (VMs) and average available bandwidth) are dynamically fragmented. In the second stage, using the workflow deadline and the capacity of the VMs, the workflow fragments created are allocated to the VMs to be executed. The simulation results show improvements in terms of workflow completion time, number of messages exchanged, percentage of workflows that meet the deadline and VM usage cost compared to other approaches.

[1]  Luciano Baresi,et al.  Towards Distributed BPEL Orchestrations , 2006, Electron. Commun. Eur. Assoc. Softw. Sci. Technol..

[2]  Jie Cheng,et al.  An agent-oriented approach to process partition and planning in migrating workflow systems , 2012, Eng. Appl. Artif. Intell..

[3]  Keqin Li,et al.  Adaptive Workflow Scheduling on Cloud Computing Platforms with IterativeOrdinal Optimization , 2015, IEEE Transactions on Cloud Computing.

[4]  Xiao Liu,et al.  Logistics scheduling based on cloud business workflows , 2014, Proceedings of the 2014 IEEE 18th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[5]  Tom Baeyens,et al.  BPM in the Cloud , 2013, BPM.

[6]  Graham R. Nudd,et al.  Pace—A Toolset for the Performance Prediction of Parallel and Distributed Systems , 2000, Int. J. High Perform. Comput. Appl..

[7]  Shazia Wasim Sadiq,et al.  Model Driven Distribution of Collaborative Business Processes , 2006, 2006 IEEE International Conference on Services Computing (SCC'06).

[8]  Claude Godart,et al.  A Flexible Approach for Automatic Process Decentralization Using Dependency Tables , 2009, 2009 IEEE International Conference on Web Services.

[9]  Hamid R. Arabnia,et al.  Fast Operations on Raster Images with SIMD Machine Architectures , 1986, Comput. Graph. Forum.

[10]  Isam Azawi Mohialdeen.  Comparative Study of Scheduling al-Grotihms in Cloud Computing , 2013, J. Comput. Sci..

[11]  Susana Muñoz-Hernández,et al.  Towards Fuzzy Granularity Control in Parallel/Distributed Computing , 2010, IJCCI.

[12]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[13]  Huifang Li,et al.  A QoS-based scheduling algorithm for instance-intensive workflows in cloud environment , 2014, The 26th Chinese Control and Decision Conference (2014 CCDC).

[14]  Soo Dong Kim,et al.  Design of a Dynamic Composition Handler for ESB-based Services , 2007 .

[15]  Wei Tan,et al.  Dynamic workflow model fragmentation for distributed execution , 2007, Comput. Ind..

[16]  Hamid R. Arabnia,et al.  Parallel Polygon Approximation Algorithm Targeted at Reconfigurable Multi-Ring Hardware , 2006, CGVR.

[17]  Frank Leymann,et al.  E Role-based Decomposition of Business Processes using BPEL , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[18]  Marty Humphrey,et al.  Auto-scaling to minimize cost and meet application deadlines in cloud workflows , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[19]  Oliver Kopp,et al.  Maintaining Data Dependencies Across BPEL Process Fragments , 2007, ICSOC.

[20]  Schahram Dustdar,et al.  Workflow Scheduling and Resource Allocation for Cloud-Based Execution of Elastic Processes , 2013, 2013 IEEE 6th International Conference on Service-Oriented Computing and Applications.

[21]  Jan Mendling,et al.  On the transformation of control flow between block-oriented and graph-oriented process modelling languages , 2008, Int. J. Bus. Process. Integr. Manag..

[22]  Hamid R. Arabnia,et al.  A Parallel Algorithm for the Arbitrary Rotation of Digitized Images Using Process-and-Data-Decomposition Approach , 1990, J. Parallel Distributed Comput..

[23]  Xingfu Wu,et al.  Using Performance Prediction to Allocate Grid Resources , 2004 .

[24]  David Stuart Robertson,et al.  A novel approach for enacting the distributed business workflows using BPEL4WS on the multi-agent platform , 2005, IEEE International Conference on e-Business Engineering (ICEBE'05).

[25]  Vijayalakshmi Atluri,et al.  A decentralized execution model for inter-organizational workflows , 2007, Distributed and Parallel Databases.

[26]  Hans-Arno Jacobsen,et al.  A distributed service-oriented architecture for business process execution , 2010, TWEB.

[27]  Yanlong Zhai,et al.  A Data Flow Optimization Based Approach for BPEL Processes Partition , 2007, IEEE International Conference on e-Business Engineering (ICEBE'07).

[28]  Zhao Li,et al.  Scheduling real-time workflow on MapReduce-based cloud , 2013, Third International Conference on Innovative Computing Technology (INTECH 2013).

[29]  Lavanya Ramakrishnan,et al.  Deadline-sensitive workflow orchestration without explicit resource control , 2011, J. Parallel Distributed Comput..

[30]  S.M. Bhandarkar,et al.  The Hough Transform on a Reconfigurable Multi-Ring Network , 1995, J. Parallel Distributed Comput..

[31]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[32]  Binh Thanh Nguyen,et al.  Translation from BPMN to BPEL, current techniques and limitations , 2014, SoICT '14.

[33]  Chase Qishi Wu,et al.  High-Throughput Scientific Workflow Scheduling under Deadline Constraint in Clouds , 2014, J. Commun..

[34]  Bahman Javadi,et al.  Deadline-Constrained Workflow Scheduling in Volunteer Computing Systems , 2013, ICA3PP.

[35]  Hamid R. Arabnia,et al.  Arbitrary Rotation of Raster Images with SIMD Machine Architectures , 1987, Comput. Graph. Forum.

[36]  M. Sudha,et al.  Dynamic Adaptive Workflow Scheduling for Instance Intensive Cloud Applications , 2012 .

[37]  Francine Berman,et al.  New Grid Scheduling and Rescheduling Methods in the GrADS Project , 2004, IPDPS Next Generation Software Program - NSFNGS - PI Workshop.

[38]  Filip De Turck,et al.  Cost-aware scheduling of deadline-constrained task workflows in public cloud environments , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[39]  Yuan-Chun Jiang,et al.  A novel statistical time-series pattern based interval forecasting strategy for activity durations in workflow systems , 2011, J. Syst. Softw..

[40]  Nur Izura Udzir,et al.  Adaptable Decentralized Service Oriented Architecture , 2011, J. Syst. Softw..

[41]  Hamid R. Arabnia,et al.  Parallel Edge-Region-Based Segmentation Algorithm Targeted at Reconfigurable MultiRing Network , 2003, The Journal of Supercomputing.

[42]  Frank Leymann,et al.  Towards Classification Criteria for Process Fragmentation Techniques , 2011, Business Process Management Workshops.

[43]  H.R. Arabnia,et al.  A Transputer Network for Fast Operations on Digitised Images , 1989, Comput. Graph. Forum.

[44]  Hamid R. Arabnia,et al.  A distributed stereocorrelation algorithm , 1995, Proceedings of Fourth International Conference on Computer Communications and Networks - IC3N'95.

[45]  Xiao Liu,et al.  A Compromised-Time-Cost Scheduling Algorithm in SwinDeW-C for Instance-Intensive Cost-Constrained Workflows on a Cloud Computing Platform , 2010, Int. J. High Perform. Comput. Appl..

[46]  Faramarz Safi Esfahani,et al.  Run-time Adaptable Business Process Decentralization , 2011 .

[47]  Xiao Liu,et al.  A market-oriented hierarchical scheduling strategy in cloud workflow systems , 2011, The Journal of Supercomputing.

[48]  Utpal Biswas,et al.  Development and Analysis of a New Cloudlet Allocation Strategy for QoS Improvement in Cloud , 2015 .

[49]  Alessandro Ricci,et al.  Engineering a BPEL orchestration engine as a multi-agent system , 2007, Sci. Comput. Program..

[50]  Oliver Kopp,et al.  On the Choice Between Graph-Based and Block-Structured Business Process Modeling Languages , 2008, MobIS.

[51]  Hamid R. Arabnia,et al.  Parallel stereocorrelation on a reconfigurable multi-ring network , 1996, The Journal of Supercomputing.

[52]  Nathaniel Palmer,et al.  Workflow Management Coalition , 2009, Encyclopedia of Database Systems.