Elastic Business Process Management: State of the art and open challenges for BPM in the cloud

With the advent of cloud computing, organizations are nowadays able to react rapidly to changing demands for computational resources. Not only individual applications can be hosted on virtual cloud infrastructures, but also complete business processes. This allows the realization of so-called elastic processes, i.e., processes which are carried out using elastic cloud resources. Despite the manifold benefits of elastic processes, there is still a lack of solutions supporting them.In this paper, we identify the state of the art of elastic Business Process Management with a focus on infrastructural challenges. We conceptualize an architecture for an elastic Business Process Management System and discuss existing work on scheduling, resource allocation, monitoring, decentralized coordination, and state management for elastic processes. Furthermore, we present two representative elastic Business Process Management Systems which are intended to counter these challenges. Based on our findings, we identify open issues and outline possible research directions for the realization of elastic processes and elastic Business Process Management. Survey of state of the art in infrastructural challenges for elastic BPM.Scheduling, resource allocation, process monitoring, decentralized coordination and state management for elastic processes are discussed in detail.Identification of future research directions.

[1]  Ralf Steinmetz,et al.  Enabling cost-efficient Software Service Distribution in infrastructure clouds at run time , 2011, 2011 IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[2]  Mathias Weske,et al.  Business Process Management: Concepts, Languages, Architectures , 2007 .

[3]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[4]  Erich Schikuta,et al.  Cloud Process Execution Engine - Evaluation of the Core Concepts , 2010, ArXiv.

[5]  Frank P. Coyle.  Review of 'The power of events: An introduction to complex event processing in distributed enterprise systems,' by David Luckham, Addison Wesley Professional, May 2002 , 2003, UBIQ.

[6]  David Luckham,et al.  The power of events - an introduction to complex event processing in distributed enterprise systems , 2002, RuleML.

[7]  Johann Eder,et al.  Time Constraints in Workflow Systems , 1999, CAiSE.

[8]  Kevin Lee,et al.  Event Aware Workload Prediction: A Study Using Auction Events , 2012, WISE.

[9]  Wil M. P. van der Aalst,et al.  Workflow Patterns , 2004, Distributed and Parallel Databases.

[10]  Guillaume Pierre,et al.  Autonomous resource provisioning for multi-service web applications , 2010, WWW '10.

[11]  Jano I. van Hemert,et al.  Scientific Workflow: A Survey and Research Directions , 2007, PPAM.

[12]  Aphrodite Tsalgatidou,et al.  Decentralized Enactment of BPEL Processes , 2014, IEEE Transactions on Services Computing.

[13]  Dario Rossi,et al.  Support vector regression for link load prediction , 2008, 2008 4th International Telecommunication Networking Workshop on QoS in Multiservice IP Networks.

[14]  Wil M. P. van der Aalst,et al.  Schedule-Aware Workflow Management Systems , 2010, Trans. Petri Nets Other Model. Concurr..

[15]  Valeria Cardellini,et al.  SLA-aware Resource Management for Application Service Providers in the Cloud , 2011, 2011 First International Symposium on Network Cloud Computing and Applications.

[16]  Johann-Christoph Freytag,et al.  Adaptive workflow scheduling under resource allocation constraints and network dynamics , 2008, Proc. VLDB Endow..

[17]  Ricardo Seguel,et al.  Process Mining Manifesto , 2011, Business Process Management Workshops.

[18]  Haiyan Zhan,et al.  Applying cloud computing in financial service industry , 2010, 2010 International Conference on Intelligent Control and Information Processing.

[19]  Mathias Uslar,et al.  Requirements for Smart Grid ICT-architectures , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[20]  Borko Furht,et al.  Handbook of Cloud Computing , 2010 .

[21]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[22]  DumasMarlon,et al.  Facilitating the rapid development and scalable orchestration of composite web services , 2005 .

[23]  Rajkumar Buyya,et al.  Cooperative and decentralized workflow scheduling in global grids , 2010, Future Gener. Comput. Syst..

[24]  Hajo A. Reijers,et al.  The effectiveness of workflow management systems: Predictions and lessons learned , 2005, Int. J. Inf. Manag..

[25]  Mathias Weske,et al.  Business Process Management: A Survey , 2003, Business Process Management.

[26]  Jörg Becker,et al.  A Review of Event Formats as Enablers of Event-Driven BPM , 2011, Business Process Management Workshops.

[27]  Rajkumar Buyya,et al.  InterCloud: Utility-Oriented Federation of Cloud Computing Environments for Scaling of Application Services , 2010, ICA3PP.

[28]  Kenneth R. Baker,et al.  Principles of Sequencing and Scheduling , 2018 .

[29]  Sherif Sakr,et al.  Cloud-hosted databases: technologies, challenges and opportunities , 2014, Cluster Computing.

[30]  Matthias Klusch,et al.  Towards Process Support for Cloud Manufacturing , 2014, 2014 IEEE 18th International Enterprise Distributed Object Computing Conference.

[31]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[32]  Rajkumar Buyya,et al.  Workflow scheduling algorithms for grid computing , 2008 .

[33]  Peter Brucker,et al.  Scheduling Algorithms , 1995 .

[34]  Thomas Heinis,et al.  Design and Evaluation of an Autonomic Workflow Engine , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[35]  Kenneth R. Baker,et al.  Principles of Sequencing and Scheduling. New York: John Wiley & Sons , 2009 .

[36]  Luis Miguel Vaquero Gonzalez,et al.  Service Scalability Over the Cloud , 2010, Handbook of Cloud Computing.

[37]  Radu Prodan,et al.  DEE: A Distributed Fault Tolerant Workflow Enactment Engine for Grid Computing , 2005, HPCC.

[38]  Selmin Nurcan,et al.  Business Process Scheduling Strategies in Cloud Environments with Fairness Metrics , 2013, 2013 IEEE International Conference on Services Computing.

[39]  Schahram Dustdar,et al.  Cost-Driven Optimization of Cloud Resource Allocation for Elastic Processes , 2013, Services Transactions on Cloud Computing.

[40]  Srikumar Venugopal,et al.  Using reinforcement learning for controlling an elastic web application hosting platform , 2011, ICAC '11.

[41]  Carlo Combi,et al.  Task Scheduling for a TemporalWorkflow Management System , 2006, Thirteenth International Symposium on Temporal Representation and Reasoning (TIME'06).

[42]  Amit P. Sheth,et al.  A Taxonomy of Adaptive Workflow Management , 2002 .

[43]  Schahram Dustdar,et al.  Workflow Scheduling and Resource Allocation for Cloud-Based Execution of Elastic Processes , 2013, 2013 IEEE 6th International Conference on Service-Oriented Computing and Applications.

[44]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[45]  Quan Z. Sheng,et al.  Facilitating the Rapid Development and Scalable Orchestration of Composite Web Services , 2004, Distributed and Parallel Databases.

[46]  Marta Indulska,et al.  Modeling languages for business processes and business rules: A representational analysis , 2009, Inf. Syst..

[47]  Ingo Weber,et al.  Optimizing the Performance of Automated Business Processes Executed on Virtualized Infrastructure , 2014, 2014 47th Hawaii International Conference on System Sciences.

[48]  Ulrich Lampe,et al.  On the Relevance of Security Risks for Cloud Adoption in the Financial Industry , 2013, AMCIS.

[49]  Jacques Wainer,et al.  Applying scheduling techniques to minimize the number of late jobs in workflow systems , 2004, SAC '04.

[50]  Huilong Duan,et al.  Reinforcement learning based resource allocation in business process management , 2011, Data Knowl. Eng..

[51]  Anja Strunk.  QoS-Aware Service Composition: A Survey , 2010, 2010 Eighth IEEE European Conference on Web Services.

[52]  Srikumar Venugopal,et al.  Efficient Node Bootstrapping for Decentralised Shared-Nothing Key-Value Stores , 2013, Middleware.

[53]  Manfred Reichert,et al.  Time patterns for process-aware information systems , 2014, Requirements Engineering.

[54]  Ismail Hakki Toroslu,et al.  An architecture for workflow scheduling under resource allocation constraints , 2005, Inf. Syst..

[55]  Odej Kao,et al.  Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud , 2011, IEEE Transactions on Parallel and Distributed Systems.

[56]  Alejandro P. Buchmann,et al.  From Calls to Events: Architecting Future BPM Systems , 2012, BPM.

[57]  Schahram Dustdar,et al.  Cost-Efficient and Application SLA-Aware Client Side Request Scheduling in an Infrastructure-as-a-Service Cloud , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[58]  M. Brian Blake,et al.  Decentralized Resource Coordination across Service Workflows in a Cloud Environment , 2013, 2013 Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[59]  Mark von Rosing,et al.  Business Process Model and Notation - BPMN , 2015, The Complete Business Process Handbook, Vol. I.

[60]  Ewa Deelman,et al.  Experiences using cloud computing for a scientific workflow application , 2011, ScienceCloud '11.

[61]  Manfred Reichert,et al.  Adeptflex—Supporting Dynamic Changes of Workflows Without Losing Control , 1998, Journal of Intelligent Information Systems.

[62]  Peter Gyngell,et al.  Process Innovation: Reengineering Work through Information Technology , 1994 .

[63]  Claudia Szabo,et al.  Evolving multi-objective strategies for task allocation of scientific workflows on public clouds , 2012, 2012 IEEE Congress on Evolutionary Computation.

[64]  Ian J. Taylor,et al.  The Triana Workflow Environment: Architecture and Applications , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[65]  Daniel Gooch,et al.  Communications of the ACM , 2011, XRDS.

[66]  Rajkumar Buyya,et al.  SLA-Based Resource Allocation for Software as a Service Provider (SaaS) in Cloud Computing Environments , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[67]  Cheng-Zhong Xu,et al.  URL: A unified reinforcement learning approach for autonomic cloud management , 2012, J. Parallel Distributed Comput..

[68]  Ingo Weber,et al.  Scalable Business Process Execution in the Cloud , 2014, 2014 IEEE International Conference on Cloud Engineering.

[69]  Li-zhen Cui,et al.  A Multiple QoS Constrained Scheduling Strategy of Multiple Workflows for Cloud Computing , 2009, 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications.

[70]  Srikumar Venugopal,et al.  Introducing the Vienna Platform for Elastic Processes , 2012, ICSOC Workshops.

[71]  Yike Guo,et al.  Principles of Elastic Processes , 2011, IEEE Internet Computing.

[72]  Gustavo Alonso,et al.  Exotica/FMQM: A Persistent Message-Based Architecture for Distributed Workflow Management , 1995 .

[73]  Hans-Arno Jacobsen,et al.  BPM in Cloud Architectures: Business Process Management with SLAs and Events , 2010, BPM.

[74]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[75]  Fethi A. Rabhi,et al.  ADAGE: a framework for supporting user-driven ad-hoc data analysis processes , 2012, Computing.

[76]  Srikumar Venugopal,et al.  Self-Adaptive Resource Allocation for Elastic Process Execution , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[77]  Deborah Bunker,et al.  An Empirical Analysis of Cloud, Mobile, Social and Green Computing: Financial Services IT Strategy and Enterprise Architecture , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[78]  Peter Dadam,et al.  Correctness criteria for dynamic changes in workflow systems - a survey , 2004, Data Knowl. Eng..

[79]  Heiko Schuldt,et al.  OSIRIS-SR: a scalable yet reliable distributed workflow execution engine , 2013, SWEET '13.

[80]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..

[81]  Opher Etzion,et al.  Event Processing in Action , 2010 .

[82]  D. Atkin.  OR scheduling algorithms. , 2000, Anesthesiology.

[83]  Michael Pinedo,et al.  Scheduling algorithms and systems , 1999 .

[84]  Mark Burgess,et al.  Promise theory - a model of autonomous objects for pervasive computing and swarms , 2006, International conference on Networking and Services (ICNS'06).

[85]  Jorge-Arnulfo Quiané-Ruiz,et al.  Runtime measurements in the cloud , 2010, Proc. VLDB Endow..

[86]  Ciprian Dobre,et al.  Workflow management in large distributed systems , 2011 .

[87]  Jin-Soo Kim,et al.  Cost optimized provisioning of elastic resources for application workflows , 2011, Future Gener. Comput. Syst..

[88]  Michael Rosemann,et al.  Process Management: A Guide for the Design of Business Processes , 2011 .

[89]  Xiao Liu,et al.  SwinDeW-C: A Peer-to-Peer Based Cloud Workflow System , 2010, Handbook of Cloud Computing.

[90]  Raffaela Mirandola,et al.  Performance Prediction of Web Service Workflows , 2007, QoSA.

[91]  Peter Loos,et al.  Event-Driven Business Process Management: where are we now?: A comprehensive synthesis and analysis of literature , 2014, Bus. Process. Manag. J..

[92]  Hans-Arno Jacobsen,et al.  Load Balancing Content-Based Publish/Subscribe Systems , 2010, TOCS.

[93]  VanmechelenKurt,et al.  Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds , 2013 .

[94]  Hans Schuster,et al.  A configuration management approach for large workflow management systems , 1999, WACC '99.

[95]  Ivona Brandic,et al.  Managing and Optimizing Bioinformatics Workflows for Data Analysis in Clouds , 2013, Journal of Grid Computing.

[96]  Christian Huemer,et al.  Towards Living Inter-organizational Processes , 2013, 2013 IEEE 15th Conference on Business Informatics.

[97]  Andreas Neumann,et al.  Oozie: towards a scalable workflow management system for Hadoop , 2012, SWEET '12.

[98]  M. Brian Blake,et al.  Adaptive Service Workflow Configuration and Agent-Based Virtual Resource Management in the Cloud* , 2013, 2013 IEEE International Conference on Cloud Engineering (IC2E).

[99]  Julien Gossa,et al.  Comparing Provisioning and Scheduling Strategies for Workflows on Clouds , 2013, 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum.

[100]  Daniel Moldovan,et al.  Multi-level Elasticity Control of Cloud Services , 2013, ICSOC.

[101]  Jan Broeckhove,et al.  Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds , 2013, Future Gener. Comput. Syst..

[102]  Thomas G. Dietterich.  Machine Learning for Sequential Data: A Review , 2002, SSPR/SPR.

[103]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[104]  Bernd Freisleben,et al.  Multi-objective Scheduling of BPEL Workflows in Geographically Distributed Clouds , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[105]  Mathias Weske,et al.  Scientific Workflows: Business as Usual? , 2009, BPM.

[106]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[107]  Christian Janiesch,et al.  Beyond process monitoring: a proof-of-concept of event-driven business activity management , 2012, Bus. Process. Manag. J..

[108]  Hans-Arno Jacobsen,et al.  A distributed service-oriented architecture for business process execution , 2010, TWEB.