Towards Business Process Execution Adequacy Criteria

Monitoring of business process execution has been proposed for the evaluation of business process performance. An important aspect to assess the thoroughness of the business process execution is to monitor if some entities have not been observed for some time and timely check if something is going wrong. We propose in this paper business process execution adequacy criteria and provide a proof-of-concept monitoring framework for their assessment. Similar to testing adequacy, the purpose of our approach is to identify the main entities of the business process that are covered during its execution and raise a warning if some entities are not covered. We provide a first assessment of the proposed approach on a case study in the learning context.

[1]  Qian Yang,et al.  A Survey of Coverage-Based Testing Tools , 2009, Comput. J..

[2]  Frank Leymann,et al.  Monitoring and Analyzing Influential Factors of Business Process Performance , 2009, 2009 IEEE International Enterprise Distributed Object Computing Conference.

[3]  Piergiorgio Bertoli,et al.  Modeling and Monitoring Business Process Execution , 2013, ICSOC.

[4]  Michael R. Lyu,et al.  An empirical study on testing and fault tolerance for software reliability engineering , 2003, 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003..

[5]  Elaine J. Weyuker,et al.  The Cost of Data Flow Testing: An Empirical Study , 1990, IEEE Trans. Software Eng..

[6]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[7]  Antonello Calabrò,et al.  Monitoring of Business Process Execution Based on Performance Indicators , 2015, 2015 41st Euromicro Conference on Software Engineering and Advanced Applications.

[8]  Falko Koetter,et al.  A Model-Driven Approach for Event-Based Business Process Monitoring , 2012, Business Process Management Workshops.

[9]  David Lee,et al.  Passive testing and applications to network management , 1997, Proceedings 1997 International Conference on Network Protocols.

[10]  Eda Marchetti,et al.  Adequate monitoring of service compositions , 2013, ESEC/FSE 2013.

[11]  Michael R. Lyu,et al.  The effect of code coverage on fault detection under different testing profiles , 2005, ACM SIGSOFT Softw. Eng. Notes.

[12]  Damiano Falcioni,et al.  Direct Verification of BPMN Processes through an Optimized Unfolding Technique , 2012, 2012 12th International Conference on Quality Software.

[13]  Michael R. Lyu,et al.  Achieving software quality with testing coverage measures , 1994, Computer.

[14]  Marek Hatala,et al.  A qualitative evaluation of evolution of a learning analytics tool , 2012, Comput. Educ..