Detecting Inconsistencies Between Process Models and Textual Descriptions

Text-based and model-based process descriptions have their own particular strengths and, as such, appeal to different stakeholders. For this reason, it is not unusual to find within an organization descriptions of the same business processes in both modes. When considering that hundreds of such descriptions may be in use in a particular organization by dozens of people, using a variety of editors, there is a clear risk that such models become misaligned. To reduce the time and effort needed to repair such situations, this paper presents the first approach to automatically identify inconsistencies between a process model and a corresponding textual description. Our approach leverages natural language processing techniques to identify cases where the two process representations describe activities in different orders, as well as model activities that are missing from the textual description. A quantitative evaluation with 46 real-life model-text pairs demonstrates that our approach allows users to quickly and effectively identify those descriptions in a process repository that are inconsistent.

[1]  Thomas Allweyer,et al.  BPMN 2.0 : introduction to the standard for business process modeling , 2016 .

[2]  Fausto Giunchiglia,et al.  Semantic Matching: Algorithms and Implementation , 2007, J. Data Semant..

[3]  Imran Sarwar Bajwa,et al.  From Natural Language Software Specifications to UML Class Models , 2011, ICEIS.

[4]  Jan Mendling,et al.  Supporting Process Model Validation through Natural Language Generation , 2014, IEEE Transactions on Software Engineering.

[5]  Henrik Leopold,et al.  Natural Language in Business Process Models , 2013, Lecture Notes in Business Information Processing.

[6]  Jan Mendling,et al.  Increasing Recall of Process Model Matching by Improved Activity Label Matching , 2013, BPM.

[7]  Owen Rambow,et al.  The ModelExplainer , 1996, INLG.

[8]  Natalya F. Noy,et al.  Semantic integration: a survey of ontology-based approaches , 2004, SGMD.

[9]  Mirjam Minor,et al.  Extracting and enriching workflows from text , 2013, 2013 IEEE 14th International Conference on Information Reuse & Integration (IRI).

[10]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[11]  Mathias Weske,et al.  Behavioral Similarity - A Proper Metric , 2011, BPM.

[12]  Alexander H. Waibel,et al.  Decoding Algorithm in Statistical Machine Translation , 1997, ACL.

[13]  Michael Rosemann,et al.  Potential pitfalls of process modeling: part A , 2006, Bus. Process. Manag. J..

[14]  Hajo A. Reijers,et al.  On the Fragmentation of Process Information: Challenges, Solutions, and Outlook , 2015, BMMDS/EMMSAD.

[15]  Xiaohua Hu,et al.  The Evaluation of Sentence Similarity Measures , 2008, DaWaK.

[16]  Jan Mendling,et al.  Process Model Generation from Natural Language Text , 2011, CAiSE.

[17]  William J. Kettinger,et al.  Business Process Change: A Study of Methodologies, Techniques, and Tools , 1997, MIS Q..

[18]  Remco M. Dijkman,et al.  The ICoP Framework: Identification of Correspondences between Process Models , 2010, CAiSE.

[19]  Carlo Strapparava,et al.  Corpus-based and Knowledge-based Measures of Text Semantic Similarity , 2006, AAAI.

[20]  Marc Ehrig,et al.  Measuring Similarity between Semantic Business Process Models , 2007, APCCM.

[21]  Saonee Sarker,et al.  An Exploration into the Process of Requirements Elicitation: A Grounded Approach , 2010, J. Assoc. Inf. Syst..

[22]  Remco M. Dijkman,et al.  Report: The Process Model Matching Contest 2013 , 2013, Business Process Management Workshops.

[23]  J. Euzenat,et al.  Ontology Matching , 2007, Springer Berlin Heidelberg.

[24]  Andreas Oberweis,et al.  Triple-S: A Matching Approach for Petri Nets on Syntactic, Semantic and Structural level , 2013, BPM 2013.

[25]  Alon Y. Halevy,et al.  Semantic Integration Research in the Database Community : A Brief Survey , 2005 .

[26]  Sophia Ananiadou,et al.  Generating Natural Language specifications from UML class diagrams , 2008, Requirements Engineering.

[27]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[28]  Peter Loos,et al.  The Process Model Matching Contest 2015 , 2013, EMISA.

[29]  MendlingJan,et al.  Efficient Consistency Measurement Based on Behavioral Profiles of Process Models , 2011 .

[30]  Christopher D. Manning,et al.  The Stanford Typed Dependencies Representation , 2008, CF+CDPE@COLING.

[31]  Remco M. Dijkman,et al.  Similarity of business process models: Metrics and evaluation , 2011, Inf. Syst..

[32]  Fernando Gomez,et al.  A System for the Semiautomatic Generation of E-R Models from Natural Language Specifications , 1999, Data Knowl. Eng..

[33]  Remco M. Dijkman,et al.  Business Process Model Merging: An Approach to Business Process Consolidation , 2013, TSEM.

[34]  Mathias Weske,et al.  Efficient Consistency Measurement Based on Behavioral Profiles of Process Models , 2011, IEEE Transactions on Software Engineering.

[35]  Marlon Dumas,et al.  Clone Detection in Repositories of Business Process Models , 2011, BPM.

[36]  Haim Levkowitz,et al.  Introduction to information retrieval (IR) , 2008 .

[37]  Erhard Rahm,et al.  A survey of approaches to automatic schema matching , 2001, The VLDB Journal.

[38]  Dekang Lin,et al.  An Information-Theoretic Definition of Similarity , 1998, ICML.