The Process Model Matching Contest 2015

Process model matching refers to the automatic identification of correspondences between the activities of process models. Application scenarios of process model matching reach from model validation over harmonization of process variants to effective management of process model collections. Recognizing this, several process model matching techniques have been developed in recent years. However, to learn about specific strengths and weaknesses of these techniques, a common evaluation basis is indispensable. The second edition of the Process Model Matching Contest in 2015 hence addresses the need for effective evaluation by defining process model matching problems over published data sets. This paper summarizes the setup and the results of the contest. Next to a description of the contest matching problems, the paper provides short descriptions of all matching techniques that have been submitted for participation. In addition, we present and discuss the evaluation results and outline directions for future work in the field of process model matching.

[1]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[2]  Remco M. Dijkman,et al.  Similarity of business process models: Metrics and evaluation , 2011, Inf. Syst..

[3]  Sarah Jane Delany.  k-Nearest Neighbour Classifiers , 2007 .

[4]  Constantin Houy,et al.  Zur Nutzung von Techniken der Natürlichen Sprachverarbeitung für die Bestimmung von Prozessmodellähnlichkeiten - Review und Konzeptentwicklung , 2015, Wirtschaftsinformatik.

[5]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[6]  Avigdor Gal,et al.  Tuning the ensemble selection process of schema matchers , 2010, Inf. Syst..

[7]  Jan Mendling,et al.  On the refactoring of activity labels in business process models , 2012, Inf. Syst..

[8]  Remco M. Dijkman,et al.  Graph Matching Algorithms for Business Process Model Similarity Search , 2009, BPM.

[9]  Norman W. Paton,et al.  User Feedback as a First Class Citizen in Information Integration Systems , 2011, CIDR.

[10]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[11]  Horst Bunke,et al.  On a relation between graph edit distance and maximum common subgraph , 1997, Pattern Recognit. Lett..

[12]  Remco M. Dijkman,et al.  Business Process Model Merging: An Approach to Business Process Consolidation , 2013, TSEM.

[13]  Karl Aberer,et al.  Minimizing Human Effort in Reconciling Match Networks , 2013, ER.

[14]  Mathias Weske,et al.  Efficient Consistency Measurement Based on Behavioral Profiles of Process Models , 2011, IEEE Transactions on Software Engineering.

[15]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[16]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[17]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[18]  Jan Mendling,et al.  Listen to Me: Improving Process Model Matching through User Feedback , 2014, BPM.

[19]  Roberto Navigli,et al.  Word sense disambiguation: A survey , 2009, CSUR.

[20]  ChengXiang Zhai,et al.  Positional language models for information retrieval , 2009, SIGIR.

[21]  Krzysztof Czarnecki,et al.  Matching business process workflows across abstraction levels , 2012, MODELS'12.

[22]  Guido Governatori,et al.  Compliance aware business process design , 2008 .

[23]  J Allan,et al.  Readings in information retrieval. , 1998 .

[24]  Heiner Stuckenschmidt,et al.  Results of the Ontology Alignment Evaluation Initiative 2007 , 2006, OM.

[25]  Avigdor Gal,et al.  Non-binary Evaluation for Schema Matching , 2012, ER.

[26]  Remco M. Dijkman,et al.  Report: The Process Model Matching Contest 2013 , 2013, Business Process Management Workshops.

[27]  J. Euzenat,et al.  Ontology Matching , 2007, Springer Berlin Heidelberg.

[28]  Heiner Stuckenschmidt,et al.  Results of the Ontology Alignment Evaluation Initiative , 2007 .

[29]  Matthias Weidlich,et al.  Towards a Compendium of Process Technologies - The jBPT Library for Process Model Analysis , 2013, CAiSE Forum.

[30]  Dan Klein,et al.  Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network , 2003, NAACL.

[31]  Marc Ehrig,et al.  Measuring Similarity between Semantic Business Process Models , 2007, APCCM.

[32]  Erhard Rahm,et al.  Schema Matching and Mapping , 2013, Schema Matching and Mapping.

[33]  Zohra Bellahsene,et al.  Matching and Alignment: What Is the Cost of User Post-Match Effort? - (Short Paper) , 2011, OTM Conferences.

[34]  Andreas Oberweis,et al.  Triple-S: A Matching Approach for Petri Nets on Syntactic, Semantic and Structural level , 2013, BPM 2013.

[35]  Peter Willett,et al.  Readings in information retrieval , 1997 .

[36]  Jan Mendling,et al.  Increasing Recall of Process Model Matching by Improved Activity Label Matching , 2013, BPM.

[37]  Emanuel Santos,et al.  AgreementMakerLight 2.0 , 2014, ISWC 2014.

[38]  P. Patel-Schneider.  Towards Large-scale Schema And Ontology Matching , 2015 .

[39]  Tao Jin,et al.  Efficient querying of large process model repositories , 2013, Comput. Ind..

[40]  Patrick Pantel,et al.  Inducing Ontological Co-occurrence Vectors , 2005, ACL.

[41]  Yuzhong Qu,et al.  Constructing virtual documents for ontology matching , 2006, WWW '06.

[42]  Mathias Weske,et al.  Behavioral Similarity - A Proper Metric , 2011, BPM.

[43]  Hanna M. Wallach,et al.  Topic modeling: beyond bag-of-words , 2006, ICML.

[44]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[45]  Marlon Dumas,et al.  Approximate Clone Detection in Repositories of Business Process Models , 2012, BPM.

[46]  Sherif Sakr,et al.  Querying Process Models Repositories by Aggregated Graph Search , 2012, Business Process Management Workshops.

[47]  Avigdor Gal,et al.  Schema matching prediction with applications to data source discovery and dynamic ensembling , 2013, The VLDB Journal.

[48]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[49]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[50]  Mauro Dragoni.  Exploiting multilinguality for creating mappings between thesauri , 2015, SAC.

[51]  Juan Enrique Ramos,et al.  Using TF-IDF to Determine Word Relevance in Document Queries , 2003 .

[52]  Jana Koehler,et al.  Improving Business Process Models with Reference Models in Business-Driven Development , 2006, Business Process Management Workshops.

[53]  Dekang Lin,et al.  An Information-Theoretic Definition of Similarity , 1998, ICML.

[54]  Isabel F. Cruz,et al.  AgreementMakerLight results for OAEI 2013 , 2013, OM.

[55]  Remco M. Dijkman,et al.  Aligning Business Process Models , 2009, 2009 IEEE International Enterprise Distributed Object Computing Conference.

[56]  Martha Palmer,et al.  Verb Semantics and Lexical Selection , 1994, ACL.

[57]  Remco M. Dijkman,et al.  The ICoP Framework: Identification of Correspondences between Process Models , 2010, CAiSE.

[58]  Ahmed Awad,et al.  BPMN-Q: A Language to Query Business Processes , 2007, EMISA.

[59]  Matthias Weidlich,et al.  Matching Business Process Models Using Positional Passage-Based Language Models , 2013, ER.

[60]  Remco M. Dijkman,et al.  Similarity Search of Business Process Models , 2009, IEEE Data Eng. Bull..

[61]  Mathias Weske,et al.  A Foundational Approach for Managing Process Variability , 2011, CAiSE.