Assessing business process complexity based on textual data: Evidence from ITIL IT ticket processing

PurposeThis study aims to draw the attention of business process management (BPM) research and practice to the textual data generated in the processes and the potential of meaningful insights extraction. The authors apply standard natural language processing (NLP) approaches to gain valuable knowledge in the form of business process (BP) complexity concept suggested in the study. It is built on the objective, subjective and meta-knowledge extracted from the BP textual data and encompassing semantics, syntax and stylistics. As a result, the authors aim to create awareness about cognitive, attention and reading efforts forming the textual data-based BP complexity. The concept serves as a basis for the development of various decision-support solutions for BP workers.Design/methodology/approachThe starting point is an investigation of the complexity concept in the BPM literature to develop an understanding of the related complexity research and to put the textual data-based BP complexity in its context. Afterward, utilizing the linguistic foundations and the theory of situation awareness (SA), the concept is empirically developed and evaluated in a real-world application case using qualitative interview-based and quantitative data-based methods.FindingsIn the practical, real-world application, the authors confirmed that BP textual data could be used to predict BP complexity from the semantic, syntactic and stylistic viewpoints. The authors were able to prove the value of this knowledge about the BP complexity formed based on the (1) professional contextual experience of the BP worker enriched by the awareness of cognitive efforts required for BP execution (objective knowledge), (2) business emotions enriched by attention efforts (subjective knowledge) and (3) quality of the text, i.e. professionalism, expertise and stress level of the text author, enriched by reading efforts (meta-knowledge). In particular, the BP complexity concept has been applied to an industrial example of Information Technology Infrastructure Library (ITIL) change management (CHM) Information Technology (IT) ticket processing. The authors used IT ticket texts from two samples of 28,157 and 4,625 tickets as the basis for the analysis. The authors evaluated the concept with the help of manually labeled tickets and a rule-based approach using historical ticket execution data. Having a recommendation character, the results showed to be useful in creating awareness regarding cognitive, attention and reading efforts for ITIL CHM BP workers coordinating the IT ticket processing.Originality/valueWhile aiming to draw attention to those valuable insights inherent in BP textual data, the authors propose an unconventional approach to BP complexity definition through the lens of textual data. Hereby, the authors address the challenges specified by BPM researchers, i.e. focus on semantics in the development of vocabularies and organization- and sector-specific adaptation of standard NLP techniques.

[1]  Vili Podgorelec,et al.  Decision Trees: An Overview and Their Use in Medicine , 2002, Journal of Medical Systems.

[2]  Hajo A. Reijers,et al.  Comparing textual descriptions to process models - The automatic detection of inconsistencies , 2017, Inf. Syst..

[3]  Jan Mendling,et al.  Supporting Process Model Validation through Natural Language Generation , 2014, IEEE Transactions on Software Engineering.

[4]  Hajo A. Reijers,et al.  Identifying Candidate Tasks for Robotic Process Automation in Textual Process Descriptions , 2018, BPMDS/EMMSAD@CAiSE.

[5]  Norbert Gronau,et al.  Management of Knowledge Intensive Business Processes , 2004, Business Process Management.

[6]  Rajiv D. Banker,et al.  Software complexity and maintenance costs , 1993, CACM.

[7]  Ingo Weber,et al.  Every apprentice needs a master: Feedback-based effectiveness improvements for process model matching , 2021, Inf. Syst..

[8]  Sallie M. Henry,et al.  Software Structure Metrics Based on Information Flow , 1981, IEEE Transactions on Software Engineering.

[9]  Xin Zhou,et al.  A-BPS: Automatic Business Process Discovery Service using Ordered Neurons LSTM , 2020, 2020 IEEE International Conference on Web Services (ICWS).

[10]  Yingxu Wang,et al.  A new measure of software complexity based on cognitive weights , 2003 .

[11]  Kresimir Solic,et al.  Methodology for complexity reduction of IT system (adjustment of the sessions' methodology) , 2011, 2011 Proceedings of the 34th International Convention MIPRO.

[12]  Victor R. Basili,et al.  An Empirical Study of a Syntactic Complexity Family , 1983, IEEE Transactions on Software Engineering.

[13]  Yiying Zhang,et al.  Information technology and service diversification: A cross-level study in different innovation environments , 2021, Inf. Manag..

[14]  Woo-Je Kim,et al.  A method of activity-based software maintenance cost estimation for package software , 2021, The Journal of Supercomputing.

[15]  Hajo A. Reijers,et al.  Using Hidden Markov Models for the accurate linguistic analysis of process model activity labels , 2019, Inf. Syst..

[16]  Volker Gruhn,et al.  Complexity Metrics for business Process Models , 2006, BIS.

[17]  Neetu Sardana,et al.  Bug Handling in Service Sector Software , 2021, Research Anthology on Recent Trends, Tools, and Implications of Computer Programming.

[18]  Nina Rizun,et al.  Business Sentiment Analysis. Concept and Method for Perceived Anticipated Effort Identification , 2019, ISD.

[19]  Ching Y. Suen,et al.  Complexity metrics for rule-based expert systems , 1994, Proceedings 1994 International Conference on Software Maintenance.

[20]  James A. Senn,et al.  System structure and software maintenance performance , 1989, Commun. ACM.

[21]  N. Rizun,et al.  Discovery of Stylistic Patterns in Business Process Textual Descriptions: IT Ticket Case , 2019 .

[22]  Jan Mendling,et al.  A Discourse on Complexity of Process Models , 2006, Business Process Management Workshops.

[23]  Hajo A. Reijers,et al.  Checking process compliance against natural language specifications using behavioral spaces , 2018, Inf. Syst..

[24]  Oliver Thomas,et al.  Semantic Process Modeling – Design and Implementation of an Ontology-based Representation of Business Processes , 2009, Bus. Inf. Syst. Eng..

[25]  Fabrizio Maria Maggi,et al.  Declo: A Chatbot for User-friendly Specification of Declarative Process Models , 2020, BPM.

[26]  Jorge S. Cardoso,et al.  Business Process Control-Flow Complexity: Metric, Evaluation, and Validation , 2008, Int. J. Web Serv. Res..

[27]  Hajo A. Reijers,et al.  Evaluating workflow process designs using cohesion and coupling metrics , 2008, Comput. Ind..

[28]  Giriprasad Sridhara,et al.  Automated Dispatch of Helpdesk Email Tickets: Pushing the Limits with AI , 2018, AAAI.

[29]  Elena Lloret,et al.  Optimizing Data-Driven Models for Summarization as Parallel Tasks , 2020, J. Comput. Sci..

[30]  Ching Y. Suen,et al.  Verifying, validating, and measuring the performance of expert systems , 1990 .

[31]  Grzegorz J. Nalepa,et al.  Square Complexity Metrics for Business Process Models , 2012, ABICT.

[32]  Walter Baets,et al.  A cognitive framework for reengineering knowledge-intensive processes , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[33]  Nina Rizun,et al.  Analyzing content of tasks in Business Process Management. Blending task execution and organization perspectives , 2021, Comput. Ind..

[34]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[35]  Hajo A. Reijers,et al.  A Task Framework for Predicting the effects of Automation , 2018, ECIS.

[36]  Jorge S. Cardoso,et al.  Complexity analysis of BPEL Web processes , 2007, Softw. Process. Improv. Pract..

[37]  Anssi Karhinen,et al.  Software Metrics by Architectural Pattern Mining , 2000 .

[38]  Mahmood Alborzi,et al.  Applying clustering and classification data mining techniques for competitive and knowledge‐intensive processes improvement , 2019, Knowledge and Process Management.

[39]  Jan Mendling,et al.  On a Quest for Good Process Models: The Cross-Connectivity Metric , 2008, CAiSE.

[40]  Krzysztof Kluza,et al.  Measuring Complexity of Business Process Models Integrated with Rules , 2015, ICAISC.

[41]  Nina Rizun,et al.  Method of Decision-Making Logic Discovery in the Business Process Textual Data , 2019, BIS.

[42]  Ina Schaefer,et al.  Towards Reducing the Complexity of Enterprise Architectures by Identifying Standard Variants Using Variability Mining , 2016 .

[43]  Tobias Scheffer,et al.  Learning to identify concise regular expressions that describe email campaigns , 2015, J. Mach. Learn. Res..

[44]  Jorge Limón-Robles,et al.  The impact of early failures on maintenance costs: an empirical study in Latin America , 2021 .

[45]  Mamata Jenamani,et al.  Helpfulness of online consumer reviews: A multi-perspective approach , 2021, Inf. Process. Manag..

[46]  Walter Daelemans,et al.  Explanation in Computational Stylometry , 2013, CICLing.

[47]  Stefan T. Mol,et al.  Text Mining in Organizational Research , 2017, Organizational research methods.

[48]  Wil M. P. van der Aalst,et al.  Complexity metrics for Workflow nets , 2009, Inf. Softw. Technol..

[49]  Remco M. Dijkman,et al.  Similarity of business process models: Metrics and evaluation , 2011, Inf. Syst..

[50]  Marlon Dumas,et al.  Automated discovery of declarative process models with correlated data conditions , 2020, Inf. Syst..

[51]  K. S. Shreedhara,et al.  Automated IT Service Desk Systems Using Machine Learning Techniques , 2019 .

[52]  Jan Mendling,et al.  Process Model Generation from Natural Language Text , 2011, CAiSE.

[53]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[54]  Rajiv D. Banker,et al.  Software complexity and maintainability , 1989, ICIS '89.

[55]  W.M.P. van der Aalst,et al.  Business Process Management: A Comprehensive Survey , 2013 .

[56]  Prerna Agarwal,et al.  Analyzing Comments in Ticket Resolution to Capture Underlying Process Interactions , 2020, Business Process Management Workshops.

[57]  David Notkin,et al.  Editorial—looking back , 2013, TSEM.

[58]  Jan vom Brocke,et al.  Using Text Analytics to Derive Customer Service Management Benefits from Unstructured Data , 2016, MIS Q. Executive.

[59]  Jan Mendling,et al.  Challenges of smart business process management: An introduction to the special issue , 2017, Decis. Support Syst..

[60]  Jan Mendling,et al.  Error Metrics for Business Process Models , 2007, CAiSE Forum.

[61]  Flávia Maria Santoro,et al.  Towards characterizing Knowledge Intensive Processes , 2012, Proceedings of the 2012 IEEE 16th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[62]  Stuart H. Zweben,et al.  Measuring the quality of structured designs , 1981, J. Syst. Softw..

[63]  Shaokun Fan,et al.  A text analytics framework for automated communication pattern analysis , 2020, Inf. Manag..

[64]  Remco M. Dijkman,et al.  The ICoP Framework: Identification of Correspondences between Process Models , 2010, CAiSE.

[65]  D. Campbell Task Complexity: A Review and Analysis , 1988 .

[66]  Sampo Pyysalo,et al.  brat: a Web-based Tool for NLP-Assisted Text Annotation , 2012, EACL.

[67]  Martin J. Eppler,et al.  Improving knowledge intensive processes through an enterprise knowledge medium , 1999, SIGCPR '99.

[68]  Jan Mendling,et al.  Automatic Detection and Resolution of Lexical Ambiguity in Process Models , 2015, IEEE Transactions on Software Engineering.

[69]  Richard J. Murnane,et al.  With What Skills Are Computers a Complement , 1996 .

[70]  Leonardo Guerreiro Azevedo,et al.  Detection of naming convention violations in process models for different languages , 2013, Decis. Support Syst..

[71]  Volker Gruhn,et al.  Examining Case Management Demand Using Event Log Complexity Metrics , 2014, 2014 IEEE 18th International Enterprise Distributed Object Computing Conference Workshops and Demonstrations.

[72]  One-Ki Daniel Lee,et al.  How do knowledge management resources and capabilities pay off in short term and long term? , 2020, Inf. Manag..

[73]  David M. Blei,et al.  Probabilistic topic models , 2012, Commun. ACM.

[74]  Alessio Antonini,et al.  Software Measures for Business Processes , 2011, ADBIS.

[75]  Nina Rizun,et al.  Multi-Criteria Knowledge-Based Recommender System for Decision Support in Complex Business Processes , 2019, ComplexRec@RecSys.

[76]  Stefan Feuerriegel,et al.  Business analytics for strategic management: Identifying and assessing corporate challenges via topic modeling , 2020, Inf. Manag..

[77]  Ahmed Guessoum,et al.  Ontology learning: Grand tour and challenges , 2021, Comput. Sci. Rev..

[78]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[79]  Jorge S. Cardoso,et al.  Business Process Quality Metrics: Log-Based Complexity of Workflow Patterns , 2007, OTM Conferences.

[80]  Martin R. Woodward,et al.  A Measure of Control Flow Complexity in Program Text , 1979, IEEE Transactions on Software Engineering.

[81]  R. Wood Task complexity: Definition of the construct , 1986 .

[82]  Surendra Sarnikar,et al.  Knowledge Management Systems for Knowledge-Intensive Processes: Design Approach and an Illustrative Example , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[83]  Hajo A. Reijers,et al.  A weighted coupling metric for business process models , 2007, CAiSE Forum.

[84]  Christoph Seidl,et al.  Decision Support for Reducing Unnecessary IT Complexity of Application Architectures , 2017, 2017 IEEE International Conference on Software Architecture Workshops (ICSAW).

[85]  Nina Rizun,et al.  Simulation Models of Human Decision-Making Processes , 2014 .

[86]  Alexander Keller Challenges and Directions in Service Management Automation , 2017, Journal of Network and Systems Management.

[87]  Jan Mendling,et al.  Challenges and Opportunities of Applying Natural Language Processing in Business Process Management , 2018, COLING.

[88]  Gary M. Grobman,et al.  Complexity Theory: A New Way to Look at Organizational Change , 2005, Public Administration Quarterly.

[89]  Xin Zhou,et al.  Automatic Business Process Structure Discovery using Ordered Neurons LSTM: A Preliminary Study , 2020, ArXiv.

[90]  Jan Mendling,et al.  How visual cognition influences process model comprehension , 2017, Decis. Support Syst..

[91]  Jan Mendling,et al.  Prediction of Business Process Model Quality Based on Structural Metrics , 2010, ER.

[92]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[93]  Jan Mendling,et al.  Automatic service derivation from business process model repositories via semantic technology , 2015, J. Syst. Softw..

[94]  Alexandra Spitz-Oener Technical Change, Job Tasks, and Rising Educational Demands: Looking outside the Wage Structure , 2006, Journal of Labor Economics.

[95]  John A. van der Poll,et al.  Metrics for the Case Management Modeling and Notation (CMMN) Specification , 2015, SAICSIT '15.

[96]  Amir Karami,et al.  Twitter speaks: A case of national disaster situational awareness , 2019, J. Inf. Sci..

[97]  Chunping Li,et al.  Complex Network Model for Software System and Complexity Measurement , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[98]  Manfred Reichert,et al.  Refactoring large process model repositories , 2011, Comput. Ind..

[99]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[100]  Jan Vanthienen,et al.  Complexity metrics for DMN decision models , 2019, Comput. Stand. Interfaces.

[101]  Remco M. Dijkman,et al.  Business Process Model Merging: An Approach to Business Process Consolidation , 2013, TSEM.

[102]  Bojan Cukic,et al.  Automated Duplicate Bug Report Classification Using Subsequence Matching , 2012, 2012 IEEE 14th International Symposium on High-Assurance Systems Engineering.

[103]  Andreas Oberweis,et al.  Rule-based Autocompletion of Business Process Models , 2007, CAiSE Forum.

[104]  Mahmoud Efatmaneshnik,et al.  Revisiting task complexity: A comprehensive framework , 2018, 2018 Annual IEEE International Systems Conference (SysCon).

[105]  Jan Mendling,et al.  Searching textual and model-based process descriptions based on a unified data format , 2017, Software & Systems Modeling.

[106]  M. Endsley Situation Awareness Misconceptions and Misunderstandings , 2015 .