Analyzing Comments in Ticket Resolution to Capture Underlying Process Interactions

Activities in the ticket resolution process have comments and emails associated with them. Process mining uses structured logs and does not analyze the unstructured data such as comments for process discovery. However, comments can provide additional information for discovering models of process reality and identifying improvement opportunities efficiently. To address the problem, we propose to extract topical phrases (keyphrases) from the unstructured data using an unsupervised graph-based approach. These keyphrases are then integrated into the event log to derive enriched event logs. A process model is discovered using the enriched event logs wherein keyphrases are represented as activities, thereby capturing the flow relationship with other activities and the frequency of occurrence. This provides insights that can not be obtained solely from the structured data. To evaluate the approach, we conduct a case study on the ticket data of a large global IT company. Our approach extracts keyphrases with an average accuracy of around 80%. Henceforth, discovered process model succinctly captures underlying process interactions which allows to understand in detail the process realities and identify opportunities for improvement. In this case, for example, manager identified that having a bot to capture specific information can reduce the delays incurred while waiting for the information.

[1]  Jan Mendling,et al.  Process Model Generation from Natural Language Text , 2011, CAiSE.

[2]  Peter D. Turney Learning Algorithms for Keyphrase Extraction , 2000, Information Retrieval.

[3]  Anette Hulth,et al.  A Study on Automatically Extracted Keywords in Text Categorization , 2006, ACL.

[4]  Zhiyuan Liu,et al.  Automatic Keyphrase Extraction via Topic Decomposition , 2010, EMNLP.

[5]  Nicola Guarino,et al.  Business Process Management , 2016, Business & Information Systems Engineering.

[6]  Jan Mendling,et al.  Challenges and Opportunities of Applying Natural Language Processing in Business Process Management , 2018, COLING.

[7]  Vincent Ng,et al.  Automatic Keyphrase Extraction: A Survey of the State of the Art , 2014, ACL.

[8]  Mohamed S. Kamel,et al.  CorePhrase: Keyphrase Extraction for Document Clustering , 2005, MLDM.

[9]  Kun Zhang,et al.  Multi-label learning by exploiting label dependency , 2010, KDD.

[10]  Alexander Serebrenik,et al.  Security and emotion: sentiment analysis of security discussions on GitHub , 2014, MSR 2014.

[11]  Mohamed S. Kamel,et al.  Efficient phrase-based document indexing for Web document clustering , 2004, IEEE Transactions on Knowledge and Data Engineering.

[12]  Vojtech Huser,et al.  Process Mining: Discovery, Conformance and Enhancement of Business Processes , 2012, J. Biomed. Informatics.

[13]  Evangelos E. Milios,et al.  World Wide Web site summarization , 2004, Web Intell. Agent Syst..

[14]  Alexander Serebrenik,et al.  Reducing user input requests to improve IT support ticket resolution process , 2017, Empirical Software Engineering.

[15]  Jan Mendling,et al.  Searching textual and model-based process descriptions based on a unified data format , 2017, Software & Systems Modeling.

[16]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[17]  Zhijun Ding,et al.  PEWP: Process extraction based on word position in documents , 2014, Ninth International Conference on Digital Information Management (ICDIM 2014).

[18]  Wil M. P. van der Aalst,et al.  Process Mining - Discovery, Conformance and Enhancement of Business Processes , 2011 .

[19]  Mohammad S. Sorower A Literature Survey on Algorithms for Multi-label Learning , 2010 .