Probabilistic Sequence Modeling for Trustworthy IT Servicing by Collective Expert Networks

Within the enterprise the timely resolution of incidents that occur within complex Information Technology (IT) systems is essential for the business, yet it remains challenging to achieve. To provide incident resolution, existing research applies probabilistic models locally to reduce the transfers (links) between expert groups (nodes) in the network. This approach is inadequate for incident management that must meet IT Service Levels (SLs). We show this using an analysis of enterprise 'operational big data' and the existence of collective problem solving in which expert skills are often complementary and are applied in sequences that are meaningful. We call such a network - 'Collective Expert Network' (or CEN). We propose a probabilistic model which uses the content-base of transfer sequences to generate assistive recommendations that improves the performance of CEN by: (1) resolving incidents to meet customer time constraints and satisfaction (and not just minimize number of transfers), (2) conforming to previous transfer sequences that have already achieved their SLs, and additionally (3) address trust in order to ensure adoption of recommendations. We present a two-level classification framework that learns regular patterns first and then recommends SL-achieving sequences on a subset of tickets, and for the remaining directly recommends knowledge improvement. The experimental validation shows 34% accuracy improvement over other existing research and locally applied generative models. In addition we show 10% reduction in the volume of SL breaching incidents, and 7% reduction in MTTR of all tickets.

[1]  Alvitta Ottley,et al.  Balancing Human and Machine Contributions in Human Computation Systems , 2013, Handbook of Human Computation.

[2]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[3]  Reuven Cohen,et al.  Complex Networks: Structure, Robustness and Function , 2010 .

[4]  Kin Keung Lai,et al.  An intelligent-agent-based fuzzy group decision making model for financial multicriteria decision support: The case of credit scoring , 2009, Eur. J. Oper. Res..

[5]  M. Newman Power laws, Pareto distributions and Zipf's law , 2005 .

[6]  Wil M. P. van der Aalst Using Process Mining to Bridge the Gap between BI and BPM , 2011, Computer.

[7]  Yi Chen,et al.  Assessing Expertise Awareness in Resolution Networks , 2010, 2010 International Conference on Advances in Social Networks Analysis and Mining.

[8]  Victor Kaptelinin,et al.  Affordances in HCI: toward a mediated action perspective , 2012, CHI.

[9]  Louise E. Moser,et al.  Reliable Ticket Routing in Expert Networks , 2012 .

[10]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[11]  Yi Chen,et al.  Efficient ticket routing by resolution sequence mining , 2008, KDD.

[12]  Yang Li,et al.  Analyzing expert behaviors in collaborative networks , 2014, KDD.

[13]  David R. Karger,et al.  Tackling the Poor Assumptions of Naive Bayes Text Classifiers , 2003, ICML.

[14]  Saeed Bagheri,et al.  Agility of Enterprise Operations across Distributed Organizations: A Model of Cross Enterprise Collaboration , 2011, 2011 Annual SRII Global Conference.

[15]  Louise E. Moser,et al.  Generative models for ticket resolution in expert networks , 2010, KDD.

[16]  Varun Aggarwal,et al.  A system to grade computer programming skills using machine learning , 2014, KDD.

[17]  Carla Simone,et al.  Computational Coordination Mechanisms: A tale of a struggle for flexibility , 2013, Computer Supported Cooperative Work (CSCW).

[18]  Wil M. P. van der Aalst,et al.  Process Mining - Discovery, Conformance and Enhancement of Business Processes , 2011 .

[19]  Rajiv Ramnath,et al.  Recommendations for Achieving Service Levels within Large-scale Resolution Service Networks , 2015, Compute '15.

[20]  M. Porter,et al.  Critical Truths About Power Laws , 2012, Science.