Motivating dynamic features for resolution time estimation within IT operations management

Cloud-based services today depend on many layers of virtual technology and application services. Incidents and problems that arise in such complex operational environments are logged as a ticket, worked on by experts and finally resolved. To assist these experts, any machine recommendation method must meet the following critical business requirements: 1) the ticket must be resolved, meeting specific time constraints or Service Level Targets (SLTs), and 2) any predictive assistance must be trustworthy. Existing research uses probabilistic models to recommend transfers between experts based on limited features intrinsic to the ticket content, and does not demonstrate how to meet SLTs. To address this lack of research and ensure SLT-compliance for an incoming ticket given its recommended sequence of experts, there needs to be an accurate time-to-resolve (TTR) estimation. This research aims to identify important features for modeling time-to-resolve estimation given the routing recommendation sequences. This work particularly makes the following contributions: 1) constructs a framework for assessing TTR estimations and their SLT-compliance, 2) applies the assessment to a baseline estimation model to identify the need for better TTR modeling, and 3) uses language modeling to study the impact of anomalous content on the estimation error, and 4) introduces a set of dynamic features, and a methodology to rigorously model the TTR estimation.

[1]  Yang Li,et al.  Analyzing expert behaviors in collaborative networks , 2014, KDD.

[2]  Rajiv Ramnath,et al.  Recommendations for Achieving Service Levels within Large-scale Resolution Service Networks , 2015, Compute '15.

[3]  Yixin Diao,et al.  Modeling the Impact of Service Level Agreements During Service Engagement , 2014, IEEE Transactions on Network and Service Management.

[4]  Yi Chen,et al.  Efficient ticket routing by resolution sequence mining , 2008, KDD.

[5]  Yi Chen,et al.  Assessing Expertise Awareness in Resolution Networks , 2010, 2010 International Conference on Advances in Social Networks Analysis and Mining.

[6]  Slava M. Katz,et al.  Estimation of probabilities from sparse data for the language model component of a speech recognizer , 1987, IEEE Trans. Acoust. Speech Signal Process..

[7]  Rajiv Ramnath,et al.  Probabilistic Sequence Modeling for Trustworthy IT Servicing by Collective Expert Networks , 2016, 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC).

[8]  Louise E. Moser,et al.  Reliable Ticket Routing in Expert Networks , 2012 .

[9]  Louise E. Moser,et al.  Generative models for ticket resolution in expert networks , 2010, KDD.