Player retention in league of legends: a study using survival analysis

Multi-player online esports games are designed for extended durations of play, requiring substantial experience to master. Furthermore, esports game revenues are increasingly driven by in-game purchases. For esports companies, the trends in players leaving their games therefore not only provide information about potential problems in the user experience, but also impacts revenue. Being able to predict when players are about to leave the game - churn prediction - is therefore an important solution for companies in the rapidly growing esports sector, as this allows them to take action to remedy churn problems. The objective of the work presented here is to understand the impact of specific behavioral characteristics on the likelihood of a player continuing to play the esports title League of Legends. Here, a solution to the problem is presented based on the application of survival analysis, using Mixed Effects Cox Regression, to predict player churn. Survival Analysis forms a useful approach for the churn prediction problem as it provides rates as well as an assessment of the characteristics of players who are at risk of leaving the game. Hazard rates are also presented for the leading indicators, with results showing that duration between matches played is a strong indicator of potential churn.

[1]  Peng Gao,et al.  Churn prediction for high-value players in casual social games , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[2]  Sukree Sinthupinyo,et al.  Skill rating method in multiplayer online battle arena , 2016, 2016 8th International Conference on Electronics, Computers and Artificial Intelligence (ECAI).

[3]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs Using Player Motivation Theories and an Ensemble Approach , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[4]  Sam Devlin,et al.  Predicting player disengagement and first purchase with event-frequency based data representation , 2015, 2015 IEEE Conference on Computational Intelligence and Games (CIG).

[5]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[6]  Hong Zhang.  Customer retention in the financial industry: An application of survival analysis , 2008 .

[7]  C. Geisler,et al.  Survival Analysis of Faculty Retention in Science and Engineering by Gender , 2012, Science.

[8]  Konstantinos I. Diamantaras,et al.  A comparison of machine learning techniques for customer churn prediction , 2015, Simul. Model. Pract. Theory.

[9]  Christian Bauckhage,et al.  Predicting player churn in the wild , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[10]  Kuan-Ta Chen,et al.  On prophesying online gamer departure , 2009, 2009 8th Annual Workshop on Network and Systems Support for Games (NetGames).

[11]  Zhe Chen,et al.  Cultural Difference on Team Performance Between Chinese and Americans in Multiplayer Online Battle Arena Games , 2015, HCI.

[12]  J. Palmgren,et al.  Estimation of Multivariate Frailty Models Using Penalized Partial Likelihood , 2000, Biometrics.

[13]  Ashutosh Tiwari,et al.  Computer assisted customer churn management: State-of-the-art and future trends , 2007, Comput. Oper. Res..

[14]  Michael Cook,et al.  Draft-Analysis of the Ancients: Predicting Draft Picks in DotA 2 using Machine Learning , 2016, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[15]  Tapio Pahikkala,et al.  Measuring Player Retention and Monetization Using the Mean Cumulative Function , 2017, IEEE Transactions on Games.

[16]  Christian Bauckhage,et al.  Predicting Purchase Decisions in Mobile Free-to-Play Games , 2015, AIIDE.

[17]  Milo Miloevi,et al.  Early churn prediction with personalized targeting in mobile social games , 2017 .

[18]  Toderean Gavril,et al.  Churn Prediction Modeling in Mobile Telecommunications Industry Using Decision Trees , 2013 .

[19]  David W. Hosmer,et al.  Applied Survival Analysis: Regression Modeling of Time-to-Event Data , 2008 .

[20]  P. V. Rao,et al.  Applied Survival Analysis: Regression Modeling of Time to Event Data , 2000 .

[21]  Yong Shi,et al.  Credit card churn forecasting by logistic regression and decision tree , 2011, Expert Syst. Appl..

[22]  D.,et al.  Regression Models and Life-Tables , 2022 .

[23]  The Year in Review , 1990, Bio/Technology.

[24]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs: A Social Influence Based Approach , 2009, 2009 International Conference on Computational Science and Engineering.

[25]  Sam Devlin,et al.  Predicting Player Disengagement in Online Games , 2014, CGW@ECAI.

[26]  Anders Drachen,et al.  Esports Analytics Through Encounter Detection , 2016 .

[27]  Christian Bauckhage,et al.  The Playtime Principle: Large-scale cross-games interest modeling , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[28]  David C. Yen,et al.  Applying data mining to telecom churn management , 2006, Expert Syst. Appl..

[29]  David A. Schoenfeld,et al.  Partial residuals for the proportional hazards regression model , 1982 .

[30]  Debanjan Saha,et al.  Measurement-based characterization of a collection of on-line games , 2005, IMC '05.

[31]  Milos Milosevic,et al.  Early churn prediction with personalized targeting in mobile social games , 2017, Expert Syst. Appl..

[32]  Jukka Heikkonen,et al.  Modelling user retention in mobile games , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[33]  Debanjan Saha,et al.  A long-term study of a popular MMORPG , 2007, NetGames '07.

[34]  Kristof Coussement,et al.  Customer churn prediction in the online gambling industry: The beneficial effect of ensemble learning , 2013 .

[35]  Hiroyuki Iida,et al.  Fairness mechanism in multiplayer online battle arena games , 2016, 2016 3rd International Conference on Systems and Informatics (ICSAI).

[36]  Jean-Philippe Métivier,et al.  Mining Tracks of Competitive Video Games , 2014 .