Predicting player churn in destiny: A Hidden Markov models approach to predicting player departure in a major online game

Destiny is, to date, the most expensive digital game ever released with a total operating budget of over half a billion US dollars. It stands as one of the main examples of AAA titles, the term used for the largest and most heavily marketed game productions in the games industry. Destiny is a blend of a shooter game and massively multi-player online game, and has attracted dozens of millions of players. As a persistent game title, predicting retention and churn in Destiny is crucial to the running operations of the game, but prediction has not been attempted for this type of game in the past. In this paper, we present a discussion of the challenge of predicting churn in Destiny, evaluate the area under curve (ROC) of behavioral features, and use Hidden Markov Models to develop a churn prediction model for the game.

[1]  Christian Bauckhage,et al.  Predicting Purchase Decisions in Mobile Free-to-Play Games , 2015, AIIDE.

[2]  Julian Togelius,et al.  Predicting player behavior in Tomb Raider: Underworld , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[3]  Chris GauthierDickey,et al.  Characterizing Virtual Populations in Massively Multiplayer Online Role-Playing Games , 2010, MMM.

[4]  Christian Bauckhage,et al.  Predicting Retention in Sandbox Games with Tensor Factorization-based Representation Learning , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[5]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs: A Social Influence Based Approach , 2009, 2009 International Conference on Computational Science and Engineering.

[6]  Ben Medler.  Play with data---an exploration of play analytics and its effect on player experiences , 2012 .

[7]  Eric Johnson,et al.  Predicting subscriber dissatisfaction and improving retention in the wireless telecommunications industry , 2000, IEEE Trans. Neural Networks Learn. Syst..

[8]  Brent E. Harrison,et al.  Identifying patterns in combat that are predictive of success in MOBA games , 2014, FDG.

[9]  Christian Bauckhage,et al.  The Playtime Principle: Large-scale cross-games interest modeling , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[10]  Julian Togelius,et al.  A Panorama of Artificial and Computational Intelligence in Games , 2015, IEEE Transactions on Computational Intelligence and AI in Games.

[11]  Debanjan Saha,et al.  A long-term study of a popular MMORPG , 2007, NetGames '07.

[12]  Boi Faltings,et al.  Hidden Markov models for churn prediction , 2015, 2015 SAI Intelligent Systems Conference (IntelliSys).

[13]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs Using Player Motivation Theories and an Ensemble Approach , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[14]  Ruck Thawonmas,et al.  Analysis of revisitations in online games , 2011, Entertain. Comput..

[15]  Christian Bauckhage,et al.  Predicting player churn in the wild , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[16]  Sam Devlin,et al.  Predicting player disengagement and first purchase with event-frequency based data representation , 2015, 2015 IEEE Conference on Computational Intelligence and Games (CIG).

[17]  Anders Drachen,et al.  Esports Analytics Through Encounter Detection , 2016 .

[18]  Christian Bauckhage,et al.  How players lose interest in playing a game: An empirical study based on distributions of total playing times , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[19]  Peng Gao,et al.  Churn prediction for high-value players in casual social games , 2014, 2014 IEEE Conference on Computational Intelligence and Games.