A Difficulty-Aware Framework for Churn Prediction and Intervention in Games

User's leaving from the system without further return, called user churn, is a severe negative signal in online games. Therefore, churn prediction and intervention are of great value for improving players' experiences and system performance. However, the problem has not been well-studied in the game scenario. Especially, some crucial factors, such as game difficulty, have not been considered for large-scale churn analysis. In this paper, a novel Difficulty-Aware Framework (DAF) for churn prediction and intervention is proposed. Firstly, a Difficulty Flow for each user is proposed, which is utilized to derive users' Personalized Perceived Difficulty during the game process. Then, a survival analysis modelD-Cox-Time is designed to model the Dynamic Influence of Perceived Difficulty on player churn intention. Finally, thePersonalized Perceived Difficulty ~(PPD) andDynamic Difficulty Influence ~(DDI) are incorporated to churn prediction and intervention. The proposed DAF framework has been specified in a real-world puzzle game as an example for churn prediction and intervention. Extensive offline experiments show significant improvements in churn prediction by introducing difficulty-related features. Besides, we conduct an online intervention system to adjust difficulty dynamically in the online game. A/B test results verify that the proposed intervention system enhances user retention and engagement significantly. To the best of our knowledge, it is the first framework in games that illustrates an in-depth understanding and leveraging dynamic and personalized perceived difficulty during game playing, which is easy to be integrated with various churn prediction and intervention models.

[1]  Na Wang,et al.  Micro- and macro-level churn analysis of large-scale mobile games , 2019, Knowledge and Information Systems.

[2]  Farhan Hassan Khan,et al.  Churn Prediction using Neural Network based Individual and Ensemble Models , 2019, 2019 16th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[3]  Anna Guitart,et al.  Churn Prediction in Mobile Social Games: Towards a Complete Assessment Using Survival Ensembles , 2016, 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[4]  Jiawei Han,et al.  I Know You'll Be Back: Interpretable New User Clustering and Churn Prediction on a Mobile Social Application , 2018, KDD.

[5]  Artit Wangperawong,et al.  Churn analysis using deep convolutional neural networks and autoencoders , 2016, ArXiv.

[6]  Jae-Hyeon Ahn,et al.  Customer churn analysis: Churn determinants and mediation effects of partial defection in the Korean mobile telecommunications service industry , 2006 .

[7]  Rainer Malaka,et al.  Enemy Within: Long-term Motivation Effects of Deep Player Behavior Models for Dynamic Difficulty Adjustment , 2020, CHI.

[8]  Ida Scheel,et al.  Time-to-Event Prediction with Neural Networks and Cox Regression , 2019, J. Mach. Learn. Res..

[9]  Gavriel Salvendy,et al.  Effects of different scenarios of game difficulty on player immersion , 2010, Interact. Comput..

[10]  N. Nagelkerke,et al.  A note on a general definition of the coefficient of determination , 1991 .

[11]  D. Hoang FLOW: The Psychology of Optimal Experience , 2018 .

[12]  Alex R. Wade,et al.  Modelling Early User-Game Interactions for Joint Estimation of Survival Time and Churn Probability , 2019, 2019 IEEE Conference on Games (CoG).

[13]  Magy Seif El-Nasr,et al.  Modeling Individual Differences in Game Behavior Using HMM , 2018, AIIDE.

[14]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[15]  Amir Hussain,et al.  Large-scale Ensemble Model for Customer Churn Prediction in Search Ads , 2018, Cognitive Computation.

[16]  Filip Radlinski,et al.  Online Evaluation for Information Retrieval , 2016, Found. Trends Inf. Retr..

[17]  Stéphane Natkin,et al.  Measuring the level of difficulty in single player video games , 2011, Entertain. Comput..

[18]  Kenneth R. Koedinger,et al.  Optimizing challenge in an educational game using large-scale design experiments , 2013, CHI.

[19]  Arthur Tay,et al.  Dynamic Game Difficulty Scaling Using Adaptive Behavior-Based AI , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[20]  Karsten Rothmeier,et al.  Prediction of Player Churn and Disengagement Based on User Activity Data of a Freemium Online Strategy Game , 2020, IEEE Transactions on Games.

[21]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[22]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[23]  Su Xue,et al.  Dynamic Difficulty Adjustment for Maximized Engagement in Digital Games , 2017, WWW.

[24]  Guillaume Levieux,et al.  Dynamic Difficulty Adjustment Impact on Players' Confidence , 2019, CHI.

[25]  Jesper Juul Fear of Failing ? The Many Meanings of Difficulty in Video Games , 2011 .

[26]  Jari Takatalo,et al.  Predicting Game Difficulty and Churn Without Players , 2020, CHI PLAY.

[27]  Anna Guitart,et al.  Games and big data: A scalable multi-dimensional churn prediction model , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[28]  Axel Buendia,et al.  From Objective to Subjective Difficulty Evaluation in Video Games , 2017, INTERACT.

[29]  Jun Yan Survival Analysis: Techniques for Censored and Truncated Data , 2004 .

[30]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[31]  A. Elliot,et al.  Handbook of Competence and Motivation , 2013 .