Churn Prediction in MMORPGs Using Player Motivation Theories and an Ensemble Approach

In this paper, we investigate the problem of churn prediction in Massively multiplayer online role-playing games (MMORPGs) from a social science perspective and develop models incorporating theories of player motivation. The ability to predict player churn can be a valuable resource to game developers designing customer retention strategies. The results from our theory-driven model significantly outperform a diffusion-based churn prediction model on the same dataset. We describe the synthesis between a theory-driven approach and a data-driven approach to a problem and examine the trade-offs involved between the two approaches in terms of prediction accuracy, interpretability and model complexity. We observe that even though the theory-driven model is not as accurate as the data-driven one, the theory-driven model itself can be more interpretable to the domain experts and hence, more preferable over a complex data-driven model. We perform lift analysis of the two models and find that if a marketing effort is restricted in the number of customers it can contact, the theory-driven model would offer much better return-on-investment by identifying more customers among that restricted set who have the highest probability of churn. Finally, we use a clustering technique to partition the dataset and then build an ensemble on the partitioned dataset for better performance. Experiment results show that the ensemble performs notably better than the single classifier in terms of its recall value, which is a highly desirable property in the churn prediction problem.

[1]  Charles X. Ling,et al.  Data Mining for Direct Marketing: Problems and Solutions , 1998, KDD.

[2]  Jeanne Farrington,et al.  Seven plus or minus two , 2011 .

[3]  Matthew Rowe,et al.  The effect of user features on churn in social networks , 2011, WebSci '11.

[4]  Sougata Mukherjea,et al.  Social ties and their relevance to churn in mobile telecom networks , 2008, EDBT '08.

[5]  Pedro M. Domingos The Role of Occam's Razor in Knowledge Discovery , 1999, Data Mining and Knowledge Discovery.

[6]  Chih-Fong Tsai,et al.  Customer churn prediction by hybrid neural networks , 2009, Expert Syst. Appl..

[7]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[8]  Marcel Karnstedt,et al.  Handbook of Social Network Technologies and Applications , 2010 .

[9]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[10]  Taieb Znati,et al.  Modeling Churn in P2P Networks , 2007, 40th Annual Simulation Symposium (ANSS'07).

[11]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs: A Social Influence Based Approach , 2009, 2009 International Conference on Computational Science and Engineering.

[12]  M. Tahar Kechadi,et al.  Customer Churn Prediction for Broadband Internet Services , 2009, DaWaK.

[13]  Euiho Suh,et al.  An LTV model and customer segmentation based on customer value: a case study on the wireless telecommunication industry , 2004, Expert Syst. Appl..

[14]  Teemu Mutanen,et al.  Customer churn analysis - a case study , 2006 .

[15]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[16]  Eric Johnson,et al.  Predicting subscriber dissatisfaction and improving retention in the wireless telecommunications industry , 2000, IEEE Trans. Neural Networks Learn. Syst..

[17]  Yu Zhao,et al.  Customer Churn Prediction Using Improved One-Class Support Vector Machine , 2005, ADMA.

[18]  Marcel Karnstedt,et al.  Churn in Social Networks , 2010, Handbook of Social Network Technologies.

[19]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[20]  Joydeep Ghosh,et al.  Multiclassifier Systems: Back to the Future , 2002, Multiple Classifier Systems.

[21]  Kristof Coussement,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Churn Prediction in Subscription Services: an Application of Support Vector Machines While Comparing Two Parameter-selection Techniques Churn Prediction in Subscription Services: an Application of Support Vector Machines While Comparin , 2022 .

[22]  Yong Shi,et al.  Finding the Hidden Pattern of Credit Card Holder's Churn: A Case of China , 2009, ICCS.

[23]  Eric W. T. Ngai,et al.  Customer churn prediction using improved balanced random forests , 2009, Expert Syst. Appl..

[24]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[25]  M. Tahar Kechadi,et al.  Multi-objective feature selection by using NSGA-II for customer churn prediction in telecommunications , 2010, Expert Syst. Appl..

[26]  Katharina Morik,et al.  Analysing Customer Churn in Insurance Data - A Case Study , 2004, PKDD.

[27]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[28]  Marley M. B. R. Vellasco,et al.  Data Mining Techniques on the Evaluation of Wireless Churn , 2004, ESANN.

[29]  David C. Yen,et al.  Applying data mining to telecom churn management , 2006, Expert Syst. Appl..

[30]  Bin Li,et al.  CHAMP: A Prototype for Automated Cellular Churn Prediction , 1999, Data Mining and Knowledge Discovery.