Customer churn prediction in the telecommunication sector using a rough set approach

Customer churn is a critical and challenging problem affecting business and industry, in particular, the rapidly growing, highly competitive telecommunication sector. It is of substantial interest to both academic researchers and industrial practitioners, interested in forecasting the behavior of customers in order to differentiate the churn from non-churn customers. The primary motivation is the dire need of businesses to retain existing customers, coupled with the high cost associated with acquiring new ones. A review of the field has revealed a lack of efficient, rule-based Customer Churn Prediction (CCP) approaches in the telecommunication sector. This study proposes an intelligent rule-based decision-making technique, based on rough set theory (RST), to extract important decision rules related to customer churn and non-churn. The proposed approach effectively performs classification of churn from non-churn customers, along with prediction of those customers who will churn or may possibly churn in the near future. Extensive simulation experiments are carried out to evaluate the performance of our proposed RST based CCP approach using four rule-generation mechanisms, namely, the Exhaustive Algorithm (EA), Genetic Algorithm (GA), Covering Algorithm (CA) and the LEM2 algorithm (LA). Empirical results show that RST based on GA is the most efficient technique for extracting implicit knowledge in the form of decision rules from the publicly available, benchmark telecom dataset. Further, comparative results demonstrate that our proposed approach offers a globally optimal solution for CCP in the telecom sector, when benchmarked against several state-of-the-art methods. Finally, we show how attribute-level analysis can pave the way for developing a successful customer retention policy that could form an indispensable part of strategic decision making and planning process in the telecom sector.

[1]  M. Tahar Kechadi,et al.  Customer churn prediction in telecommunications , 2012, Expert Syst. Appl..

[2]  J. Grzymala-Busse A Comparison of Three Strategies to Rule Induction from Data with Numerical Attributes , 2003, Electron. Notes Theor. Comput. Sci..

[3]  Manuel Graña,et al.  Reputation features for trust prediction in social networks , 2015, Neurocomputing.

[4]  Cao Kang,et al.  Customer Churn Prediction Based on SVM-RFE , 2008, 2008 International Seminar on Business and Information Management.

[5]  Prabin Kumar Panigrahi,et al.  A Neural Network based Approach for Predicting Customer Churn in Cellular Network Services , 2011, ArXiv.

[6]  Asifullah Khan,et al.  Intelligent churn prediction in telecom: employing mRMR feature selection and RotBoost based ensemble classification , 2013, Applied Intelligence.

[7]  Bart Baesens,et al.  New insights into churn prediction in the telecommunication sector: A profit driven data mining approach , 2012, Eur. J. Oper. Res..

[8]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[9]  Chi-Hyuck Jun,et al.  Improved churn prediction in telecommunication industry by analyzing a large network , 2014, Expert Syst. Appl..

[10]  HussainAmir,et al.  An online generalized eigenvalue version of Laplacian Eigenmaps for visual big data , 2016 .

[11]  Kaizhu Huang,et al.  Machine Learning: Modeling Data Locally and Globally , 2008 .

[12]  Adnan Amin,et al.  Churn Prediction in Telecommunication Industry Using Rough Set Approach , 2015, New Trends in Computational Collective Intelligence.

[13]  Zoran Stajic,et al.  A methodology for training set instance selection using mutual information in time series prediction , 2014, Neurocomputing.

[14]  Hung Son Nguyen,et al.  Analysis of STULONG Data by Rough Set Exploration System (RSES) , 2003 .

[15]  Lian Yan,et al.  Predicting customer behavior in telecommunications , 2004, IEEE Intelligent Systems.

[16]  Dirk Van den Poel,et al.  Customer attrition analysis for financial services using proportional hazard models , 2004, Eur. J. Oper. Res..

[17]  Konstantinos I. Diamantaras,et al.  A comparison of machine learning techniques for customer churn prediction , 2015, Simul. Model. Pract. Theory.

[18]  Eric Johnson,et al.  Predicting subscriber dissatisfaction and improving retention in the wireless telecommunications industry , 2000, IEEE Trans. Neural Networks Learn. Syst..

[19]  Setak Mostafa,et al.  A Neuro-Fuzzy Classifier for Customer Churn Prediction , 2011 .

[20]  T. Y. Lin,et al.  Rough Sets and Data Mining , 1997, Springer US.

[21]  Girish Keshav Palshikar,et al.  Employee churn prediction , 2011, Expert Syst. Appl..

[22]  Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[23]  Amir Hussain,et al.  An online generalized eigenvalue version of Laplacian Eigenmaps for visual big data , 2016, Neurocomputing.

[24]  P.A. Crossley,et al.  Application of Genetic Algorithm and Rough Set Theory for Knowledge Extraction , 2007, 2007 IEEE Lausanne Power Tech.

[25]  Idan Szpektor,et al.  Churn prediction in new users of Yahoo! answers , 2012, WWW.

[26]  Baoxu Liu,et al.  Attack Detection by Rough Set Theory in Recommendation System , 2010, 2010 IEEE International Conference on Granular Computing.

[27]  Adnan Amin,et al.  Customer Churn Prediction in Telecommunication Industry: With and without Counter-Example , 2014, 2014 European Network Intelligence Conference.

[28]  Zdzislaw Pawlak,et al.  Rough Sets, Rough Relations and Rough Functions , 1996, Fundam. Informaticae.

[29]  Jan G. Bazan,et al.  Rough set algorithms in classification problem , 2000 .

[30]  Nick Bontis,et al.  Voluntary turnover: knowledge management – friend or foe? , 2002 .

[31]  David C. Yen,et al.  Applying data mining to telecom churn management , 2006, Expert Syst. Appl..

[32]  Reza Allahyari Soeini,et al.  Applying Data Mining to Insurance Customer Churn Management , 2012 .

[33]  Chih-Ping Wei,et al.  Turning telecommunications call details to churn prediction: a data mining approach , 2002, Expert Syst. Appl..

[34]  Li Hong,et al.  Predicting Customer Churn in Mobile Telephony Industry Using Probabilistic Classifiers in Data Mining , 2013 .

[35]  Marcin S. Szczuka,et al.  The Rough Set Exploration System , 2005, Trans. Rough Sets.

[36]  Sougata Mukherjea,et al.  Social ties and their relevance to churn in mobile telecom networks , 2008, EDBT '08.

[37]  Nandita Sengupta,et al.  Comparison of Different Rule Calculation Method for Rough Set Theory , 2012 .

[38]  Ian H. Witten,et al.  WEKA: a machine learning workbench , 1994, Proceedings of ANZIIS '94 - Australian New Zealnd Intelligent Information Systems Conference.

[39]  Amir Hussain,et al.  Multilayered Echo State Machine: A Novel Architecture and Algorithm , 2017, IEEE Transactions on Cybernetics.

[40]  Siti Norul Huda Sheikh Abdullah,et al.  A Comparison of Exhaustive, Heuristic and Genetic Algorithm for Travelling Salesman Problem in PROLOG , 2012 .

[41]  Jerzy W. Grzymala-Busse,et al.  A New Version of the Rule Induction System LERS , 1997, Fundam. Informaticae.

[42]  Vadlamani Ravi,et al.  Churn prediction using comprehensible support vector machine: An analytical CRM application , 2014, Appl. Soft Comput..

[43]  Chin-Laung Lei,et al.  Network game design: hints and implications of player interaction , 2006, NetGames '06.

[44]  Dirk Van den Poel,et al.  Handling class imbalance in customer churn prediction , 2009, Expert Syst. Appl..

[45]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs: A Social Influence Based Approach , 2009, 2009 International Conference on Computational Science and Engineering.

[46]  Susan M. Keaveney,et al.  Customer Switching Behavior in Service Industries: An Exploratory Study , 1995 .

[47]  David C. Yen,et al.  Data mining techniques for customer relationship management , 2002 .

[48]  Gavril Toderean,et al.  CHURN PREDICTION IN THE TELECOMMUNICATIONS SECTOR USING SUPPORT VECTOR MACHINES , 2013 .

[49]  U. Devi Prasad,et al.  Prediction of Churn Behaviour of Bank Customers Using Data Mining Tools , 2012 .

[50]  Ali Mustafa Qamar,et al.  Telecommunication subscribers' churn prediction model using machine learning , 2013, Eighth International Conference on Digital Information Management (ICDIM 2013).

[51]  Jon M. Kleinberg,et al.  Group formation in large social networks: membership, growth, and evolution , 2006, KDD '06.

[52]  Maja Matijasevic,et al.  MMORPG player behavior model based on player action categories , 2011, 2011 10th Annual Workshop on Network and Systems Support for Games.

[53]  Bart Baesens,et al.  Social network analysis for customer churn prediction , 2014, Appl. Soft Comput..

[54]  Neil J. Hurley,et al.  ChurnVis: Visualizing mobile telecommunications churn on a social network with attributes , 2013, 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013).

[55]  이건창,et al.  신용카드 시장에서 데이터 마이닝을 이용한 이탈고객 분석 ( An Artificial Intelligence-based Data Mining Approach to Extracting Strategies for reducing the Churning Rate in Credit Card Industry ) , 2002 .

[56]  Gwo-Hshiung Tzeng,et al.  Combined rough set theory and flow network graph to predict customer churn in credit card accounts , 2011, Expert Syst. Appl..

[57]  Jürg Nievergelt,et al.  Exhaustive Search, Combinatorial Optimization and Enumeration: Exploring the Potential of Raw Computing Power , 2000, SOFSEM.

[58]  Shuqin Cai,et al.  A Hybrid Churn Prediction Model in Mobile Telecommunication Industry , 2014 .

[59]  Dirk Van den Poel,et al.  CRM at a pay-TV company: Using analytical models to reduce customer attrition by targeted marketing for subscription services , 2007, Expert Syst. Appl..

[60]  Bart Baesens,et al.  Building comprehensible customer churn prediction models with advanced rule induction techniques , 2011, Expert Syst. Appl..

[61]  Ekrem Duman,et al.  A profit-driven Artificial Neural Network (ANN) with applications to fraud detection and direct marketing , 2016, Neurocomputing.

[62]  K. Ruyter,et al.  Investigating drivers of bank loyalty: the complex relationship between image, service quality and satisfaction , 1998 .

[63]  Blaz Zupan,et al.  Predictive data mining in clinical medicine: Current issues and guidelines , 2008, Int. J. Medical Informatics.

[64]  Ashutosh Tiwari,et al.  Computer assisted customer churn management: State-of-the-art and future trends , 2007, Comput. Oper. Res..

[65]  Xin Yao,et al.  A novel evolutionary data mining algorithm with applications to churn prediction , 2003, IEEE Trans. Evol. Comput..

[66]  Bart Baesens,et al.  Mining software repositories for comprehensible software fault prediction models , 2008, J. Syst. Softw..

[67]  Balaji Padmanabhan,et al.  From information to operations: Service quality and customer retention , 2011, TMIS.

[68]  Yoshinobu Hotta,et al.  Sparse learning for support vector classification , 2010, Pattern Recognit. Lett..

[69]  Mona Nasr,et al.  A Proposed Churn Prediction Model , 2012 .

[70]  Jakub Wróblewski,et al.  Genetic Algorithms in Decomposition and Classification Problems , 1998 .

[71]  Rahul J. Jadhav,et al.  Churn Prediction in Telecommunication Using Data Mining Technology , 2011 .

[72]  John Hadden,et al.  A Customer Profiling Methodology for Churn Prediction , 2008 .

[73]  Kristof Coussement,et al.  Faculteit Economie En Bedrijfskunde Hoveniersberg 24 B-9000 Gent Churn Prediction in Subscription Services: an Application of Support Vector Machines While Comparing Two Parameter-selection Techniques Churn Prediction in Subscription Services: an Application of Support Vector Machines While Comparin , 2022 .

[74]  Jerzy W. Grzymala-Busse,et al.  LERS-A System for Learning from Examples Based on Rough Sets , 1992, Intelligent Decision Support.

[75]  Nha Nguyen,et al.  The mediating role of corporate image on customers’ retention decisions: an investigation in financial services , 1998 .