A Feature Interaction Network for Customer Churn Prediction

Customer churn prediction is an active research topic for the data mining community and business managers in this rapidly growing society. The ability to detect churn customers precisely is something that every company would wish to achieve. With the great success of DNNs, several churn prediction models based on DNNs are proposed in recent years. However, traditional DNNs cannot learn high-order feature interactions and deal with one-hot vectors well. In this paper, we proposed a feature interaction network (FIN), which aims to enhance the inherent relations of discrete features and learn high-order feature interactions. This network contains two modules: an entity embedding network and a factorization machine network with several sliding windows. From the experiments, it is observed that our proposed model has a better predictive performance than several state-of-the-art models on 4 public datasets.

[1]  Xing Xie,et al.  xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems , 2018, KDD.

[2]  Bart Baesens,et al.  A comparative study of social network classifiers for predicting churn in the telecommunication industry , 2016, 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[3]  Gavril Toderean,et al.  CHURN PREDICTION IN THE TELECOMMUNICATIONS SECTOR USING SUPPORT VECTOR MACHINES , 2013 .

[4]  Nicolas Le Roux,et al.  A latent factor model for highly multi-relational data , 2012, NIPS.

[5]  MartensDavid,et al.  Including high-cardinality attributes in predictive models , 2015 .

[6]  Kaizhu Huang,et al.  Customer churn prediction in the telecommunication sector using a rough set approach , 2017, Neurocomputing.

[7]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[8]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[9]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[10]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[11]  Jose Berengueres,et al.  Airline new customer tier level forecasting for real-time resource allocation of a miles program , 2013, Journal Of Big Data.

[12]  Andrew Marshall,et al.  Assessing the impact of derived behavior information on customer attrition in the financial service industry , 2014, Eur. J. Oper. Res..

[13]  Arno De Caigny,et al.  A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees , 2018, Eur. J. Oper. Res..

[14]  Amin Babazadeh Sangar,et al.  A Model for Increasing Usability of Mobile Banking Apps on Smart Phones , 2015 .

[15]  JapkowiczNathalie,et al.  The class imbalance problem: A systematic study , 2002 .

[16]  Bart Baesens,et al.  Social network analysis for customer churn prediction , 2014, Appl. Soft Comput..

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  David Martens,et al.  Including high-cardinality attributes in predictive models: A case study in churn prediction in the energy sector , 2015, Decis. Support Syst..

[19]  Jia Shi,et al.  Particle classification optimization-based BP network for telecommunication customer churn prediction , 2018, Neural Computing and Applications.

[20]  Xin Wang,et al.  Compressed knowledge transfer via factorization machine for heterogeneous collaborative recommendation , 2015, Knowl. Based Syst..

[21]  Bart Baesens,et al.  Social network analytics for churn prediction in telco: Model building, evaluation and network architecture , 2017, Expert Syst. Appl..

[22]  T. Stijnen,et al.  Review: a gentle introduction to imputation of missing values. , 2006, Journal of clinical epidemiology.

[23]  Monique Snoeck,et al.  Profit maximizing logistic model for customer churn prediction using genetic algorithms , 2017, Swarm Evol. Comput..

[24]  Christian Bauckhage,et al.  Predicting player churn in the wild , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[25]  Maja Matijasevic,et al.  MMORPG player behavior model based on player action categories , 2011, 2011 10th Annual Workshop on Network and Systems Support for Games.

[26]  Ge Xiurun,et al.  An improved PSO-based ANN with simulated annealing technique , 2005, Neurocomputing.

[27]  Cheng Guo,et al.  Entity Embeddings of Categorical Variables , 2016, ArXiv.

[28]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[29]  K. Chitra,et al.  Customer Retention in Banking Sector using Predictive Data Mining Technique , 2011 .

[30]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[31]  Lukás Burget,et al.  Empirical Evaluation and Combination of Advanced Language Modeling Techniques , 2011, INTERSPEECH.

[32]  Jonathan Loo,et al.  Customer churn prediction in telecommunication industry using data certainty , 2019, Journal of Business Research.

[33]  Jiawei Han,et al.  I Know You'll Be Back: Interpretable New User Clustering and Churn Prediction on a Mobile Social Application , 2018, KDD.