A multi-kernel support tensor machine for classification with multitype multiway data and an application to cross-selling recommendations

Cross-selling is an integral component of customer relationship management. Using relevant information to improve customer response rate is a challenging task in cross-selling recommendations. Incorporating multitype multiway customer behavioral, including related product, similar customer and historical promotion, data into cross-selling models is helpful in improving the classification performance. Customer behavioral data can be represented by multiple high-order tensors. Most existing supervised tensor learning methods cannot directly deal with heterogeneous and sparse multiway data in cross-selling recommendations. In this study, a novel collaborative ensemble learning method, multi-kernel support tensor machine (MK-STM), is proposed for classification in cross-selling recommendations using multitype multiway customer behavioral data. The MK-STM can also perform feature selections from large sparse multitype multiway data. Computational experiments are conducted using two databases. The experimental results show that the MK-STM has better performance than existing ensemble learning, supervised tensor learning and other commonly used recommendation methods for cross-selling recommendations.

[1]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[2]  Zhi-Ping Fan,et al.  Distributed customer behavior prediction using multiplex data: A collaborative MK-SVM approach , 2012, Knowl. Based Syst..

[3]  Wagner A. Kamakura,et al.  Identifying Innovators for the Cross-Selling of New Products , 2001, Manag. Sci..

[4]  Peter D. Hoff,et al.  Hierarchical multilinear models for multiway data , 2010, Comput. Stat. Data Anal..

[5]  Xuelong Li,et al.  Supervised Tensor Learning , 2005, ICDM.

[6]  Xiaowei Yang,et al.  A Linear Support Higher-Order Tensor Machine for Classification , 2013, IEEE Transactions on Image Processing.

[7]  T. Archibald,et al.  Identifying Cross-Selling Opportunities using Lifestyle Segmentation and Survival Analysis , 2007 .

[8]  Fei Wang,et al.  FEMA: flexible evolutionary multi-faceted analysis for dynamic behavioral pattern discovery , 2014, KDD.

[9]  Haiping Lu,et al.  A survey of multilinear subspace learning for tensor data , 2011, Pattern Recognit..

[10]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[11]  Alejandro Bellogín,et al.  A comparative study of heterogeneous item recommendations in social systems , 2013, Inf. Sci..

[12]  Gediminas Adomavicius,et al.  Classification, Ranking, and Top-K Stability of Recommendation Algorithms , 2016, INFORMS J. Comput..

[13]  Johan A. K. Suykens,et al.  A kernel-based framework to tensorial data analysis , 2011, Neural Networks.

[14]  Li Xiu,et al.  Application of data mining techniques in customer relationship management: A literature review and classification , 2009, Expert Syst. Appl..

[15]  Qiang Yang,et al.  General Functional Matrix Factorization Using Gradient Boosting , 2013, ICML.

[16]  Wagner A. Kamakura,et al.  Cross-Selling , 2008 .

[17]  Minghe Sun,et al.  A hierarchical multiple kernel support vector machine for customer churn prediction using longitudinal behavioral data , 2012, Eur. J. Oper. Res..

[18]  Philip S. Yu,et al.  Incremental tensor analysis: Theory and applications , 2008, TKDD.

[19]  Zhi-Hua Zhou,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[20]  Dirk Van den Poel,et al.  Modeling complex longitudinal consumer behavior with Dynamic Bayesian networks: an Acquisition Pattern Analysis application , 2011, Journal of Intelligent Information Systems.

[21]  Dirk Van den Poel,et al.  Predicting home-appliance acquisition sequences: Markov/Markov for Discrimination and survival analysis for modeling sequential information in NPTB models , 2007, Decis. Support Syst..

[22]  Robert Hable,et al.  Consistency of support vector machines using additive kernels for additive models , 2012, Comput. Stat. Data Anal..

[23]  Baohong Sun,et al.  Cross-Selling the Right Product to the Right Customer at the Right Time , 2011 .

[24]  Minghe Sun,et al.  A SVM ensemble learning method using tensor data: An application to cross selling recommendation , 2015, 2015 12th International Conference on Service Systems and Service Management (ICSSSM).

[25]  Kyong Joo Oh,et al.  Facilitating cross-selling in a mobile telecom market to develop customer classification model based on hybrid data mining techniques , 2011, Expert Syst. Appl..

[26]  Xiaowei Yang,et al.  A Low-Rank Approximation-Based Transductive Support Tensor Machine for Semisupervised Classification , 2015, IEEE Transactions on Image Processing.

[27]  Minghe Sun,et al.  Behavior-aware user response modeling in social media: Learning from diverse heterogeneous data , 2015, Eur. J. Oper. Res..

[28]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[29]  Scott A. Neslin,et al.  Next-product-to-buy models for cross-selling applications , 2002 .

[30]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[31]  He Sun,et al.  Choice-Based Recommender Systems: A Unified Approach to Achieving Relevancy and Diversity , 2014, Oper. Res..

[32]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[33]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[34]  Dirk Van den Poel,et al.  Investigating purchasing-sequence patterns for financial services using Markov, MTD and MTDg models , 2006, Eur. J. Oper. Res..

[35]  Le Thi Hoai An,et al.  DC approximation approaches for sparse optimization , 2014, Eur. J. Oper. Res..

[36]  Ayhan Demiriz,et al.  Linear Programming Boosting via Column Generation , 2002, Machine Learning.

[37]  Li Zhang,et al.  Sparse ensembles using weighted combination methods based on linear programming , 2011, Pattern Recognit..

[38]  Stefan Lessmann,et al.  A reference model for customer-centric data mining with support vector machines , 2009, Eur. J. Oper. Res..

[39]  Thomas G. Dietterich.  Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[40]  Serguei Netessine,et al.  Revenue Management Through Dynamic Cross Selling in E-Commerce Retailing , 2006, Oper. Res..

[41]  Joseph Pancras,et al.  Cross-buying in retailing: Drivers and consequences , 2008 .