Deep Learning to Address Candidate Generation and Cold Start Challenges in Recommender Systems: A Research Survey

Among the machine learning applications to business, recommender systems would take one of the top places when it comes to success and adoption. They help the user in accelerating the process of search while helping businesses maximize sales. Post phenomenal success in computer vision and speech recognition, deep learning methods are beginning to get applied to recommender systems. Current survey papers on deep learning in recommender systems provide a historical overview and taxonomy of recommender systems based on type. Our paper addresses the gaps of providing a taxonomy of deep learning approaches to address recommender systems problems in the areas of cold start and candidate generation in recommender systems. We outline different challenges in recommender systems into those related to the recommendations themselves (include relevance, speed, accuracy and scalability), those related to the nature of the data (cold start problem, imbalance and sparsity) and candidate generation. We then provide a taxonomy of deep learning techniques to address these challenges. Deep learning techniques are mapped to the different challenges in recommender systems providing an overview of how deep learning techniques can be used to address them. We contribute a taxonomy of deep learning techniques to address the cold start and candidate generation problems in recommender systems. Cold Start is addressed through additional features (for audio, images, text) and by learning hidden user and item representations. Candidate generation has been addressed by separate networks, RNNs, autoencoders and hybrid methods. We also summarize the advantages and limitations of these techniques while outlining areas for future research.

[1]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[2]  Stathes Hadjiefthymiades,et al.  Facing the cold start problem in recommender systems , 2014, Expert Syst. Appl..

[3]  György Fazekas,et al.  Hybrid music recommender using content-based and social information , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Yu He,et al.  The YouTube video recommendation system , 2010, RecSys '10.

[5]  Nikhil Ketkar,et al.  Introduction to PyTorch , 2021, Deep Learning with Python.

[6]  Jaap Kamps,et al.  The Continuous Cold-start Problem in e-Commerce Recommender Systems , 2015, CBRecSys@RecSys.

[7]  Weidong Xiao,et al.  Deep keyphrase generation with a convolutional sequence to sequence model , 2017, 2017 4th International Conference on Systems and Informatics (ICSAI).

[8]  Bracha Shapira,et al.  Recommender Systems Handbook , 2015, Springer US.

[9]  Harm de Vries,et al.  RMSProp and equilibrated adaptive learning rates for non-convex optimization. , 2015 .

[10]  Paulo S. C. Alencar,et al.  The use of machine learning algorithms in recommender systems: A systematic review , 2015, Expert Syst. Appl..

[11]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[12]  Zheng Zhang,et al.  MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems , 2015, ArXiv.

[13]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[14]  Jennifer Chu-Carroll,et al.  Finding needles in the haystack: Search and candidate generation , 2012, IBM J. Res. Dev..

[15]  Hugues Bersini,et al.  Collaborative Filtering with Recurrent Neural Networks , 2016, ArXiv.

[16]  Anusha Balakrishnan DeepPlaylist : Using Recurrent Neural Networks to Predict Song Similarity , 2016 .

[17]  Bernabe Batchakui,et al.  Deep Learning Methods on Recommender System: A Survey of State-of-the-art , 2017 .

[18]  Xuanjing Huang,et al.  Bidirectional Long Short-Term Memory with Gated Relevance Network for Paraphrase Identification , 2016, NLPCC/ICCPOL.

[19]  Ayush Singhal,et al.  Use of Deep Learning in Modern Recommendation System: A Summary of Recent Works , 2017, ArXiv.

[20]  Xiaonan Li,et al.  Entity-Relationship Queries over Wikipedia , 2012, TIST.

[21]  Xiaojun Wan,et al.  A Neural Network Approach to Quote Recommendation in Writings , 2016, CIKM.

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Ramakrishnan Srikant,et al.  Mining Sequential Patterns: Generalizations and Performance Improvements , 1996, EDBT.

[24]  Benjamin Schrauwen,et al.  Deep content-based music recommendation , 2013, NIPS.

[25]  Matthias Grossglauser,et al.  Collaborative Recurrent Neural Networks for Dynamic Recommender Systems , 2016, ACML.

[26]  Anh Duc Duong,et al.  Addressing cold-start problem in recommendation systems , 2008, ICUIMC '08.

[27]  CARLOS A. GOMEZ-URIBE,et al.  The Netflix Recommender System , 2015, ACM Trans. Manag. Inf. Syst..

[28]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[29]  Jimmy J. Lin,et al.  Fast candidate generation for real-time tweet search with bloom filter chains , 2013, TOIS.

[30]  James She,et al.  Collaborative Variational Autoencoder for Recommender Systems , 2017, KDD.

[31]  Daniel P. W. Ellis,et al.  Content-Aware Collaborative Music Recommendation Using Pre-trained Neural Networks , 2015, ISMIR.