ACNN-FM: A novel recommender with attention-based convolutional neural network and factorization machines

Abstract With the rapid development of the Internet, the data generated from application platforms such as online shopping, e-education, and digital entertainment has exhibited dramatical growth, which has caused serious information overload to Internet users. The traditional recommendation approaches are crucial for Internet users to extract valuable information from various information. However, there exist some problems such as sparse data, cold start, and over-reliance on manual extracted feature and so on. To address the above problems, this paper proposes a novel recommender with Attention-based Convolutional Neural Network and Factorization Machines (ACNN-FM), which achieves the recommendation with comments. Firstly, from the perspective of local to overall, this paper proposes a word-level attention mechanism and a phrase-level attention mechanism to increase the ability to remember the importance and the order of historical vocabulary (phrase) in the process of text processing of convolutional neural networks. Secondly, it constructs a model to automatically extract hidden features of users and items from comments in the form of natural language. Finally, we utilize factorization machines to analyze the association between the hidden features of users and items, and implement the recommendation based on the association. Extensive experiments are conducted for demonstrating that ACNN-FM method outperforms state-of-the-art NARR method, and ACNN-FM has the highest data utilization among NARR, DeepCoNN, BCF and NMF methods, thus the recommendation performance is significantly improved in large-scale data environment.

[1]  MengChu Zhou,et al.  Incorporation of Efficient Second-Order Solvers Into Latent Factor Models for Accurate Prediction of Missing QoS Data , 2018, IEEE Transactions on Cybernetics.

[2]  Shuai Li,et al.  An Efficient Approach to Generating Location-Sensitive Recommendations in Ad-hoc Social Network Environments , 2015, IEEE Transactions on Services Computing.

[3]  Wen Gao,et al.  Cross-media analysis and reasoning: advances and directions , 2017, Frontiers of Information Technology & Electronic Engineering.

[4]  Sergio Escalera,et al.  Beyond One-hot Encoding: lower dimensional target embedding , 2018, Image Vis. Comput..

[5]  Fei Hao,et al.  An on-demand coverage based self-deployment algorithm for big data perception in mobile sensing networks , 2018, Future Gener. Comput. Syst..

[6]  Chao Chen,et al.  Partial Membership Latent Dirichlet Allocation for Soft Image Segmentation , 2017, IEEE Transactions on Image Processing.

[7]  MengChu Zhou,et al.  An Inherently Nonnegative Latent Factor Model for High-Dimensional and Sparse Matrices from Industrial Applications , 2018, IEEE Transactions on Industrial Informatics.

[8]  Wenguan Wang,et al.  Deep Visual Attention Prediction , 2017, IEEE Transactions on Image Processing.

[9]  Fernando Ortega,et al.  A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model , 2016, Knowl. Based Syst..

[10]  MengChu Zhou,et al.  Latent Factor-Based Recommenders Relying on Extended Stochastic Gradient Descent Algorithms , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Albert-László Barabási,et al.  Limits of Predictability in Human Mobility , 2010, Science.

[12]  Shuai Li,et al.  Symmetric and Nonnegative Latent Factor Models for Undirected, High-Dimensional, and Sparse Networks in Industrial Applications , 2017, IEEE Transactions on Industrial Informatics.

[13]  Ling Chen,et al.  A Dynamic Topic Model and Matrix Factorization-Based Travel Recommendation Method Exploiting Ubiquitous Data , 2017, IEEE Transactions on Multimedia.

[14]  Xiaoming Wang,et al.  An efficient probabilistic routing scheme based on game theory in opportunistic networks , 2019, Comput. Networks.

[15]  Erik Brynjolfsson,et al.  Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product Sales , 2011, Manag. Sci..

[16]  John Gantz,et al.  The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East , 2012 .

[17]  Xiangnan He,et al.  Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention , 2017, SIGIR.

[18]  Yiqun Liu,et al.  Neural Attentional Rating Regression with Review-level Explanations , 2018, WWW.

[19]  Victor C. S. Lee,et al.  TaxiRec: Recommending Road Clusters to Taxi Drivers Using Ranking-Based Extreme Learning Machines , 2018, IEEE Trans. Knowl. Data Eng..

[20]  Yongdong Zhang,et al.  GLA: Global–Local Attention for Image Description , 2018, IEEE Transactions on Multimedia.

[21]  Tadahiro Taniguchi,et al.  Visualization of Driving Behavior Based on Hidden Feature Extraction by Using Deep Learning , 2017, IEEE Transactions on Intelligent Transportation Systems.

[22]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[23]  Cong Lin,et al.  Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[24]  MengChu Zhou,et al.  An Effective Scheme for QoS Estimation via Alternating Direction Method-Based Matrix Factorization , 2019, IEEE Transactions on Services Computing.

[25]  Maoguo Gong,et al.  Local Probabilistic Matrix Factorization for Personal Recommendation , 2017, 2017 13th International Conference on Computational Intelligence and Security (CIS).

[26]  Fei Hao,et al.  A location-sensitive over-the-counter medicines recommender based on tensor decomposition , 2018, The Journal of Supercomputing.

[27]  Lei Zheng,et al.  Joint Deep Modeling of Users and Items Using Reviews for Recommendation , 2017, WSDM.

[28]  Bahriye Akay,et al.  Deep learning based recommender systems , 2017, 2017 International Conference on Computer Science and Engineering (UBMK).

[29]  Kai Chen,et al.  Collaborative filtering and deep learning based recommendation system for cold start items , 2017, Expert Syst. Appl..

[30]  Ngoc Thanh Nguyen,et al.  A combination of active learning and self-learning for named entity recognition on Twitter using conditional random fields , 2017, Knowl. Based Syst..

[31]  Anton van den Hengel,et al.  Image-Based Recommendations on Styles and Substitutes , 2015, SIGIR.

[32]  Lantao Yu,et al.  Dynamic Attention Deep Model for Article Recommendation by Learning Human Editors' Demonstration , 2017, KDD.

[33]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[34]  Ling Chen,et al.  Spatial-Aware Hierarchical Collaborative Deep Learning for POI Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[35]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[36]  Witold Pedrycz,et al.  On Distributed Fuzzy Decision Trees for Big Data , 2018, IEEE Transactions on Fuzzy Systems.

[37]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.