A deep neural network of multi-form alliances for personalized recommendations

Abstract The collaborative filtering adopted by traditional recommendation system has data sparsity problem, and the matrix decomposition method simply decomposes users and items into linear models for potential factors. These limitations have led to limited effectiveness for traditional recommendation algorithms. In this case, the recommendation system based on deep learning has emerged. Most of the current deep learning recommendations use deep neural networks to model some basic information, and in the modeling process, according to the input data categories, multiple mapping paths are used to map the original data to the potential vector space. However, these recommendations ignore that the alliance between different categories may have a potential impact on the recommendation effect. Aiming at this problem, this paper proposes a feedforward deep neural network of multi-form category features combination for recommendation, which is deep alliance neural network. According to the different alliance modes, it can be divided into deep series network (DSN), deep parallel network (DPN) and deep random network (DRN), which are used to solve the recommendation problem of implicit feedback. At the same time, a fusion model SMLP based on deep alliance neural network and traditional Multi-Layer Perceptron (MLP) is proposed to try to explore the performance of the fusion model. Finally, experiments on public datasets show that our proposed method significantly improves the existing methods. Empirical evidence indicates that deep series network and deep parallel network can provide better recommendation performance, while the recommended performance of deep random network and fusion model SMLP is not ideal. This indicates that the deep alliance network needs to pay special attention to the order of the category features in the process of category features association.

[1]  Allan Pinkus,et al.  Approximation theory of the MLP model in neural networks , 1999, Acta Numerica.

[2]  José A. Olivas,et al.  A T1OWA fuzzy linguistic aggregation methodology for searching feature-based opinions , 2020, Knowl. Based Syst..

[3]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[4]  Duen-Ren Liu,et al.  Recommending blog articles based on popular event trend analysis , 2015, Inf. Sci..

[5]  Arindam Banerjee,et al.  Generalized Probabilistic Matrix Factorizations for Collaborative Filtering , 2010, 2010 IEEE International Conference on Data Mining.

[6]  Francesco Romani,et al.  Adaptive nonnegative matrix factorization and measure comparisons for recommender systems , 2019, Appl. Math. Comput..

[7]  Feng Zhou,et al.  EMD2FNN: A strategy combining empirical mode decomposition and factorization machine based neural network for stock market trend prediction , 2019, Expert Syst. Appl..

[8]  Aidong Zhang,et al.  Collaborative restricted Boltzmann machine for social event recommendation , 2016, 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[9]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[10]  Yingyuan Xiao,et al.  A time-sensitive personalized recommendation method based on probabilistic matrix factorization technique , 2018, Soft Comput..

[11]  Mi-Yen Yeh,et al.  A General Framework for Implicit and Explicit Social Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[12]  Feng Xia,et al.  Context-Based Collaborative Filtering for Citation Recommendation , 2015, IEEE Access.

[13]  Gil Alterovitz,et al.  Sparse online collaborative filtering with dynamic regularization , 2019, Inf. Sci..

[14]  Li Chen,et al.  Personalized recommendation with implicit feedback via learning pairwise preferences over item-sets , 2018, Knowledge and Information Systems.

[15]  Yung-Ming Li,et al.  Recommending social network applications via social filtering mechanisms , 2013, Inf. Sci..

[16]  Lei Zheng,et al.  Deep Latent Factor Model with Hierarchical Similarity Measure for recommender systems , 2019, Inf. Sci..

[17]  Jinhui Tang,et al.  Weakly Supervised Deep Matrix Factorization for Social Image Understanding , 2017, IEEE Transactions on Image Processing.

[18]  Caihua Wu,et al.  Deep Learning Based Recommendation: A Survey , 2017, ICISA.

[19]  Fabio Aiolli Convex AUC optimization for top-N recommendation with implicit feedback , 2014, RecSys '14.

[20]  Yulin Cao,et al.  An Improved Neighborhood-Aware Unified Probabilistic Matrix Factorization Recommendation , 2018, Wirel. Pers. Commun..

[21]  Wei Wang,et al.  Recommender system application developments: A survey , 2015, Decis. Support Syst..

[22]  Sangwon Lee,et al.  Item-network-based collaborative filtering: A personalized recommendation method based on a user's item network , 2017, Inf. Process. Manag..

[23]  José Angel Olivas,et al.  Hiperion: A fuzzy approach for recommending educational activities based on the acquisition of competences , 2013, Inf. Sci..

[24]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[25]  Li Bo,et al.  Analysis of the Click through Rate of Chinese Netizens through Social Software based on DeepFM Algorithm , 2019 .

[26]  Danial Hooshyar,et al.  GPS: Factorized group preference-based similarity models for sparse sequential recommendation , 2019, Inf. Sci..

[27]  Biao Wang,et al.  LiftingNet: A Novel Deep Learning Network With Layerwise Feature Learning From Noisy Mechanical Data for Fault Classification , 2018, IEEE Transactions on Industrial Electronics.

[28]  Erik Marchi,et al.  A novel approach for automatic acoustic novelty detection using a denoising autoencoder with bidirectional LSTM neural networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Zhang Yi,et al.  A Novel Deep Learning-Based Collaborative Filtering Model for Recommendation System , 2019, IEEE Transactions on Cybernetics.

[30]  Ling Luo,et al.  Personalized recommendation by matrix co-factorization with tags and time information , 2019, Expert Syst. Appl..

[31]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[32]  Fernando Ortega,et al.  A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model , 2016, Knowl. Based Syst..

[33]  Ricardo Buettner,et al.  Predicting user behavior in electronic markets based on personality-mining in large online social networks , 2017, Electron. Mark..

[34]  Michael Grottke,et al.  Exploiting social media with higher-order Factorization Machines: statistical arbitrage on high-frequency data of the S&P 500 , 2018, Quantitative Finance.

[35]  Zhaolong Ning,et al.  A collective filtering based content transmission scheme in edge of vehicles , 2020, Inf. Sci..

[36]  Chi Ho Yeung,et al.  Do recommender systems benefit users? a modeling approach , 2015, ArXiv.

[37]  Boris Cule,et al.  Collaborative Filtering for Binary, Positiveonly Data , 2017, SKDD.

[38]  Xiangnan He,et al.  A Generic Coordinate Descent Framework for Learning from Implicit Feedback , 2016, WWW.

[39]  Pei-Yun Tsai,et al.  Personalized recommendation of popular blog articles for mobile applications , 2011, Inf. Sci..

[40]  Xue Liu,et al.  Point-of-Interest Recommendation: Exploiting Self-Attentive Autoencoders with Neighbor-Aware Influence , 2018, CIKM.

[41]  Pável Calado,et al.  Improving a hybrid literary book recommendation system through author ranking , 2012, JCDL '12.

[42]  Enrique Herrera-Viedma,et al.  A google wave-based fuzzy recommender system to disseminate information in University Digital Libraries 2.0 , 2011, Inf. Sci..

[43]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.