Learning social representations with deep autoencoder for recommender system

With the development of online social media, it attracts increasingly attentions to utilize social information for recommender systems. Based on the intuition that users are influenced by their social friends, these methods are capable of addressing the data sparse problem and improving the performance of recommender systems. However, these methods model the influences between each pair of users independently and ignore the interactions among these social influences, i.e., high-level signal of social information. In this paper, we propose a deep autoencoder model to learn social representations for recommender system. This approach aims to learn low- and high- level features from social information based on muti-layers neural networks and matrix factorization technique. Especially, we develop an improved deep autoencoder model, named Sparse Stacked Denoising Autoencoder (SSDAE), to address the data sparse and imbalance problems for social networks. Moreover, we incorporate these deep representations and matrix factorization model into a uniform framework for recommender system. Our experiments in Epinions and Ciao datasets demonstrate that our method can significantly improve the performance of recommender system, especially for sparse users.

[1]  Fazhi He,et al.  Using shapes correlation for active contour segmentation of uterine fibroid ultrasound images in computer-aided therapy , 2016 .

[2]  Yiteng Pan,et al.  A novel segmentation model for medical images with intensity inhomogeneity based on adaptive perturbation , 2018, Multimedia Tools and Applications.

[3]  Yilin Chen,et al.  A new haze removal approach for sky/river alike scenes based on external and internal clues , 2019, Multimedia Tools and Applications.

[4]  Zhendong Niu,et al.  A hybrid recommender system for e-learning based on context awareness and sequential pattern mining , 2017, Soft Computing.

[5]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[6]  Haiyi Zhu,et al.  Effectiveness of Conflict Management Strategies in Peer Review Process of Online Collaboration Projects , 2016, CSCW.

[7]  Michael R. Lyu,et al.  Learning to recommend with social trust ensemble , 2009, SIGIR.

[8]  Tong Zhao,et al.  Leveraging Social Connections to Improve Personalized Ranking for Collaborative Filtering , 2014, CIKM.

[9]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[10]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[11]  Fazhi He,et al.  Service-Oriented Feature-Based Data Exchange for Cloud-Based Design and Manufacturing , 2018, IEEE Transactions on Services Computing.

[12]  Hwanjo Yu,et al.  Improving top-K recommendation with truster and trustee relationship in user trust network , 2016, Inf. Sci..

[13]  Yanchun Zhang,et al.  Modeling dual role preferences for trust-aware recommendation , 2014, SIGIR.

[14]  Fazhi He,et al.  An efficient and robust bat algorithm with fusion of opposition-based learning and whale optimization algorithm , 2020, Intell. Data Anal..

[15]  Peng Zhang,et al.  Hybrid recommendation model based on incremental collaborative filtering and content-based algorithms , 2017, 2017 IEEE 21st International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[16]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[17]  Yiteng Pan,et al.  A novel region-based active contour model via local patch similarity measure for image segmentation , 2018, Multimedia Tools and Applications.

[18]  Jian Yao,et al.  Joint learning of image detail and transmission map for single image dehazing , 2018, The Visual Computer.

[19]  Lei Li,et al.  Social context-aware trust inference for trust enhancement in social network based recommendations on service providers , 2013, World Wide Web.

[20]  Alex Graves,et al.  DRAW: A Recurrent Neural Network For Image Generation , 2015, ICML.

[21]  Fazhi He,et al.  An Efficient Particle Swarm Optimization for Large-Scale Hardware/Software Co-Design System , 2017, Int. J. Cooperative Inf. Syst..

[22]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[24]  Kang Li,et al.  Robust Visual Tracking Based on Convolutional Features with Illumination and Occlusion Handing , 2018, Journal of Computer Science and Technology.

[25]  Yi Zhou,et al.  Parallel ant colony optimization on multi-core SIMD CPUs , 2018, Future Gener. Comput. Syst..

[26]  Yi Zhou,et al.  An efficient GPU-based parallel tabu search algorithm for hardware/software co-design , 2020, Frontiers of Computer Science.

[27]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[28]  Florian Strub,et al.  Hybrid Recommender System based on Autoencoders , 2018 .

[29]  Xiao Chen,et al.  A parallel and robust object tracking approach synthesizing adaptive Bayesian learning and improved incremental subspace learning , 2019, Frontiers of Computer Science.

[30]  Jia-shi Yong,et al.  A Novel Bat Algorithm based on Cross Boundary Learning and Uniform Explosion Strategy , 2019 .

[31]  Yiteng Pan,et al.  A novel Enhanced Collaborative Autoencoder with knowledge distillation for top-N recommender systems , 2019, Neurocomputing.

[32]  Neil Yorke-Smith,et al.  TrustSVD: Collaborative Filtering with Both the Explicit and Implicit Influence of User Trust and of Item Ratings , 2015, AAAI.

[33]  Jiming Liu,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Social Collaborative Filtering by Trust , 2022 .

[34]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[35]  Dit-Yan Yeung,et al.  Relational Stacked Denoising Autoencoder for Tag Recommendation , 2015, AAAI.

[36]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Fazhi He,et al.  A dividing-based many-objective evolutionary algorithm for large-scale feature selection , 2019, Soft Computing.

[39]  Yann LeCun,et al.  Very Deep Convolutional Networks for Natural Language Processing , 2016, ArXiv.

[40]  Donghyun Kim,et al.  Convolutional Matrix Factorization for Document Context-Aware Recommendation , 2016, RecSys.

[41]  Ling Chen,et al.  Spatial-Aware Hierarchical Collaborative Deep Learning for POI Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[42]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[43]  Lynda L. McGhie,et al.  World Wide Web , 2011, Encyclopedia of Information Assurance.

[44]  Huan Liu,et al.  eTrust: understanding trust evolution in an online world , 2012, KDD.

[45]  Yiteng Pan,et al.  A correlative denoising autoencoder to model social influence for top-N recommender system , 2019, Frontiers of Computer Science.

[46]  Weitong Chen,et al.  Learning Graph-based POI Embedding for Location-based Recommendation , 2016, CIKM.

[47]  Xiao Chen,et al.  A matting method based on full feature coverage , 2018, Multimedia Tools and Applications.

[48]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[49]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[50]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[51]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[52]  Zhaohui Wu,et al.  On Deep Learning for Trust-Aware Recommendations in Social Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[53]  Yiteng Pan,et al.  Learning adaptive trust strength with user roles of truster and trustee for trust-aware recommender systems , 2019, Applied Intelligence.

[54]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[55]  Dong Liu,et al.  Comparative Deep Learning of Hybrid Representations for Image Recommendations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Yi Zhou,et al.  Dynamic strategy based parallel ant colony optimization on GPUs for TSPs , 2017, Science China Information Sciences.

[57]  Fazhi He,et al.  IBEA-SVM: An Indicator-based Evolutionary Algorithm Based on Pre-selection with Classification Guided by SVM , 2019, Applied Mathematics-A Journal of Chinese Universities.

[58]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[59]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[60]  Yang Wang,et al.  SPTF: A Scalable Probabilistic Tensor Factorization Model for Semantic-Aware Behavior Prediction , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[61]  Eriko Nurvitadhi,et al.  Accelerating recurrent neural networks in analytics servers: Comparison of FPGA, CPU, GPU, and ASIC , 2016, 2016 26th International Conference on Field Programmable Logic and Applications (FPL).

[62]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[63]  Xiaodong He,et al.  A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems , 2015, WWW.

[64]  Juan-Zi Li,et al.  Typicality-Based Collaborative Filtering Recommendation , 2014, IEEE Transactions on Knowledge and Data Engineering.

[65]  Chengqi Zhang,et al.  Noisy but non-malicious user detection in social recommender systems , 2012, World Wide Web.

[66]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[67]  Pingyu Jiang,et al.  A deep learning approach for relationship extraction from interaction context in social manufacturing paradigm , 2016, Knowl. Based Syst..

[68]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[69]  Michael R. Lyu,et al.  SoRec: social recommendation using probabilistic matrix factorization , 2008, CIKM '08.

[70]  Shazia Wasim Sadiq,et al.  Discovering interpretable geo-social communities for user behavior prediction , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[71]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[72]  Navdeep Jaitly,et al.  Pointer Networks , 2015, NIPS.

[73]  Liang Xu,et al.  Multisource surveillance video data coding with hierarchical knowledge library , 2018, Multimedia Tools and Applications.

[74]  Navdeep Jaitly,et al.  Adversarial Autoencoders , 2015, ArXiv.

[75]  Michael R. Lyu,et al.  Improving Recommender Systems by Incorporating Social Contextual Information , 2011, TOIS.

[76]  Mingxin Gan,et al.  COUSIN: A network-based regression model for personalized recommendations , 2016, Decis. Support Syst..