UBMTR: Unsupervised Boltzmann machine-based time-aware recommendation system

Abstract Visual media, in today’s world, has swept across most forms of day to day communication. In the paradigm of generative modelling, restricted Boltzmann machines (RBMs) are used to solve complex tasks such as feature extraction, neuroimaging, collaborative filtering, radar target cognition, etc. In this paper, we implement an unsupervised Boltzmann machine-based time-aware recommendation system (UBMTR) which detects underlying hidden features in user-movie ratings data in connection with the time at which each rating was made (temporal information). The model takes ratings and time as a dual-input and outputs binary values via the contrastive divergence algorithm which samples from a Monte Carlo Markov Chain. Arguably, there exists a correlation between the content requested and the temporal conditions, which is exactly what our model tries to exploit. There is seldom any work in the field of recommender systems built using Boltzmann machines that incorporate temporal information, which necessitates research in this domain. RBMs are adept at pattern completion to tackle missing values, and can deal with imbalanced datasets and unstructured data by encoding raw data into latent variables. Using RBM, the UBMTR outperforms many earlier made attempts made at recommendation systems done through CF and deep learning or their hybridized models.

[1]  Peng-yu Lu,et al.  Hybrid Recommendation Algorithm for E-Commerce Website , 2015, 2015 8th International Symposium on Computational Intelligence and Design (ISCID).

[2]  Deniz Erdogmus,et al.  Auto-Context Convolutional Neural Network (Auto-Net) for Brain Extraction in Magnetic Resonance Imaging , 2017, IEEE Transactions on Medical Imaging.

[3]  Zhao Du,et al.  Content-Boosted Restricted Boltzmann Machine for Recommendation , 2014, ICANN.

[4]  Ju Ren,et al.  A Survey on End-Edge-Cloud Orchestrated Network Computing Paradigms , 2019, ACM Comput. Surv..

[5]  James She,et al.  Collaborative Variational Autoencoder for Recommender Systems , 2017, KDD.

[6]  Iván Cantador,et al.  Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols , 2013, User Modeling and User-Adapted Interaction.

[7]  Huseyin Polat,et al.  Shilling attacks against recommender systems: a comprehensive survey , 2014, Artificial Intelligence Review.

[8]  Deng Gui-shi,et al.  Hybrid Recommendation Algorithm of Item Cold-start in Collaborative Filtering System , 2008 .

[9]  Preslav Nakov,et al.  A non-IID Framework for Collaborative Filtering with Restricted Boltzmann Machines , 2013, ICML.

[10]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[11]  Juxtaposing inference capabilities of deep neural models over posteroanterior chest radiographs facilitating COVID-19 detection , 2021 .

[12]  Zhang Xiong,et al.  User Occupation Aware Conditional Restricted Boltzmann Machine Based Recommendation , 2016, 2016 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[13]  Neil J. Hurley,et al.  Utility-based neighbourhood formation for efficient and robust collaborative filtering , 2004, EC '04.

[14]  Matthew D. Hoffman,et al.  Variational Autoencoders for Collaborative Filtering , 2018, WWW.

[15]  Satoshi Naoi,et al.  An automated CNN recommendation system for image classification tasks , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[16]  Nadia Magnenat-Thalmann,et al.  Time-aware point-of-interest recommendation , 2013, SIGIR.

[17]  Hongfei Lin,et al.  Convolutional neural networks for expert recommendation in community question answering , 2017, Science China Information Sciences.

[18]  Siddharth Swarup Rautaray,et al.  A Survey Work on Optimization Techniques Utilizing Map Reduce Framework in Hadoop Cluster , 2017 .

[19]  Xing Xie,et al.  Solving the data sparsity problem in destination prediction , 2015, The VLDB Journal.

[20]  Jing Zhang,et al.  A Time-Aware CNN-Based Personalized Recommender System , 2019, Complex..

[21]  Hao Wang,et al.  Location recommendation in location-based social networks using user check-in data , 2013, SIGSPATIAL/GIS.

[22]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[23]  Ahmed Eldawy,et al.  LARS: A Location-Aware Recommender System , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[24]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[25]  Chi-Yin Chow,et al.  TICRec: A Probabilistic Framework to Utilize Temporal Influence Correlations for Time-Aware Location Recommendations , 2016, IEEE Transactions on Services Computing.

[26]  A. V. Prosvetov.  GAN for Recommendation System , 2019 .

[27]  Neil J. Hurley,et al.  An Evaluation of Neighbourhood Formation on the Performance of Collaborative Filtering , 2004, Artificial Intelligence Review.

[28]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[29]  Cecilia Mascolo,et al.  A Random Walk around the City: New Venue Recommendation in Location-Based Social Networks , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[30]  Geoffrey E. Hinton.  Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[31]  Wang Haiyan,et al.  Latent Group Recommendation Based on Dynamic Probabilistic Matrix Factorization Model Integrated with CNN , 2017 .

[32]  Aidong Zhang,et al.  Collaborative restricted Boltzmann machine for social event recommendation , 2016, 2016 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[33]  Dilip Singh Sisodia,et al.  Modeling Side Information in Preference Relation based Restricted Boltzmann Machine for recommender systems , 2019, Inf. Sci..

[34]  Gang Chen,et al.  Personal recommendation using deep recurrent neural networks in NetEase , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[35]  Neil J. Hurley,et al.  Collaborative Filtering - Safe and Sound? , 2003, ISMIS.

[36]  Hongfei Yan,et al.  Learning Graph-based Embedding For Time-Aware Product Recommendation , 2017, CIKM.

[37]  Brian Y. Lim,et al.  RecGAN: recurrent generative adversarial networks for recommendation systems , 2018, RecSys.

[38]  Alexandros Karatzoglou,et al.  Deep Learning for Recommender Systems , 2017, RecSys.

[39]  Fu Jie Huang,et al.  A Tutorial on Energy-Based Learning , 2006 .

[40]  Mahendra Kumar Gourisaria,et al.  Building hybrid recommendation system based on Hadoop framework , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[41]  Zhang Xiong,et al.  Item Category Aware Conditional Restricted Boltzmann Machine Based Recommendation , 2015, ICONIP.

[42]  Ying Zhang,et al.  Collaborative filtering recommendation for MOOC application , 2017, Comput. Appl. Eng. Educ..

[43]  Changsheng Li,et al.  An Efficient Distributed-Computing Framework for Association-Rule-Based Recommendation , 2018, 2018 IEEE International Conference on Web Services (ICWS).

[44]  Manjusha Pandey,et al.  A comprehensive survey and analysis of generative models in machine learning , 2020, Comput. Sci. Rev..