Weightless Neural Network WiSARD Applied to Online Recommender Systems

Recommender systems generally are made to predict user preferences' for items. However, in high dimensional datasets this task demands high computational costs. Taking into account that data distribution changes through time, it is important that online recommender systems have a fast retraining process in order to keep the model updated, delivering accurate predictions. Therefore, we propose a new approach for recommender systems using a weightless neural network, denominated WiSARD. We show that our proposal increases training and prediction processing speed, without decreasing the quality of predictions. First results show that our proposal is 306% faster than the improved regularized singular value decomposition (IRSVD), a well-known state-of-the-art algorithm. Moreover, our proposal still had an improvement of 3.7% regarding the mean absolute error (MAE). We show how to apply the WiSARD algorithm for online recommender systems, its drawbacks, and insights for further research.

[1]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[2]  Edilson de Aguiar,et al.  Visual tracking with VG-RAM Weightless Neural Networks , 2016, Neurocomputing.

[3]  Massimo De Gregorio,et al.  Change Detection with Weightless Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Hyung Jun Ahn,et al.  A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem , 2008, Inf. Sci..

[5]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[6]  Hsinchun Chen,et al.  Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering , 2004, TOIS.

[7]  Kenneth Y. Goldberg,et al.  Eigentaste: A Constant Time Collaborative Filtering Algorithm , 2001, Information Retrieval.

[8]  Wilson Rosa de Oliveira,et al.  Weightless neural models , 1994 .

[9]  I. Aleksander,et al.  WISARD·a radical step forward in image recognition , 1984 .

[10]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[11]  João Gama,et al.  A Weightless Neural Network-Based Approach for Stream Data Clustering , 2012, IDEAL.

[12]  Jonice Oliveira,et al.  Evaluating Binary Encoding Techniques for WiSARD , 2016, 2016 5th Brazilian Conference on Intelligent Systems (BRACIS).

[13]  B. Schwartz.  The Paradox of Choice: Why More Is Less , 2004 .

[14]  Massimo De Gregorio,et al.  Background estimation by weightless neural networks , 2017, Pattern Recognit. Lett..

[15]  Hugo C. C. Carneiro.  Theoretical results on a weightless neural classifier and application to computational linguistics , 2017 .

[16]  Teresa Bernarda Ludermir,et al.  Training a classical weightless neural network in a quantum computer , 2014, ESANN.

[17]  Yi Chang,et al.  Streaming Recommender Systems , 2016, WWW.

[18]  Marcelo Embiruçu,et al.  Fault Detection and Diagnosis in dynamic systems using Weightless Neural Networks , 2017, Expert Syst. Appl..

[19]  Sahibsingh A. Dudani.  The Distance-Weighted k-Nearest-Neighbor Rule , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[21]  David J. Fleet,et al.  Hamming Distance Metric Learning , 2012, NIPS.

[22]  Rosni Abdullah,et al.  Weightless Neural Network Array for Protein Classification , 2004, PDCAT.

[23]  Diego Fernández,et al.  Comparison of collaborative filtering algorithms , 2011, ACM Trans. Web.

[24]  R. J. Hunt,et al.  Percent Agreement, Pearson's Correlation, and Kappa as Measures of Inter-examiner Reliability , 1986, Journal of dental research.

[25]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[26]  João Gama,et al.  Weightless neural networks for open set recognition , 2017, Machine Learning.