Incremental Nonnegative Matrix Factorization Based on Matrix Sketching and k-means Clustering

Along with the information increase on the Internet, there is a pressing need for online and real-time recommendation in commercial applications. This kind of recommendation attains results by combining both users’ historical data and their current behaviors. Traditional recommendation algorithms have high computational complexity and thus their reactions are usually delayed when dealing with large historical data. In this paper, we investigate the essential need of online and real-time processing in modern applications. In particular, to provide users with better online experience, this paper proposes an incremental recommendation algorithm to reduce the computational complexity and reaction time. The proposed algorithm can be considered as an online version of nonnegative matrix factorization. This paper uses matrix sketching and k-means clustering to deal with cold-start users and existing users respectively and experiments show that the proposed algorithm can outperform its competitors.

[1]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[2]  Domonkos Tikk,et al.  Scalable Collaborative Filtering Approaches for Large Recommender Systems , 2009, J. Mach. Learn. Res..

[3]  Matthew Brand,et al.  Fast Online SVD Revisions for Lightweight Recommender Systems , 2003, SDM.

[4]  Huseyin Polat,et al.  A scalable privacy-preserving recommendation scheme via bisecting k-means clustering , 2013, Inf. Process. Manag..

[5]  Robin D. Burke,et al.  Hybrid Web Recommender Systems , 2007, The Adaptive Web.

[6]  Konrad P. Körding,et al.  Science Concierge: A Fast Content-Based Recommendation System for Scientific Publications , 2016, PloS one.

[7]  Angshul Majumdar,et al.  SVD free matrix completion with online bias correction for Recommender systems , 2015, 2015 Eighth International Conference on Advances in Pattern Recognition (ICAPR).

[8]  Edo Liberty,et al.  Simple and deterministic matrix sketching , 2012, KDD.

[9]  Sahin Albayrak,et al.  Real-time recommendations for user-item streams , 2015, SAC.

[10]  Lars Schmidt-Thieme,et al.  Online-updating regularized kernel matrix factorization models for large-scale recommender systems , 2008, RecSys '08.

[11]  Julien Subercaze,et al.  Real-time, scalable, content-based Twitter users recommendation , 2016, Web Intell..

[12]  Hanqing Lu,et al.  Incremental Matrix Factorization via Feature Space Re-learning for Recommender System , 2015, RecSys.

[13]  Hanqing Lu,et al.  Online sketching hashing , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).