Extreme Learning Machine combining matrix factorization for collaborative filtering

Collaborative Filtering (CF) is one of the most popular techniques for information filtering in recommendation systems. Currently, there are many linear and nonlinear regression algorithms for CF. However, to our knowledge, these regression algorithms may not give satisfactory results in some practical applications. In this paper, Extreme Learning Machine (ELM), which is famous with its fast speed and good performance in generalization, is firstly employed to build a nonlinear regression model for CF, namely ELM for CF (ELMCF) algorithm. Then by combining ELM and Weighted Nonnegative Matrix Tri-Factorization (WNMTF), which can alleviate the data sparsity problem of the user-item matrix, a new nonlinear regression model is proposed, namely Extreme Learning Machine Combining Matrix Factorization for Collaborative Filtering (CELMCF) algorithm, to construct regression based CF algorithms and improve the performance of recommendation systems. Experiments are conducted on several benchmark datasets from different application domains. Experimental results show that the proposed CELMCF algorithm outperforms some state-of-the-art regression based CF algorithms (including ELMCF algorithm, Linear Regression for CF (LRCF) algorithm and Memory based CF (MemCF) algorithm) more efficiently with the competitive effectiveness.

[1]  Zoran Obradovic,et al.  Collaborative Filtering Using a Regression-Based Approach , 2003, Knowledge and Information Systems.

[2]  Minglu Li,et al.  A Collaborative Filtering Recommendation Model Using Polynomial Regression Approach , 2009, 2009 Fourth ChinaGrid Annual Conference.

[3]  Xiaoyong Du,et al.  Recommendation algorithm combining the user-based classified regression and the item-based filtering , 2006, ICEC.

[4]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[5]  Wei Chu,et al.  Information Services]: Web-based services , 2022 .

[6]  Patrick Gallinari,et al.  Predicting most rated items in Weekly Recommendation with temporal regression , 2010, CAMRa '10.

[7]  Amnon Shashua,et al.  Ranking with Large Margin Principle: Two Approaches , 2002, NIPS.

[8]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[9]  Sahin Albayrak,et al.  Adapting Ratings in Memory-Based Collaborative Filtering using Linear Regression , 2007, 2007 IEEE International Conference on Information Reuse and Integration.

[10]  Xiaoyuan Su,et al.  Hybrid Collaborative Filtering Algorithms Using a Mixture of Experts , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[11]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[12]  Chris H. Q. Ding,et al.  Collaborative Filtering: Weighted Nonnegative Matrix Factorization Incorporating User and Item Graphs , 2010, SDM.

[13]  Eibe Frank,et al.  Additive Regression Applied to a Large-Scale Collaborative Filtering Problem , 2008, Australasian Conference on Artificial Intelligence.

[14]  Martin Natter,et al.  Collaborative filtering or regression models for Internet recommendation systems? , 2002 .

[15]  Du Xiaoyong,et al.  Recommendation algorithm combining the user-based classified regression and the item-based filtering , 2006 .

[16]  José Ranilla,et al.  Collaborative Tag Recommendation System based on Logistic Regression , 2009, DC@PKDD/ECML.

[17]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[18]  R. Dieng-Kuntz,et al.  A Graph-Based Algorithm for Alignment of OWL Ontologies , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[19]  Tommi S. Jaakkola,et al.  Weighted Low-Rank Approximations , 2003, ICML.

[20]  Wei-Lun Chang,et al.  An Ordinal Regression Model with SVD Hebbian Learning for Collaborative Recommendation , 2014, J. Inf. Sci. Eng..

[21]  Fillia Makedon,et al.  Using singular value decomposition approximation for collaborative filtering , 2005, Seventh IEEE International Conference on E-Commerce Technology (CEC'05).

[22]  Demetris Stathakis,et al.  How many hidden layers and nodes? , 2009 .

[23]  Chris H. Q. Ding,et al.  Orthogonal nonnegative matrix t-factorizations for clustering , 2006, KDD '06.

[24]  Yan Liu,et al.  Collaborative Topic Regression with Social Matrix Factorization for Recommendation Systems , 2012, ICML.

[25]  J. Friedman.  Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[26]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..