Information Filtering in Sparse Online Systems: Recommendation via Semi-Local Diffusion

With the rapid growth of the Internet and overwhelming amount of information and choices that people are confronted with, recommender systems have been developed to effectively support users’ decision-making process in the online systems. However, many recommendation algorithms suffer from the data sparsity problem, i.e. the user-object bipartite networks are so sparse that algorithms cannot accurately recommend objects for users. This data sparsity problem makes many well-known recommendation algorithms perform poorly. To solve the problem, we propose a recommendation algorithm based on the semi-local diffusion process on the user-object bipartite network. The simulation results on two sparse datasets, Amazon and Bookcross, show that our method significantly outperforms the state-of-the-art methods especially for those small-degree users. Two personalized semi-local diffusion methods are proposed which further improve the recommendation accuracy. Finally, our work indicates that sparse online systems are essentially different from the dense online systems, so it is necessary to reexamine former algorithms and conclusions based on dense data in sparse systems.

[1]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[2]  Li Chen,et al.  Factorization vs. regularization: fusing heterogeneous social relationships in top-n recommendation , 2011, RecSys '11.

[3]  Martin Ester,et al.  TrustWalker: a random walk model for combining trust-based and item-based recommendation , 2009, KDD.

[4]  Tao Zhou,et al.  An item-oriented recommendation algorithm on cold-start problem , 2011 .

[5]  Bing-Hong Wang,et al.  Accurate and diverse recommendations via eliminating redundant correlations , 2008, 0805.4127.

[6]  Alexander J. Smola,et al.  Like like alike: joint friendship and interest propagation in social networks , 2011, WWW.

[7]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[8]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[9]  Tao Zhou,et al.  CAN DISSIMILAR USERS CONTRIBUTE TO ACCURACY AND DIVERSITY OF PERSONALIZED RECOMMENDATION , 2010 .

[10]  Tao Li,et al.  Recommendation model based on opinion diffusion , 2007, ArXiv.

[11]  Yi-Cheng Zhang,et al.  Heat conduction process on community networks as a recommendation model. , 2007, Physical review letters.

[12]  Alfred Kobsa,et al.  The Adaptive Web, Methods and Strategies of Web Personalization , 2007, The Adaptive Web.

[13]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[14]  An Zeng,et al.  Extracting the Information Backbone in Online System , 2013, PloS one.

[15]  Young Hwan Kim,et al.  Measuring User Similarity Using Electric Circuit Analysis: Application to Collaborative Filtering , 2012, PloS one.

[16]  S. Floyd,et al.  Adaptive Web , 1997 .

[17]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[18]  Yi-Cheng Zhang,et al.  Empirical analysis of web-based user-object bipartite networks , 2009, ArXiv.

[19]  Fuguo Zhang,et al.  Improving information filtering via network manipulation , 2012, ArXiv.

[20]  Giulio Cimini,et al.  Emergence of Scale-Free Leadership Structure in Social Recommender Systems , 2011, PloS one.

[21]  Jun Wang,et al.  Adaptive diversification of recommendation results via latent factor portfolio , 2012, SIGIR '12.

[22]  Yi-Cheng Zhang,et al.  The reinforcing influence of recommendations on global diversification , 2011, 1106.0330.

[23]  Yi-Cheng Zhang,et al.  Solving the apparent diversity-accuracy dilemma of recommender systems , 2008, Proceedings of the National Academy of Sciences.

[24]  Linyuan Lu,et al.  Information filtering via preferential diffusion , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[26]  Yi-Cheng Zhang,et al.  Bipartite network projection and personal recommendation. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[28]  Yicheng Zhang,et al.  Referee networks and their spectral properties , 2005 .

[29]  Tao Zhou,et al.  Relevance is more significant than correlation: Information filtering on sparse data , 2009 .

[30]  Qiang Guo,et al.  Information filtering via biased heat conduction , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  S Maslov,et al.  Extracting hidden information from knowledge networks. , 2001, Physical review letters.