Research on Entropy-based Collaborative Filtering Algorithm

Based on the brief introduction to the user-based and item-based collaborative filtering algorithms, the problems related to the two algorithms are analyzed, and a new entropy-based recommendation algorithm is proposed. Aimed at the drawbacks of traditional similarity measurement methods, we put forward an improved similarity measurement method. The entropy-based collaborative filtering algorithm contributes to solving the cold-start problem and discovering users' hidden interests. Using the practical data obtained from Movielens Website and MAE metrics for accuracy measure, three different collaborative filtering recommendation algorithms are compared through experiments. The results show that the entropy-based algorithm provides better recommendation quality than user-based algorithm and achieves recommendation accuracy comparable to the item-based algorithm. The experimental solution, the advantages of the entropy-based algorithm and future work are discussed in detail.

[1]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[2]  Shi Bing.  An adaptive algorithm for personal recommendation , 2005 .

[3]  Zeng Yan.  Collaborative Filtering Recommendation Based on Content and Item Rating Prediction , 2004 .

[4]  Wang Wei.  Hybrid Partial Entropy and Relative Entropy , 2005 .

[5]  Wang Xia.  Research on application of item-based collaborative filtering in recommender systems , 2007 .

[6]  Yu Li,et al.  Research on personalized recommendations in E-business , 2004 .

[7]  Charu C. Aggarwal,et al.  On the effects of dimensionality reduction on high dimensional similarity search , 2001, PODS.

[8]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[9]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[10]  Hu Nai,et al.  ALGORITHM DESIGN FOR PERSONALIZATION RECOMMENDATION SYSTEMS , 2002 .

[11]  John Riedl,et al.  Analysis of recommendation algorithms for e-commerce , 2000, EC '00.

[12]  Deng Ai,et al.  A Collaborative Filtering Recommendation Algorithm Based on Item Rating Prediction , 2003 .

[13]  David Maxwell Chickering,et al.  Efficient Approximations for the Marginal Likelihood of Bayesian Networks with Hidden Variables , 1997, Machine Learning.

[14]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.