Analysing exposure diversity in collaborative recommender systems—Entropy fusion approach

Abstract Recommender Systems are considered as essential business tools to leverage the potential growth of on-line services. Neighbourhood based collaborative filtering, a successful recommendation approach has mainly focused on improving accuracy of predictions. From user point of view, it is more valuable to obtain novel and diverse recommendations rather than monotonic preferences. Ratings given by a user for different categories of items are considered as a tool to access user exposure diversity which signifies his creative and divergent thinking. On the other hand, pair of items is concordant if highly correlated users agree in rating the items. Based on the user exposure diversity and item concordance, the neighbourhood selection process of item based collaborative recommender systems is refined. Rating predictions are made based on the newly selected neighbours. The performance of the proposed approach is investigated for accuracy and diversity of predictions on Movielens data sets. The results demonstrate that the proposed approach outperforms the state of the art recommendation approaches which address accuracy–diversity trade off. Statistical analysis is done to prove the efficiency of the proposed approach.

[1]  R. Gray Entropy and Information Theory , 1990, Springer New York.

[2]  Saul Vargas,et al.  Novelty and diversity enhancement and evaluation in recommender systems and information retrieval , 2014, SIGIR.

[3]  Rui Jiang,et al.  ROUND: Walking on an object-user heterogeneous network for personalized recommendations , 2015, Expert Syst. Appl..

[4]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.

[5]  Yong Deng,et al.  A New Belief Entropy to Measure Uncertainty of Basic Probability Assignments Based on Belief Function and Plausibility Function , 2018, Entropy.

[6]  Yong Deng,et al.  Toward uncertainty of weighted networks: An entropy-based model , 2018, Physica A: Statistical Mechanics and its Applications.

[7]  Pei-Chann Chang,et al.  Applying artificial immune systems to collaborative filtering for movie recommendation , 2015, Adv. Eng. Informatics.

[8]  Mahdi Jalili,et al.  A probabilistic model to resolve diversity–accuracy challenge of recommendation systems , 2015, Knowledge and Information Systems.

[9]  John Riedl,et al.  Collaborative Filtering Recommender Systems , 2011, Found. Trends Hum. Comput. Interact..

[10]  Mingxin Gan,et al.  COUSIN: A network-based regression model for personalized recommendations , 2016, Decis. Support Syst..

[11]  Hong Yan,et al.  Recommender systems based on social networks , 2015, J. Syst. Softw..

[12]  Lucia D'Acunto,et al.  Exposure diversity as a design principle for recommender systems , 2018 .

[13]  Jun Wang,et al.  Workshop on novelty and diversity in recommender systems - DiveRS 2011 , 2011, RecSys '11.

[14]  Wei Deng,et al.  Entropic methodology for entanglement measures , 2018, Physica A: Statistical Mechanics and its Applications.

[15]  Gediminas Adomavicius,et al.  Maximizing Aggregate Recommendation Diversity: A Graph-Theoretic Approach , 2011, RecSys 2011.

[16]  Javier Parapar,et al.  Finding and analysing good neighbourhoods to improve collaborative filtering , 2018, Knowl. Based Syst..

[17]  Mehrbakhsh Nilashi,et al.  A multi-criteria collaborative filtering recommender system for the tourism domain using Expectation Maximization (EM) and PCA-ANFIS , 2015, Electron. Commer. Res. Appl..

[18]  John Riedl,et al.  An Algorithmic Framework for Performing Collaborative Filtering , 1999, SIGIR Forum.

[19]  Franca Garzotto,et al.  Content-Based Video Recommendation System Based on Stylistic Visual Features , 2016, Journal on Data Semantics.

[20]  Fabian Lecron,et al.  Weighting strategies for a recommender system using item clustering based on genres , 2017, Expert Syst. Appl..

[21]  Parham Moradi,et al.  A trust-aware recommendation method based on Pareto dominance and confidence concepts , 2017, Knowl. Based Syst..

[22]  Saul Vargas,et al.  Rank and relevance in novelty and diversity metrics for recommender systems , 2011, RecSys '11.

[23]  Tevfik Aytekin,et al.  Clustering-based diversity improvement in top-N recommendation , 2013, Journal of Intelligent Information Systems.

[24]  Wlodzislaw Duch,et al.  Comparison of Shannon, Renyi and Tsallis Entropy Used in Decision Trees , 2006, ICAISC.

[25]  Guangquan Zhang,et al.  A fuzzy tree matching-based personalised e-learning recommender system , 2015, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[26]  Likang Yin,et al.  An evidential link prediction method and link predictability based on Shannon entropy , 2017 .

[27]  Pu-Tai Yang,et al.  Discovering diverse human behavior from two-dimensional preferences , 2018, Knowl. Based Syst..

[28]  Mohsen Afsharchi,et al.  A social recommendation method based on an adaptive neighbor selection mechanism , 2017, Inf. Process. Manag..

[29]  Yong Deng,et al.  Identifying influential nodes in complex networks: A node information dimension approach. , 2018, Chaos.

[30]  Rahul Katarya,et al.  Recent developments in affective recommender systems , 2016 .

[31]  Sangwon Lee,et al.  Item-network-based collaborative filtering: A personalized recommendation method based on a user's item network , 2017, Inf. Process. Manag..

[32]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[33]  Yong Deng,et al.  Generalized Ordered Propositions Fusion Based on Belief Entropy , 2018, Int. J. Comput. Commun. Control.

[34]  Yong Deng,et al.  Generating Z‐number based on OWA weights using maximum entropy , 2018, Int. J. Intell. Syst..

[35]  Daniel Dajun Zeng,et al.  A framework for diversifying recommendation lists by user interest expansion , 2016, Knowl. Based Syst..

[36]  A. Magurran,et al.  Measuring Biological Diversity , 2004 .

[37]  Xiao Ma,et al.  An exploration of improving prediction accuracy by constructing a multi-type clustering based recommendation framework , 2016, Neurocomputing.

[38]  Maria Soledad Pera,et al.  A group recommender for movies based on content similarity and popularity , 2013, Inf. Process. Manag..

[39]  Roi Blanco,et al.  An in-depth study on diversity evaluation: The importance of intrinsic diversity , 2017, Inf. Process. Manag..

[40]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[41]  Kostas Stefanidis,et al.  On Achieving Diversity in Recommender Systems , 2017, ExploreDB@SIGMOD/PODS.

[42]  Elena Shakirova,et al.  Collaborative filtering for music recommender system , 2017, 2017 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus).

[43]  Zoltán Botta-Dukát,et al.  Rao's quadratic entropy as a measure of functional diversity based on multiple traits , 2005 .

[44]  Erik Brynjolfsson,et al.  Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product Sales , 2011, Manag. Sci..

[45]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[46]  Michael J. Pazzani,et al.  A Framework for Collaborative, Content-Based and Demographic Filtering , 1999, Artificial Intelligence Review.

[47]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[48]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[49]  Wei Wang,et al.  Member contribution-based group recommender system , 2016, Decis. Support Syst..

[50]  Qiang Guo,et al.  Ceiling effect of online user interests for the movies , 2014 .

[51]  Rashid Ali,et al.  Product Recommendation Techniques for Ecommerce - past, present and future , 2012 .

[52]  Michael J. Pazzani,et al.  Syskill & Webert: Identifying Interesting Web Sites , 1996, AAAI/IAAI, Vol. 1.

[53]  Craig MacDonald,et al.  Search Result Diversification , 2015, Found. Trends Inf. Retr..

[54]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[55]  F. O. Isinkaye,et al.  Recommendation systems: Principles, methods and evaluation , 2015 .

[56]  Shie-Jue Lee,et al.  A clustering based approach to improving the efficiency of collaborative filtering recommendation , 2016, Electron. Commer. Res. Appl..

[57]  Peter Knees,et al.  New Paths in Music Recommender Systems Research , 2017, RecSys.

[58]  Neil J. Hurley,et al.  Novelty and Diversity in Top-N Recommendation -- Analysis and Evaluation , 2011, TOIT.

[59]  Xueqi Cheng,et al.  Learning for search result diversification , 2014, SIGIR.

[60]  Licia Capra,et al.  Temporal diversity in recommender systems , 2010, SIGIR.

[61]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[62]  Jade Goldstein-Stewart,et al.  The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries , 1998, SIGIR Forum.

[63]  Rui Jiang,et al.  Trinity: Walking on a User-Object-Tag Heterogeneous Network for Personalised Recommendations , 2016, Journal of Computer Science and Technology.

[64]  Giuseppe M. L. Sarnè,et al.  A multi-agent recommender system for supporting device adaptivity in e-Commerce , 2011, Journal of Intelligent Information Systems.

[65]  Rui Jiang,et al.  Improving accuracy and diversity of personalized recommendation through power law adjustments of user similarities , 2013, Decis. Support Syst..

[66]  L. Jost Entropy and diversity , 2006 .

[67]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[68]  Mouzhi Ge,et al.  Placing High-Diversity Items in Top-N Recommendation Lists , 2011, ITWP@IJCAI.

[69]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[70]  Matevz Kunaver,et al.  Diversity in recommender systems - A survey , 2017, Knowl. Based Syst..

[71]  Jongwuk Lee,et al.  Improving the accuracy of top-N recommendation using a preference model , 2016, Inf. Sci..

[72]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[73]  F. Maxwell Harper,et al.  User perception of differences in recommender algorithms , 2014, RecSys '14.

[74]  Panagiotis Adamopoulos,et al.  On Unexpectedness in Recommender Systems: Or How to Expect the Unexpected , 2011, DiveRS@RecSys.