IntersectionExplorer, a multi-perspective approach for exploring recommendations

Abstract In this paper, we advent a novel approach to foster exploration of recommendations: IntersectionExplorer, a scalable visualization that interleaves the output of several recommender engines with human-generated data, such as user bookmarks and tags, as a basis to increase exploration and thereby enhance the potential to find relevant items. We evaluated the viability of IntersectionExplorer in the context of conference paper recommendation, through three user studies performed in different settings to understand the usefulness of the tool for diverse audiences and scenarios. We analyzed several dimensions of user experience and other, more objective, measures of performance. Results indicate that users found IntersectionExplorer to be a relatively fast and effortless tool to navigate through conference papers. Objective measures of performance linked to interaction showed that users were not only interested in exploring combinations of machine-produced recommendations with bookmarks of users and tags, but also that this “augmentation” actually resulted in increased likelihood of finding relevant papers in explorations. Overall, the findings suggest the viability of IntersectionExplorer as an effective tool, and indicate that its multi-perspective approach to exploring recommendations has great promise as a way of addressing the complex human-recommender system interaction problem.

[1]  Jie Lu,et al.  A Personalized e-Learning material Recommender System , 2004 .

[2]  Philipp Neuhaus,et al.  Portal of medical data models: information infrastructure for medical research and healthcare , 2016, Database J. Biol. Databases Curation.

[3]  Tobias Höllerer,et al.  Hypothetical Recommendation: A Study of Interactive Profile Manipulation Behavior for Recommender Systems , 2015, FLAIRS.

[4]  Erik Duval,et al.  Visualizing recommendations to support exploration, transparency and controllability , 2013, IUI '13.

[5]  Yvonne Kammerer,et al.  Signpost from the masses: learning effects in an exploratory social tag search browser , 2009, CHI.

[6]  Katrien Verbert,et al.  Agents Vs. Users: Visual Recommendation of Research Talks with Multiple Dimension of Relevance , 2016, TIIS.

[7]  Anselm Spoerri,et al.  InfoCrystal: a visual tool for information retrieval & management , 1993, CIKM '93.

[8]  Michelle X. Zhou,et al.  Who is talking about what: social map-based recommendation for content-centric social websites , 2010, RecSys '10.

[9]  Alfred Kobsa,et al.  Inspectability and control in social recommenders , 2012, RecSys.

[10]  Jürgen Ziegler,et al.  Blended Recommending: Integrating Interactive Information Filtering and Algorithmic Recommender Techniques , 2015, CHI.

[11]  Alejandro Bellogín,et al.  Content-based recommendation in social tagging systems , 2010, RecSys '10.

[12]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[13]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[14]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[15]  John Riedl,et al.  Tagsplanations: explaining recommendations using tags , 2009, IUI.

[16]  Katrien Verbert,et al.  Scalable Exploration of Relevance Prospects to Support Decision Making , 2016, IntRS@RecSys.

[17]  Bart P. Knijnenburg,et al.  Explaining the user experience of recommender systems , 2012, User Modeling and User-Adapted Interaction.

[18]  Judith Masthoff,et al.  A Survey of Explanations in Recommender Systems , 2007, 2007 IEEE 23rd International Conference on Data Engineering Workshop.

[19]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[20]  Heather Lea Moulaison,et al.  Collaborative and Social Tagging Networks , 2008 .

[21]  Claudia López,et al.  Linking information and people in a social system for academic conferences , 2017, New Rev. Hypermedia Multim..

[22]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[23]  Denis Parra,et al.  Moodplay: Interactive Mood-based Music Discovery and Recommendation , 2016, UMAP.

[24]  Bart P. Knijnenburg,et al.  Each to his own: how different users call for different interaction methods in recommender systems , 2011, RecSys '11.

[25]  I. Barry Crabtree,et al.  Identifying and tracking changing interests , 1998, International Journal on Digital Libraries.

[26]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[27]  Matevz Kunaver,et al.  Diversity in recommender systems - A survey , 2017, Knowl. Based Syst..

[28]  Wil M.P. van der Aalst,et al.  YAWL: yet another workflow language , 2005, Inf. Syst..

[29]  Li Chen,et al.  Personality and Recommendation Diversity , 2017, Emotions and Personality in Personalized Services.

[30]  Peter Brusilovsky.  Personalization in the Context of Relevance-Based Visualization , 2017, ESIDA@IUI.

[31]  J. Venn,et al.  . On the diagrammatic and mechanical representation of propositions and reasonings , 2022 .

[32]  Chih-Hung Liu,et al.  Intelligent agent-based systems for personalized recommendations in Internet commerce , 2002, Expert Syst. Appl..

[33]  Fabio Persia,et al.  A Multimedia Recommender System , 2013, TOIT.

[34]  Tobias Höllerer,et al.  TasteWeights: a visual interactive hybrid recommender system , 2012, RecSys.

[35]  James Bennett,et al.  The Netflix Prize , 2007 .

[36]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[37]  Barry Smyth,et al.  PeerChooser: visual interactive recommendation , 2008, CHI.

[38]  Tae Kyung Kim,et al.  Layer-specific chromatin accessibility landscapes reveal regulatory networks in adult mouse visual cortex , 2017, eLife.

[39]  Katrien Verbert,et al.  Interactive recommender systems: A survey of the state of the art and future research challenges and opportunities , 2016, Expert Syst. Appl..

[40]  Katrien Verbert,et al.  Recommender Systems for Health Informatics: State-of-the-Art and Future Perspectives , 2016, Machine Learning for Health Informatics.

[41]  Tobias Höllerer,et al.  SmallWorlds: Visualizing Social Recommendations , 2010, Comput. Graph. Forum.

[42]  Marti A. Hearst.  TileBars: visualization of term distribution information in full text information access , 1995, CHI '95.

[43]  Katrien Verbert,et al.  The effect of different set-based visualizations on user exploration of recommendations , 2014 .

[44]  Christoph Trattner,et al.  See what you want to see: visual user-driven approach for hybrid recommendation , 2014, IUI.

[45]  Xue Dong Yang,et al.  The Visual Exploration ofWeb Search Results Using HotMap , 2006, Tenth International Conference on Information Visualisation (IV'06).

[46]  Eduardo E. Veas,et al.  Rank As You Go: User-Driven Exploration of Search Results , 2016, IUI.

[47]  Mei C. Chuah,et al.  Dynamic aggregation with circular visual designs , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[48]  F. Maxwell Harper,et al.  Letting Users Choose Recommender Algorithms: An Experimental Study , 2015, RecSys.

[49]  Li Chen,et al.  A user-centric evaluation framework for recommender systems , 2011, RecSys '11.

[50]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[51]  Hanspeter Pfister,et al.  UpSet: Visualization of Intersecting Sets , 2014, IEEE Transactions on Visualization and Computer Graphics.

[52]  Peter Brusilovsky,et al.  User-controllable personalization: A case study with SetFusion , 2015, Int. J. Hum. Comput. Stud..

[53]  Judith Masthoff,et al.  Designing and Evaluating Explanations for Recommender Systems , 2011, Recommender Systems Handbook.

[54]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[55]  Jun Guo,et al.  SFViz: interest-based friends exploration and recommendation in social networks , 2011, VINCI '11.

[56]  Peter Brusilovsky,et al.  Collaborative filtering for social tagging systems: an experiment with CiteULike , 2009, RecSys '09.

[57]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[58]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.