Agents Vs. Users: Visual Recommendation of Research Talks with Multiple Dimension of Relevance

Several approaches have been researched to help people deal with abundance of information. An important feature pioneered by social tagging systems and later used in other kinds of social systems is the ability to explore different community relevance prospects by examining items bookmarked by a specific user or items associated by various users with a specific tag. A ranked list of recommended items offered by a specific recommender engine can be considered as another relevance prospect. The problem that we address is that existing personalized social systems do not allow their users to explore and combine multiple relevance prospects. Only one prospect can be explored at any given time—a list of recommended items, a list of items bookmarked by a specific user, or a list of items marked with a specific tag. In this article, we explore the notion of combining multiple relevance prospects as a way to increase effectiveness and trust. We used a visual approach to recommend articles at a conference by explicitly presenting multiple dimensions of relevance. Suggestions offered by different recommendation techniques were embodied as recommender agents to put them on the same ground as users and tags. The results of two user studies performed at academic conferences allowed us to obtain interesting insights to enhance user interfaces of personalized social systems. More specifically, effectiveness and probability of item selection increase when users are able to explore and interrelate prospects of items relevance—that is, items bookmarked by users, recommendations and tags. Nevertheless, a less-technical audience may require guidance to understand the rationale of such intersections.

[1]  Peter Brusilovsky,et al.  Adaptive visualization for exploratory information retrieval , 2013, Inf. Process. Manag..

[2]  John Riedl,et al.  Tagsplanations: explaining recommendations using tags , 2009, IUI.

[3]  Pasquale Lops,et al.  Content-based Recommender Systems: State of the Art and Trends , 2011, Recommender Systems Handbook.

[4]  Robert R. Korfhage,et al.  Visualization of a Document Collection: The VIBE System , 1993, Inf. Process. Manag..

[5]  Alfred Kobsa,et al.  Inspectability and control in social recommenders , 2012, RecSys.

[6]  Robin D. Burke,et al.  Evaluating the dynamic properties of recommendation algorithms , 2010, RecSys '10.

[7]  Peter Brusilovsky,et al.  User-controllable personalization: A case study with SetFusion , 2015, Int. J. Hum. Comput. Stud..

[8]  Judith Masthoff,et al.  Designing and Evaluating Explanations for Recommender Systems , 2011, Recommender Systems Handbook.

[9]  Yvonne Kammerer,et al.  Signpost from the masses: learning effects in an exploratory social tag search browser , 2009, CHI.

[10]  Anselm Spoerri,et al.  InfoCrystal: a visual tool for information retrieval & management , 1993, CIKM '93.

[11]  Tim Dwyer,et al.  Untangling Euler Diagrams , 2010, IEEE Transactions on Visualization and Computer Graphics.

[12]  Alex Endert,et al.  Finding Waldo: Learning about Users from their Interactions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[13]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[14]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[15]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[16]  Steve Benford,et al.  VR‐VIBE: A Virtual Environment for Co‐operative Information Retrieval , 1995, Comput. Graph. Forum.

[17]  Aniket Kittur,et al.  Apolo: making sense of large network data by combining rich user interaction and machine learning , 2011, CHI.

[18]  BrusilovskyPeter,et al.  Agents Vs. Users , 2016 .

[19]  Kirsten Swearingen,et al.  Beyond Algorithms: An HCI Perspective on Recommender Systems , 2001 .

[20]  Tobias Höllerer,et al.  TasteWeights: a visual interactive hybrid recommender system , 2012, RecSys.

[21]  Adelaide V. Finch,et al.  September , 1867, The Hospital.

[22]  Ido Guy,et al.  Personalized recommendation of social software items based on social relations , 2009, RecSys '09.

[23]  Angelo Cangelosi,et al.  ACM Transactions on Interactive Intelligent Systems (TiiS) Special Issue on Trust and Influence in Intelligent Human-Machine Interaction , 2018, ACM Trans. Interact. Intell. Syst..

[24]  Tobias Höllerer,et al.  SmallWorlds: Visualizing Social Recommendations , 2010, Comput. Graph. Forum.

[25]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[26]  Jun Zhang,et al.  A Novel Visualization Model for Web Search Results , 2006, IEEE Transactions on Visualization and Computer Graphics.

[27]  M. Sheelagh T. Carpendale,et al.  Bubble Sets: Revealing Set Relations with Isocontours over Existing Visualizations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[28]  Christoph Trattner,et al.  See what you want to see: visual user-driven approach for hybrid recommendation , 2014, IUI.

[29]  Bamshad Mobasher,et al.  Tag-based resource recommendation in social annotation applications , 2011, UMAP'11.

[30]  Danah Boyd,et al.  Vizster: visualizing online social networks , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[31]  Nava Tintarev,et al.  Explanations of recommendations , 2007, RecSys '07.

[32]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[33]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[34]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.

[35]  Daniel Dajun Zeng,et al.  Collaborative filtering in social tagging systems based on joint item-tag recommendations , 2010, CIKM.

[36]  Jun Ma,et al.  iGraph: a graph-based technique for visual analytics of image and text collections , 2015, Electronic Imaging.

[37]  Peter Brusilovsky,et al.  Collaborative filtering for social tagging systems: an experiment with CiteULike , 2009, RecSys '09.

[38]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[39]  Heather Lea Moulaison,et al.  Collaborative and Social Tagging Networks , 2008 .

[40]  Katrien Verbert,et al.  The effect of different set-based visualizations on user exploration of recommendations , 2014 .

[41]  Bart P. Knijnenburg,et al.  Each to his own: how different users call for different interaction methods in recommender systems , 2011, RecSys '11.

[42]  Mei C. Chuah,et al.  Dynamic aggregation with circular visual designs , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[43]  Dieter Schmalstieg,et al.  Context-Preserving Visual Links , 2011, IEEE Transactions on Visualization and Computer Graphics.

[44]  Sean M. McNee,et al.  Interfaces for Eliciting New User Preferences in Recommender Systems , 2003, User Modeling.

[45]  Matthias Hemmje,et al.  LyberWorld—a visualization user interface supporting fulltext retrieval , 1994, SIGIR '94.

[46]  Xue Dong Yang,et al.  The Visual Exploration ofWeb Search Results Using HotMap , 2006, Tenth International Conference on Information Visualisation (IV'06).

[47]  Claudia López,et al.  Conference Navigator 3: An online social conference support system , 2012, UMAP Workshops.

[48]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[49]  Ricardo Baeza-Yates,et al.  Modern Information Retrieval - the concepts and technology behind search, Second edition , 2011 .

[50]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[51]  William Ribarsky,et al.  Recovering Reasoning Processes from User Interactions , 2009, IEEE Computer Graphics and Applications.

[52]  Georges G. Grinstein,et al.  Vectorized Radviz and Its Application to Multiple Cluster Datasets , 2008, IEEE Transactions on Visualization and Computer Graphics.

[53]  Yoichi Shinoda,et al.  Information filtering based on user behavior analysis and best match text retrieval , 1994, SIGIR '94.

[54]  Erik Duval,et al.  Visualising Social Bookmarks , 2009, J. Digit. Inf..

[55]  Marti A. Hearst TileBars: visualization of term distribution information in full text information access , 1995, CHI '95.

[56]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[57]  Michelle X. Zhou,et al.  Who is talking about what: social map-based recommendation for content-centric social websites , 2010, RecSys '10.

[58]  Chris North,et al.  Multi-model semantic interaction for text analytics , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[59]  Mary Czerwinski,et al.  Design Study of LineSets, a Novel Set Visualization Technique , 2011, IEEE Transactions on Visualization and Computer Graphics.

[60]  James J. Thomas,et al.  Visualizing the non-visual: spatial analysis and interaction with information from text documents , 1995, Proceedings of Visualization 1995 Conference.

[61]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[62]  Hanspeter Pfister,et al.  UpSet: Visualization of Intersecting Sets , 2014, IEEE Transactions on Visualization and Computer Graphics.

[63]  Kwan-Liu Ma,et al.  Visual Recommendations for Network Navigation , 2011, Comput. Graph. Forum.

[64]  Steven M. Drucker,et al.  Helping Users Sort Faster with Adaptive Machine Learning Recommendations , 2011, INTERACT.

[65]  Jun Guo,et al.  SFViz: interest-based friends exploration and recommendation in social networks , 2011, VINCI '11.

[66]  James Bennett,et al.  The Netflix Prize , 2007 .

[67]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[68]  Barry Smyth,et al.  PeerChooser: visual interactive recommendation , 2008, CHI.

[69]  Chris North,et al.  Semantic interaction for visual text analytics , 2012, CHI.

[70]  Nathan Jacobs,et al.  Pie Charts for Visualizing Query Term Frequency in Search Results , 2002, ICADL.