The effects of transparency on trust in and acceptance of a content-based art recommender

The increasing availability of (digital) cultural heritage artefacts offers great potential for increased access to art content, but also necessitates tools to help users deal with such abundance of information. User-adaptive art recommender systems aim to present their users with art content tailored to their interests. These systems try to adapt to the user based on feedback from the user on which artworks he or she finds interesting. Users need to be able to depend on the system to competently adapt to their feedback and find the artworks that are most interesting to them. This paper investigates the influence of transparency on user trust in and acceptance of content-based recommender systems. A between-subject experiment (N = 60) evaluated interaction with three versions of a content-based art recommender in the cultural heritage domain. This recommender system provides users with artworks that are of interest to them, based on their ratings of other artworks. Version 1 was not transparent, version 2 explained to the user why a recommendation had been made and version 3 showed a rating of how certain the system was that a recommendation would be of interest to the user. Results show that explaining to the user why a recommendation was made increased acceptance of the recommendations. Trust in the system itself was not improved by transparency. Showing how certain the system was of a recommendation did not influence trust and acceptance. A number of guidelines for design of recommender systems in the cultural heritage domain have been derived from the study’s results.

[1]  Marc Langheinrich,et al.  Privacy by Design - Principles of Privacy-Aware Ubiquitous Systems , 2001, UbiComp.

[2]  Antonio Krüger,et al.  The museum visit: generating seamless personalized presentations on multiple devices , 2004, IUI '04.

[3]  Judith Masthoff,et al.  Effective explanations of recommendations: user-centered design , 2007, RecSys '07.

[4]  Lora Aroyo,et al.  User Interaction with User-Adaptive Information Filters , 2007, HCI.

[5]  Chris Cornelis,et al.  Gradual trust and distrust in recommender systems , 2009, Fuzzy Sets Syst..

[6]  Christoph Bartneck,et al.  How Convincing is Mr. Data's Smile: Affective Expressions of Machines , 2001, User Modeling and User-Adapted Interaction.

[7]  Zhisheng Huang,et al.  MultimediaN E-Culture Demonstrator , 2006, International Semantic Web Conference.

[8]  E. McKinney,et al.  Extending the Technology Acceptance Model and the Task-Technology Fit Model to Consumer E-Commerce , 2004 .

[9]  Eero Hyvönen,et al.  MuseumFinland - Finnish museums on the semantic web , 2005, J. Web Semant..

[10]  Fabio Pianesi,et al.  The influence of personality factors on visitor attitudes towards adaptivity dimensions for mobile museum guides , 2006, User Modeling and User-Adapted Interaction.

[11]  Daniel J. McAllister.  Affect- and Cognition-Based Trust as Foundations for Interpersonal Cooperation in Organizations , 1995 .

[12]  Bako Rajaonah,et al.  The role of intervening variables in driver-ACC cooperation , 2008, Int. J. Hum. Comput. Stud..

[13]  Andreas Zimmermann,et al.  LISTEN: a user-adaptive audio-augmented museum guide , 2008, User Modeling and User-Adapted Interaction.

[14]  Izak Benbasat,et al.  Recommendation Agents for Electronic Commerce: Effects of Explanation Facilities on Trusting Beliefs , 2007, J. Manag. Inf. Syst..

[15]  DamianoRossana,et al.  A stroll with Carletto , 2008 .

[16]  Matthias Nückles,et al.  How do Experts Adapt their Explanations to a Layperson’s Knowledge in Asynchronous Communication? An Experimental Study , 2006, User Modeling and User-Adapted Interaction.

[17]  Tsvi Kuflik,et al.  Adaptive, intelligent presentation of information for the museum visitor in PEACH , 2007, User Modeling and User-Adapted Interaction.

[18]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[19]  Keith Cheverst,et al.  Exploring Issues of User Model Transparency and Proactive Behaviour in an Office Environment Control System , 2005, User Modeling and User-Adapted Interaction.

[20]  Amedeo Cesta,et al.  Key Issues in Interactive Problem Solving: An Empirical Investigation on Users Attitude , 2005, INTERACT.

[21]  Cristina Gena,et al.  A stroll with Carletto: adaptation in drama-based tours with virtual characters , 2008, User Modeling and User-Adapted Interaction.

[22]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[23]  Kristina Höök,et al.  Steps to take before intelligent user interfaces become real , 2000, Interact. Comput..

[24]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[25]  Anthony Jameson,et al.  Pros and Cons of Controllability: An Empirical Study , 2002, AH.

[26]  E. McKinney,et al.  Extending the Technology Acceptance Model Extending the Technology Acceptance Model and the Task and the Task-Technology Fit Model to Technology Fit Model to Consumer E Consumer E- -Commerce Commerce , 2004 .

[27]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[28]  Peter Brusilovsky,et al.  Methods and techniques of adaptive hypermedia , 1996, User Modeling and User-Adapted Interaction.

[29]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[30]  Colin G. Drury,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[31]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[32]  Federica Cena,et al.  Tag-based user modeling for social multi-device adaptive guides , 2008, User Modeling and User-Adapted Interaction.

[33]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[34]  David McSherry,et al.  Explanation in Recommender Systems , 2005, Artificial Intelligence Review.

[35]  Audun Jøsang,et al.  Analysing the Relationship between Risk and Trust , 2004, iTrust.

[36]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[37]  Antonella De Angeli,et al.  Personalisation and Trust: A Reciprocal Relationship? , 2004, Designing Personalized User Experiences in eCommerce.

[38]  Paul A. Pavlou,et al.  Consumer Acceptance of Electronic Commerce: Integrating Trust and Risk with the Technology Acceptance Model , 2003, Int. J. Electron. Commer..

[39]  A. Jameson.  Adaptive interfaces and agents , 2002 .

[40]  Lora Aroyo,et al.  Personalized Museum Experience: The Rijksmuseum Use Case , 2007 .

[41]  Omprakash K. Gupta,et al.  The Moguls' Model of Computing: Integrating the Moderating Impact of Users' Persona into the Technology Acceptance Model , 2005 .

[42]  Ben Shneiderman,et al.  Direct manipulation vs. interface agents , 1997, INTR.

[43]  Nava Tintarev,et al.  Explaining Recommendations , 2007, User Modeling.

[44]  Izak Benbasat,et al.  Trust In and Adoption of Online Recommendation Agents , 2005, J. Assoc. Inf. Syst..

[45]  David E. Millard,et al.  Artequakt: Generating Tailored Biographies with Automatically Annotated Fragments from the Web , 2002, SAAKM@ECAI.

[46]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[47]  Christopher A. Miller,et al.  Trust and etiquette in high-criticality automated systems , 2004, CACM.

[48]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[49]  Henriette Cramer,et al.  Interaction with user-adaptive information filters.: trust, transparency and acceptance. , 2007, CHI Extended Abstracts.

[50]  Reena Master,et al.  Measurement of human trust in a hybrid inspection system based on signal detection theory measures , 2004 .

[51]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[52]  Clare-Marie Karat,et al.  User Attitudes Regarding a User-Adaptive eCommerce Web Site , 2003, User Modeling and User-Adapted Interaction.

[53]  Jennifer Trant,et al.  Exploring the potential for social tagging and folksonomy in art museums: Proof of concept , 2006, New Rev. Hypermedia Multim..

[54]  Raymond J. Mooney,et al.  Explaining Recommendations: Satisfaction vs. Promotion , 2005 .

[55]  David Benyon,et al.  Adaptive systems: A solution to usability problems , 1993, User Modeling and User-Adapted Interaction.

[56]  Hideo.  ExpertClerk : A Conversational Case-Based Reasoning Tool for Developing Salesclerk Agents in E-Commerce , .

[57]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[58]  Kristina Höök.  Evaluating the utility and usability of an adaptive hypermedia system , 1998, Knowl. Based Syst..

[59]  Lora Aroyo,et al.  Interactive User Modeling for Personalized Access to Museum Collections: The Rijksmuseum Case Study , 2007, User Modeling.

[60]  Kristina Höök,et al.  A glass box approach to adaptive hypermedia , 1996, User Modeling and User-Adapted Interaction.

[61]  Hans van der Heijden,et al.  User Acceptance of Hedonic Information Systems , 2004, MIS Q..

[62]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[63]  Frank Huysmans,et al.  Snuffelen en graven , 2006 .

[64]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[65]  Nancy Proctor,et al.  The State of the Art in Museum Handhelds in 2003. , 2003 .

[66]  Peretz Shoval,et al.  Information Filtering: Overview of Issues, Research and Systems , 2001, User Modeling and User-Adapted Interaction.

[67]  Marcus Specht,et al.  A Nomadic Information System for Adaptive Exhibition Guidance , 1999, Arch. Mus. Informatics.

[68]  Annika Waern,et al.  User Involvement in Automatic Filtering: An Experimental Study , 2004 .

[69]  Detmar W. Straub,et al.  Trust and TAM in Online Shopping: An Integrated Model , 2003, MIS Q..

[70]  Li Chen,et al.  Trust-inspiring explanation interfaces for recommender systems , 2007, Knowl. Based Syst..

[71]  B. J. Fogg,et al.  Prominence-interpretation theory: explaining how people assess credibility online , 2003, CHI Extended Abstracts.

[72]  Fabrice Vienne,et al.  Trust and the use of adaptive cruise control: a study of a cut-in situation , 2006, Cognition, Technology & Work.

[73]  Vanessa Evers,et al.  The effects of transparency on perceived and actual competence of a content-based recommender , 2008 .

[74]  Qingxiong Ma,et al.  The Technology Acceptance Model: A Meta-Analysis of Empirical Findings , 2004, J. Organ. End User Comput..

[75]  B. Rajaonah,et al.  Study of Driver Trust During Cooperation with Adaptive Cruise Control , 2006 .

[76]  Rino Falcone,et al.  Trust and control: A dialectic link , 2000, Appl. Artif. Intell..

[77]  Izak Benbasat,et al.  Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice , 1999, MIS Q..

[78]  Mark van Setten,et al.  Supporting People in Finding Information: Hybrid Recommender Systems and Goal-Based Structuring , 2005 .

[79]  Izak Benbasat,et al.  The formation of trust and distrust in recommendation agents in repeated interactions: a process-tracing analysis , 2003, ICEC '03.

[80]  Deborah L. McGuinness,et al.  Explaining answers from the Semantic Web: the Inference Web approach , 2004, J. Web Semant..

[81]  K. Kurasaki,et al.  Intercoder Reliability for Validating Conclusions Drawn from Open-Ended Interview Data , 2000 .

[82]  Judy Kay,et al.  Scrutable Adaptation: Because We Can and Must , 2006, AH.

[83]  Ing-Long Wu,et al.  An extension of Trust and TAM model with TPB in the initial adoption of on-line tax: An empirical study , 2005, Int. J. Hum. Comput. Stud..

[84]  Paul H. Lewis,et al.  Semantic web integration of cultural heritage sources , 2006, WWW '06.

[85]  B. J. Fogg,et al.  The elements of computer credibility , 1999, CHI '99.