Tell me more?: the effects of mental model soundness on personalizing an intelligent agent

What does a user need to know to productively work with an intelligent agent? Intelligent agents and recommender systems are gaining widespread use, potentially creating a need for end users to understand how these systems operate in order to fix their agent's personalized behavior. This paper explores the effects of mental model soundness on such personalization by providing structural knowledge of a music recommender system in an empirical study. Our findings show that participants were able to quickly build sound mental models of the recommender system's reasoning, and that participants who most improved their mental models during the study were significantly more likely to make the recommender operate to their satisfaction. These results suggest that by helping end users understand a system's reasoning, intelligent agents may elicit more and better feedback, thus more closely aligning their output with each user's intentions.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  Weng-Keen Wong,et al.  Fixing the program my computer learned: barriers for end users, challenges for the machine , 2009, IUI.

[3]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[4]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction. Second Edition , 2007 .

[5]  A. Bandura.  Self-efficacy: toward a unifying theory of behavioral change. , 1977, Psychology Review.

[6]  Desney S. Tan,et al.  Interactive optimization for steering machine classification , 2010, CHI.

[7]  P. Hancock,et al.  Human Mental Workload , 1988 .

[8]  Thomas G. Dietterich,et al.  Toward harnessing user feedback for machine learning , 2007, IUI '07.

[9]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[10]  N. Bozionelos.  The relationship of instrumental and expressive traits with computer anxiety , 2001 .

[11]  Sean M. McNee,et al.  Confidence Displays and Training in Recommender Systems , 2003, INTERACT.

[12]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[13]  Mary Beth Rosson,et al.  Smalltalk scaffolding: a case study of minimalist instruction , 1990, CHI '90.

[14]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[15]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[16]  Weng-Keen Wong,et al.  Explanatory Debugging: Supporting End-User Debugging of Machine-Learned Programs , 2010, VL/HCC.

[17]  Desney S. Tan,et al.  Examining multiple potential models in end-user interactive concept learning , 2010, CHI.

[18]  Judith Masthoff,et al.  Effective explanations of recommendations: user-centered design , 2007, RecSys '07.

[19]  P. Johnson-Laird.  Mental models , 1989 .

[20]  Philip J. Stone,et al.  Extracting Information. (Book Reviews: The General Inquirer. A Computer Approach to Content Analysis) , 1967 .

[21]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[22]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[23]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[24]  Anind K. Dey,et al.  Toolkit to support intelligibility in context-aware applications , 2010, UbiComp.

[25]  Joe Tullio,et al.  How it works: a field study of non-technical users interacting with an intelligent system , 2007, CHI.

[26]  A. Adam.  Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[27]  Desney S. Tan,et al.  EnsembleMatrix: interactive visualization to support machine learning with multiple classifiers , 2009, CHI.

[28]  Perry R. Cook,et al.  Human model evaluation in interactive supervised learning , 2011, CHI.

[29]  Anind K. Dey,et al.  Why and why not explanations improve the intelligibility of context-aware intelligent systems , 2009, CHI.

[30]  Yvonne Rogers,et al.  Interaction Design - Beyond Human-Computer Interaction, 3rd Edition , 2012 .

[31]  Thomas G. Dietterich,et al.  Interacting meaningfully with machine learning systems: Three experiments , 2009, Int. J. Hum. Comput. Stud..

[32]  Jeffery D. Wilfong.  Computer anxiety and anger: the impact of computer use, computer experience, and self-efficacy beliefs , 2006, Comput. Hum. Behav..

[33]  Weng-Keen Wong,et al.  Fixing the program my computer learned: barriers for end users, challenges for the machine , 2009, IUI.

[34]  Deborah Compeau,et al.  Application of Social Cognitive Theory to Training for Computer Skills , 1995, Inf. Syst. Res..