User Trust Dynamics: An Investigation Driven by Differences in System Performance

Trust is a key factor affecting the way people rely on automated systems. On the other hand, system performance has comprehensive implications on a user's trust variations. This paper examines systems of varied levels of accuracy, in order to reveal the relationship between system performance, a user's trust and reliance on the system. In particular, it is identified that system failures have a stronger effect on trust than system successes. We also describe how patterns of trust change according to a number of consecutive system failures or successes. Importantly, we show that increasing user familiarity with the system decreases the rate of trust change, which provides new insights on the development of user trust. Finally, our analysis established a correlation between a user's reliance on a system and their trust level. Combining all these findings can have important implications in general system design and implementation, by predicting how trust builds and when it stabilizes, as well as allowing for indirectly reading a user's trust in real time based on system reliance.

[1]  George Mason.  Situation Awareness, Mental Workload, and Trust in Automation:Viable, Empirically Supported Cognitive Engineering Constructs , 2011 .

[2]  Neville Moray,et al.  Trust and human intervention in automated systems , 1995 .

[3]  Zheng Yan,et al.  Trust Modeling and Management: From Social Trust to Digital Trust , 2008 .

[4]  Arthur D. Fisk,et al.  Type of Automation Failure: The Effects on Trust and Reliance in Automation , 2004 .

[5]  Deborah Lee,et al.  Are Well-Calibrated Users Effective Users? Associations Between Calibration of Trust and Performance on an Automation-Aided Task , 2015, Hum. Factors.

[6]  Jan Marco Leimeister,et al.  How to use behavioral research insights on trust for HCI system design , 2012, CHI Extended Abstracts.

[7]  G. Zaltman,et al.  Relationships between Providers and Users of Market Research: The Dynamics of Trust within and between Organizations , 1992 .

[8]  B. Rouse William,et al.  Adaptive Aiding for Human/Computer Control , 1988 .

[9]  Yolanda Gil,et al.  Towards content trust of web resources , 2006, WWW '06.

[10]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[11]  Deborah L. McGuinness,et al.  Toward establishing trust in adaptive agents , 2008, IUI '08.

[12]  Fang Chen,et al.  Trust and Reliance Based on System Accuracy , 2016, UMAP.

[13]  Shankar Ganesan,et al.  Dimensions and Levels of Trust: Implications for Commitment to a Relationship , 1997 .

[14]  Berkeley J. Dietvorst,et al.  Algorithm Aversion: People Erroneously Avoid Algorithms after Seeing Them Err , 2014, Journal of experimental psychology. General.

[15]  Kristin E. Schaefer,et al.  Individual Differences, Trust, and Vehicle Autonomy , 2015 .

[16]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[17]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[18]  Erik Millstone,et al.  A crisis of trust: for science, scientists or for institutions? , 2000, Nature Medicine.

[19]  Holger Hoffmann,et al.  Incorporating behavioral trust theory into system development for ubiquitous applications , 2012, Personal and Ubiquitous Computing.

[20]  Susan Wiedenbeck,et al.  On-line trust: concepts, evolving themes, a model , 2003, Int. J. Hum. Comput. Stud..

[21]  Elisabeth André,et al.  Trust-based decision-making for smart and adaptive environments , 2015, User Modeling and User-Adapted Interaction.

[22]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[23]  Cees J. H. Midden,et al.  The effects of errors on system trust, self-confidence, and the allocation of control in route planning , 2003, Int. J. Hum. Comput. Stud..

[24]  Nadine B. Sarter,et al.  Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information , 2006, Hum. Factors.

[25]  Juergen Sauer,et al.  Experience of automation failures in training: effects on trust, automation bias, complacency and performance , 2016, Ergonomics.

[26]  N. Moray,et al.  Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. , 2000 .

[27]  E. Salas,et al.  Human Factors : The Journal of the Human Factors and Ergonomics Society , 2012 .

[28]  Elisabeth André,et al.  An empirical study on the trustworthiness of life-like interface agents , 1999, HCI.

[29]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[30]  Li Chen,et al.  Trust building with explanation interfaces , 2006, IUI '06.

[31]  N. Moray,et al.  Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. , 2000, Journal of experimental psychology. Applied.

[32]  Jennifer Preece,et al.  Empathy and online interpersonal trust: A fragile relationship , 2004, Behav. Inf. Technol..