Moderators Of Trust And Reliance Across Multiple Decision Aids

The present work examines whether user’s trust of and reliance on automation, were affected by the manipulations of user’s perception of the responding agent. These manipulations included agent reliability, agent type, and failure salience. Previous work has shown that automation is not uniformly beneficial; problems can occur because operators fail to rely upon automation appropriately, by either misuse (overreliance) or disuse (underreliance). This is because operators often face difficulties in understanding how to combine their judgment with that of an automated aid. This difficulty is especially prevalent in complex tasks in which users rely heavily on automation to reduce their workload and improve task performance. However, when users rely on automation heavily they often fail to monitor the system effectively (i.e., they lose situation awareness – a form of misuse). However, if an operator realizes a system is imperfect and fails, they may subsequently lose trust in the system leading to underreliance. In the present studies, it was hypothesized that in a dual-aid environment poor reliability in one aid would impact trust and reliance levels in a companion better aid, but that this relationship is dependent upon the perceived aid type and the noticeability of the errors made. Simulations of a computerbased search-and-rescue scenario, employing uninhabited/unmanned ground vehicles (UGVs) searching a commercial office building for critical signals, were used to investigate these hypotheses. Results demonstrated that participants were able to adjust their reliance and trust on automated teammates depending on the teammate’s actual reliability levels. However, as hypothesized there was a biasing effect among mixed-reliability aids for trust and reliance. That is, when operators worked with two agents of mixed-reliability, their perception of how reliable and to what degree they relied on the aid was effected by the reliability of a current aid.

[1]  M. Deutsch Trust and suspicion , 1958 .

[2]  Morton Deutschi The Effect of Motivational Orientation upon Trust and Suspicion , 1960 .

[3]  J. Rotter A new scale for the measurement of interpersonal trust. , 1967, Journal of personality.

[4]  J. Rotter Generalized expectancies for interpersonal trust. , 1971 .

[5]  Stanley M. Halpin,et al.  Cognitive Reliability in Manned Systems , 1973 .

[6]  J. Rotter Interpersonal trust, trustworthiness, and gullibility. , 1980 .

[7]  Tibor Vámos,et al.  Adapting automation to man, culture and society , 1983, Autom..

[8]  Thomas B Sheridan,et al.  Research and Modeling of Supervisory Control Behavior. Report of a Workshop , 1984 .

[9]  J. G. Holmes,et al.  Trust in close relationships. , 1985 .

[10]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[11]  H P Bergeron,et al.  Aircraft automation: the problem of the pilot interface. , 1985, Aviation, space, and environmental medicine.

[12]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[13]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[14]  Shoshana Zuboff,et al.  In the Age of the Smart Machine: The Future of Work and Power , 1989 .

[15]  F. Javier Lerch,et al.  How do we trust machine advice , 1989 .

[16]  Edward F. McQuarrie,et al.  Public Opinion Toward Computers as a Function of Exposure , 1990 .

[17]  Christine E. DeMars,et al.  Item Response Theory , 2010, Assessing Measurement Invariance for Applied Research.

[18]  A J Belyavin,et al.  Pilots' Attitudes to Cockpit Automation , 1991 .

[19]  John P. Robinson,et al.  Measures Of Personality And Social Psychological Attitudes , 1991 .

[20]  L. Wrightsman CHAPTER 8 – Interpersonal Trust and Attitudes toward Human Nature , 1991 .

[21]  I. Singh,et al.  Individual differences in monitoring failures of automation , 1993 .

[22]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[23]  William B. Rouse,et al.  Human-Technology Interaction in Complex Systems , 1993 .

[24]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[25]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[26]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[27]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[28]  Barry H. Kantowitz,et al.  PILOT WORKLOAD AND FLIGHTDECK AUTOMATION. , 1996 .

[29]  William H. Ross,et al.  MULTIPLE MEANINGS OF TRUST IN NEGOTIATION THEORY AND RESEARCH: A LITERATURE REVIEW AND INTEGRATIVE MODEL , 1996 .

[30]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[31]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[32]  The Debiasing Effects of Accountability and Feedback on Automation Bias , 1997 .

[33]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[34]  Sheryl L. Chappell Cross-Checked but Not Seen: The Effects of Automation and Reliable Systems , 1997 .

[35]  James P. Bliss Alarm Reaction Patterns by Pilots as a Function of Reaction Modality , 1997 .

[36]  Kathleen L. Mosier,et al.  Automation Bias and Errors: Are Teams Better than Individuals? , 1998 .

[37]  Linda G. Pierce,et al.  Human Decision Making in an Automated Environment , 1998 .

[38]  Keith Stewart Gempler,et al.  DISPLAY OF PREDICTOR RELIABILITY ON A COCKPIT DISPLAY OF TRAFFIC INFORMATION , 1999 .

[39]  Sheue-Ling Hwang,et al.  Evaluating the Effects of Situation Awareness and Trust With Robust Design in Automation , 2000 .

[40]  S Lewandowsky,et al.  The dynamics of trust: comparing humans to automation. , 2000, Journal of experimental psychology. Applied.

[41]  Mark R. Lehto,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[42]  John S. Barnett Affects of training on user confidence in automation , 2000 .

[43]  Raja Parasuraman,et al.  Fuzzy Signal Detection Theory: Basic Postulates and Formulas for Analyzing Human and Machine Performance , 2000, Hum. Factors.

[44]  Michael J. Smith,et al.  Usability evaluation and interface design : cognitive engineering, intelligent agents and virtual reality , 2001 .

[45]  A. M. Rich,et al.  Automated diagnostic aids: The effects of aid reliability on users' trust and reliance , 2001 .

[46]  Douglas A. Wiegmann,et al.  Agreeing with Automated Diagnostic Aids: A Study of Users' Concurrence Strategies , 2002, Hum. Factors.

[47]  Linda G. Pierce,et al.  3. Operators' automation usage decisions and the sources of misuse and disuse , 2002 .

[48]  Alex M. Andrew,et al.  Humans and Automation: System Design and Research Issues , 2003 .

[49]  Cees J. H. Midden,et al.  The effects of errors on system trust, self-confidence, and the allocation of control in route planning , 2003, Int. J. Hum. Comput. Stud..

[50]  Peter A. Hancock,et al.  Human-Centered Design of Unmanned Aerial Vehicles , 2003 .

[51]  Raja Parasuraman,et al.  Fuzzy signal detection theory: analysis of human and machine performance in air traffic control, and analytic considerations , 2003, Ergonomics.

[52]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[53]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[54]  J. Gregory Trafton,et al.  Human control of multiple unmanned vehicles: effects of interface type on execution and task switching times , 2006, HRI '06.

[55]  Provocation: Is the UAV Control Ratio the Right Question? , 2007 .

[56]  Ann M. Bisantz,et al.  Measuring the Fit between Human Judgments and Alerting Systems: A Study of Collision Detection in Aviation , 2009 .

[57]  Ann M. Bisantz,et al.  Trust, Automation, and Feedback: An Integrated Approach , 2009 .