Measures of Reliance and Compliance in Aided Visual Scanning

Objective: We study the dependence or independence of reliance and compliance as two responses to alarms to understand the mechanisms behind these responses. Background: Alarms, alerts, and other binary cues affect user behavior in complex ways. The suggestion has been made that there are two different responses to alerts—compliance (the tendency to perform an action cued by the alert) and reliance (the tendency to refrain from actions as long as no alert is issued). The study tests the degree to which these two responses are indeed independent. Method: An experiment tested the effects of the positive and negative predictive values of the alerts (PPV and NPV) on measures of compliance and reliance based on cutoff settings, response times, and subjective confidence. Results: For cutoff settings and response times, compliance was unaffected by the irrelevant NPV, whereas reliance depended on the irrelevant PPV. For subjective estimates, there were no significant effects of the irrelevant variables. Conclusion: Results suggest that compliance is relatively stable and unaffected by irrelevant information (the NPV), whereas reliance is also affected by the PPV. The results support the notion that reliance and compliance are separate, but related, forms of trust. Application: False alarm rates, which affect PPV, determine both the response to alerts (compliance) and the tendency to limit precautions when no alert is issued (reliance).

[1]  Joachim Meyer,et al.  Mental effort in binary categorization aided by binary cues. , 2013, Journal of experimental psychology. Applied.

[2]  Christopher D. Wickens,et al.  On the Independence of Compliance and Reliance: Are Automation False Alarms Worse Than Misses? , 2007, Hum. Factors.

[3]  Werner Hamacher,et al.  The Relation , 2009 .

[4]  Christopher D. Wickens,et al.  Automation Reliability in Unmanned Aerial Vehicle Control: A Reliance-Compliance Model of Automation Dependence in High Workload , 2006, Hum. Factors.

[5]  Joachim Meyer,et al.  Effects of Warning Validity and Proximity on Responses to Warnings , 2001, Hum. Factors.

[6]  Arthur D. Fisk,et al.  Understanding the Effect of Workload on Automation Use for Younger and Older Adults , 2011, Hum. Factors.

[7]  Carl Craig Morris,et al.  Retrieval processes underlying confidence in comprehension judgments. , 1990 .

[8]  Raja Parasuraman,et al.  Adaptive Aiding of Human-Robot Teaming , 2011 .

[9]  Keiichi Yamada,et al.  Preliminary study of behavioral and safety effects of driver dependence on a warning system in a driving simulator , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[10]  D. Shinar BEN-GURION UNIVERSITY OF THE NEGEV , 2012 .

[11]  Dietrich Manzey,et al.  Misuse of Diagnostic Aids in Process Control: The Effects of Automation Misses on Complacency and Automation Bias , 2008 .

[12]  E. Bass,et al.  The Effect of Information Analysis Automation Display Content on Human Judgment Performance in Noisy Environments , 2013, Journal of cognitive engineering and decision making.

[13]  Jason S McCarley,et al.  Effects of response bias and judgment framing on operator use of an automated aid in a target detection task. , 2011, Journal of experimental psychology. Applied.

[14]  Joachim Meyer,et al.  Use of Warnings in an Attentionally Demanding Detection Task , 2001, Hum. Factors.

[15]  Stephen Rice Examining Single- and Multiple-Process Theories of Trust in Automation , 2009, The Journal of general psychology.

[16]  Joachim Meyer,et al.  Defining and measuring physicians' responses to clinical reminders , 2009, J. Biomed. Informatics.

[17]  Joachim Meyer,et al.  Self-initiated and respondent actions in a simulated control task , 2007, Ergonomics.

[18]  Nina Gérard Are false alarms not as bad as supposed after all? A study investigating operators’ responses to imperfect alarms , 2010 .

[19]  Janet A. Sniezek,et al.  Influences on the appropriateness of confidence in judgment: Practice, effort, information, and decision-making , 1991 .

[20]  J A Swets,et al.  Psychological Science Can Improve Diagnostic Decisions , 2000, Psychological science in the public interest : a journal of the American Psychological Society.

[21]  Joachim Meyer,et al.  On the Relation Between Reliance and Compliance in an Aided Visual Scanning Task , 2012 .

[22]  Joachim Meyer,et al.  Conceptual Issues in the Study of Dynamic Hazard Warnings , 2004, Hum. Factors.