Robot Capability and Intention in Trust-Based Decisions Across Tasks

In this paper, we present results from a human-subject study designed to explore two facets of human mental models of robots—inferred capability and intention—and their relationship to overall trust and eventual decisions. In particular, we examine delegation situations characterized by uncertainty, and explore how inferred capability and intention are applied across different tasks. We develop an online survey where human participants decide whether to delegate control to a simulated UAV agent. Our study shows that human estimations of robot capability and intent correlate strongly with overall self-reported trust. However, overall trust is not independently sufficient to determine whether a human will decide to trust (delegate) a given task to a robot. Instead, our study reveals that estimations of robot intention, capability, and overall trust are integrated when deciding to delegate. From a broader perspective, these results suggest that calibrating overall trust alone is insufficient; to make correct decisions, humans need (and use) multi-faceted mental models when collaborating with robots across multiple contexts.

[1]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[2]  Kristin E. Schaefer,et al.  Measuring Trust in Human Robot Interactions: Development of the “ Trust Perception Scale-HRI ” , 2016 .

[3]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[4]  Tolga Könik,et al.  Achieving Far Transfer in an Integrated Cognitive Architecture , 2008, AAAI.

[5]  Robert J. Hall.  Trusting your assistant , 1996, Proceedings of the 11th Knowledge-Based Software Engineering Conference.

[6]  Alan R. Wagner,et al.  Effect of Robot Performance on Human–Robot Trust in Time-Critical Situations , 2017, IEEE Transactions on Human-Machine Systems.

[7]  Mark R. Lehto,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[8]  James L. Szalma,et al.  A Meta-Analysis of Factors Influencing the Development of Trust in Automation , 2016, Hum. Factors.

[9]  N. Moray,et al.  Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. , 1996, Ergonomics.

[10]  Ewart de Visser,et al.  Measurement of trust in human-robot collaboration , 2007, 2007 International Symposium on Collaborative Technologies and Systems.

[11]  Guy Hoffman,et al.  Evaluating Fluency in Human–Robot Collaboration , 2019, IEEE Transactions on Human-Machine Systems.

[12]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .

[13]  D. Collard,et al.  Trust : making and breaking cooperative relations , 1989 .

[14]  Bonnie M. Muir,et al.  Trust in automation. I: Theoretical issues in the study of trust and human intervention in automated systems , 1994 .

[15]  Yiannis Demiris,et al.  When and how to help: An iterative probabilistic model for learning assistance by demonstration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Gregory Dudek,et al.  OPTIMo: Online Probabilistic Trust Inference Model for Asymmetric Human-Robot Collaborations , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Thomas B Sheridan,et al.  Research and Modeling of Supervisory Control Behavior. Report of a Workshop , 1984 .

[18]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[19]  Ning Wang,et al.  Trust calibration within a human-robot team: Comparing automatically generated explanations , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  Motoko Kosugi,et al.  Trust, Gullibility, and Social Intelligence , 1999 .

[21]  Siddhartha S. Srinivasa,et al.  Planning with Trust for Human-Robot Collaboration , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Gregory Dudek,et al.  Towards Modeling Real-Time Trust in Asymmetric Human-Robot Collaborations , 2013, ISRR.

[23]  Yiannis Demiris,et al.  Learning assistance by demonstration , 2015, J. Hum. Robot Interact..

[24]  Min Chen,et al.  The Transfer of Human Trust in Robot Capabilities across Tasks , 2018, Robotics: Science and Systems.

[25]  Diego Gambetta.  Can We Trust Trust , 2000 .

[26]  V. Groom,et al.  Can robots be teammates?: Benchmarks in human–robot teams , 2007 .

[27]  Holly A. Yanco,et al.  Modeling trust to improve human-robot interaction , 2012 .

[28]  J. H. Davis,et al.  An integrative model of organizational trust, Academy of Management Review, : . , 1995 .

[29]  Anca D. Dragan,et al.  Establishing Appropriate Trust via Critical States , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Ion Juvina,et al.  Cognitive Model of Trust Dynamics Predicts Human Behavior within and between Two Games of Strategic Interaction with Computerized Confederate Agents , 2016, Front. Psychol..

[31]  Holly A. Yanco,et al.  Identifying Factors that Influence Trust in Automated Cars and Medical Diagnosis Systems , 2014, AAAI Spring Symposia.

[32]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[33]  D. Wiegmann,et al.  Similarities and differences between human–human and human–automation trust: an integrative review , 2007 .