Modeling and Predicting Trust Dynamics in Human-Robot Teaming: A Bayesian Inference Approach

Trust in automation, or more recently trust in autonomy, has received extensive research attention in the past three decades. The majority of prior literature adopted a “snapshot” view of trust and typically evaluated trust through questionnaires administered at the end of an experiment. This “snapshot” view, however, does not acknowledge that trust is a dynamic variable that can strengthen or decay over time. To fill the research gap, the present study aims to model trust dynamics when a human interacts with a robotic agent over time. The underlying premise of the study is that by interacting with a robotic agent and observing its performance over time, a rational human agent will update his/her trust in the robotic agent accordingly. Based on this premise, we develop a personalized trust prediction model and learn its parameters using Bayesian inference. Our proposed model adheres to three properties of trust dynamics characterizing human agents’ trust development process de facto and thus guarantees high model explicability and generalizability. We tested the proposed method using an existing dataset involving 39 human participants interacting with four drones in a simulated surveillance mission. The proposed method obtained a root mean square error of 0.072, significantly outperforming existing prediction methods. Moreover, we identified three distinct types of trust dynamics, the Bayesian decision maker, the oscillator, and the disbeliever, respectively. This prediction model can be used for the design of individualized and adaptive technologies.

[1]  Franz Kummert,et al.  Comparing Robot and Human guided Personalization: Adaptive Exercise Robots are Perceived as more Competent and Trustworthy , 2020, Int. J. Soc. Robotics.

[2]  Brian Scassellati,et al.  The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents , 2011, Int. J. Soc. Robotics.

[3]  Kerstin Dautenhahn,et al.  Would You Trust a (Faulty) Robot? Effects of Error, Task Type and Personality on Human-Robot Cooperation and Trust , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[5]  Kevin Li,et al.  Evaluating Effects of User Experience and System Transparency on Trust in Automation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[6]  Ning Wang,et al.  Trust calibration within a human-robot team: Comparing automatically generated explanations , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Deborah Lee,et al.  I Trust It, but I Don’t Know Why , 2013, Hum. Factors.

[8]  Pei-Luen Patrick Rau,et al.  Effects of a Social Robot's Autonomy and Group Orientation on Human Decision-Making , 2013, Adv. Hum. Comput. Interact..

[9]  R. L. Thorndike Who belongs in the family? , 1953 .

[10]  Christopher D. Wickens,et al.  False Alerts in Air Traffic Control Conflict Alerting System: Is There a “Cry Wolf” Effect? , 2009, Hum. Factors.

[11]  X. Jessie Yang,et al.  Evaluating effects of workload on trust in automation, attention allocation and dual-task performance: , 2017 .

[12]  Neera Jain,et al.  Real-Time Sensing of Trust in Human-Machine Interactions , 2016 .

[13]  Arthur D. Fisk,et al.  Understanding the Effect of Workload on Automation Use for Younger and Older Adults , 2011, Hum. Factors.

[14]  Ho Chit Siu,et al.  Comparative Performance of Human and Mobile Robotic Assistants in Collaborative Fetch-and-Deliver Tasks , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  N. Epley,et al.  The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle , 2014 .

[16]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[17]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[18]  Mark A. Neerincx,et al.  Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams , 2019, International Journal of Social Robotics.

[19]  Na Du,et al.  Not All Information Is Equal: Effects of Disclosing Different Types of Likelihood Information on Trust, Compliance and Reliance, and Task Performance in Human-Automation Teaming , 2019, Hum. Factors.

[20]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[21]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[22]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[23]  Robin R. Murphy,et al.  Human-robot interaction in rescue robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Kerstin Dautenhahn,et al.  How the Timing and Magnitude of Robot Errors Influence Peoples' Trust of Robots in an Emergency Scenario , 2017, ICSR.

[25]  J. Swets,et al.  A decision-making theory of visual detection. , 1954, Psychological review.

[26]  Wendy Ju,et al.  Tell me more designing HRI to encourage more trust, disclosure, and companionship , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Nadine Sarter,et al.  Eye Tracking: A Process-Oriented Method for Inferring Trust in Automation as a Function of Priming and System Reliability , 2019, IEEE Transactions on Human-Machine Systems.

[28]  James L. Szalma,et al.  A Meta-Analysis of Factors Influencing the Development of Trust in Automation: Implications for Human-Robot Interaction , 2014 .

[29]  Pei-Luen Patrick Rau,et al.  Effects of communication style and culture on ability to accept recommendations from robots , 2009, Comput. Hum. Behav..

[30]  Arthur D. Fisk,et al.  Age-Related Differences in Reliance Behavior Attributable to Costs Within a Human-Decision Aid System , 2008, Hum. Factors.

[31]  Holly A. Yanco,et al.  Impact of robot failures and feedback on real-time trust , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  An In-home Advanced Robotic System to Manage Elderly Home-care Patients' Medications: A Pilot Safety and Usability Study. , 2017, Clinical therapeutics.

[33]  Alan R. Wagner,et al.  Overtrust of robots in emergency evacuation scenarios , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[34]  Gregory Dudek,et al.  OPTIMo: Online Probabilistic Trust Inference Model for Asymmetric Human-Robot Collaborations , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[35]  Linda Onnasch,et al.  Human Performance Consequences of Automated Decision Aids , 2012 .

[36]  Katia Sycara,et al.  The role of trust in human-robot interaction , 2018 .

[38]  Bertram F. Malle,et al.  Human-Robot Trust: Just a Button Press Away , 2017, HRI.

[39]  Katja Hölttä-Otto,et al.  How human operators adjust trust in automation: Contrast effect and hindsight bias , 2016 .

[40]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[41]  Katja Hölttä-Otto,et al.  How users adjust trust in automation , 2016 .