Identifying Factors that Influence Trust in Automated Cars and Medical Diagnosis Systems

Our research goals are to understand and model the factors that affect trust in automation across a variety of application domains. For the initial surveys described in this paper, we selected two domains: automotive and medical. Specifically, we focused on driverless cars (e.g., Google Cars) and automated medical diagnoses (e.g., IBM’s Watson). There were two dimensions for each survey: the safety criticality of the situation in which the system was being used and name-brand recognizability. We designed the surveys and administered them electronically, using Survey Monkey and Amazon’s Mechanical Turk. We then performed statistical analyses of the survey results to discover common factors across the domains, domain-specific factors, and implications of safety criticality and brand recognizability on trust factors. We found commonalities as well as dissimilarities in factors between the two domains, suggesting the possibility of creating a core model of trust that could be modified for individual domains. The results of our research will allow for the creation of design guidelines for autonomous systems that will be better accepted and used by target populations.

[1]  Holly A. Yanco,et al.  Effects of changing reliability on trust of robot systems , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[3]  Holly A. Yanco,et al.  Modeling trust to improve human-robot interaction , 2012 .

[4]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[5]  Holly A. Yanco,et al.  Impact of robot failures and feedback on real-time trust , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  D. Woods,et al.  Automation Surprises , 2001 .

[7]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[8]  P. Ostwald,et al.  Helping Global Hawk Fly with the Rest of US , 2007, 2007 Integrated Communications, Navigation and Surveillance Conference.

[9]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[10]  Dianne Easterling,et al.  March , 1890, The Hospital.

[11]  Frank Dellaert,et al.  Robust car tracking using Kalman filtering and Bayesian templates , 1998, Other Conferences.

[12]  Patrick Lin,et al.  Autonomous Military Robotics: Risk, Ethics, and Design , 2008 .

[13]  François Michaud,et al.  Telepresence Robot for Home Care Assistance , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[14]  S Vandebuerie,et al.  OUT OF THE LOOP , 2004 .

[15]  R. Parasuraman.  Vigilance, monitoring, and search. , 1986 .

[16]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[17]  Katherine M. Tsui,et al.  Designing Telepresence Robot Systems for Use by People with Special Needs , 2011 .

[18]  R. E. Curry,et al.  Human factors of flight-deck automation: report on a NASA-industry workshop , 1983 .