Overtrust in External Cues of Automated Vehicles: An Experimental Investigation

The intentions of an automated vehicle are hard to spot in the absence of eye contact with a driver or other established means of communication. External car displays have been proposed as a solution, but what if they malfunction or display misleading information? How will this influence pedestrians' trust in the vehicle? To investigate these questions, we conducted a between-subjects study in Virtual Reality (N = 18) in which one group was exposed to erroneous displays. Our results show that participants already started with a very high degree of trust. Incorrectly communicated information led to a strong decline in trust and perceived safety, but both recovered very quickly. This was also reflected in participants' road crossing behavior. We found that malfunctions of an external car display motivate users to ignore it and thereby aggravate the effects of overtrust. Therefore, we argue that the design of external communication should avoid misleading information and at the same time prevent the development of overtrust by design.

[1]  D A Norman,et al.  The 'problem' with automation: inappropriate feedback and interaction, not 'over-automation'. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[2]  Alexander Kunze,et al.  Enhancing Driving Safety and User Experience Through Unobtrusive and Function-Specific Feedback , 2017, AutomotiveUI.

[3]  Florian Alt,et al.  Car Exterior Surface Displays: Exploration in a Real-World Context , 2018, PerDis.

[4]  Jacques M. B. Terken,et al.  Pedestrian Interaction with Vehicles: Roles of Explicit and Implicit Communication , 2017, AutomotiveUI.

[5]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[6]  Makoto Itoh,et al.  Human’s Overtrust in and Overreliance on Advanced Driver Assistance Systems: A Theoretical Framework , 2013 .

[7]  Natasha Merat,et al.  Designing the interaction of automated vehicles with other traffic participants: design considerations based on human needs and expectations , 2018, Cognition, Technology & Work.

[8]  Raphael Zimmermann,et al.  First Step into Visceral Interaction with Autonomous Vehicles , 2017, AutomotiveUI.

[9]  Kristin Kolodge,et al.  Understanding Attitudes Towards Self-Driving Vehicles: Quantitative Analysis of Qualitative Data , 2018, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[10]  Ralf Risser,et al.  Pedestrian-driver communication and decision strategies at marked crossings. , 2017, Accident; analysis and prevention.

[11]  Girish Chowdhary,et al.  Intent Communication between Autonomous Vehicles and Pedestrians , 2017, ArXiv.

[12]  Philipp Wintersberger,et al.  S(C)ENTINEL: monitoring automated vehicles with olfactory reliability displays , 2019, IUI.

[13]  Alex Fridman,et al.  To Walk or Not to Walk: Crowdsourced Assessment of External Vehicle-to-Pedestrian Displays , 2017, ArXiv.

[14]  Changxu Wu,et al.  Pedestrian gestures increase driver yielding at uncontrolled mid-block road crossings. , 2014, Accident; analysis and prevention.

[15]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[16]  Katia Sycara,et al.  The role of trust in human-robot interaction , 2018 .

[17]  John K. Tsotsos,et al.  Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice , 2018, IEEE Transactions on Intelligent Transportation Systems.

[18]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[19]  Jacques M. B. Terken,et al.  Gaze Patterns in Pedestrian Interaction with Vehicles: Towards Effective Design of External Human-Machine Interfaces for Automated Vehicles , 2019, AutomotiveUI.

[20]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[21]  Philipp Wintersberger,et al.  Trust in Technology as a Safety Aspect in Highly Automated Driving , 2016, i-com.

[22]  John K. Tsotsos,et al.  Towards Social Autonomous Vehicles: Understanding Pedestrian-Driver Interactions , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[23]  Sowmya Somanath,et al.  Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction , 2018, CHI.

[24]  Philipp Wintersberger,et al.  Fostering User Acceptance and Trust in Fully Automated Vehicles: Evaluating the Potential of Augmented Reality , 2018, PRESENCE: Virtual and Augmented Reality.

[25]  Wendy Ju,et al.  Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[26]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[27]  Linda Ng Boyle,et al.  In UX We Trust: Investigation of Aesthetics and Usability of Driver-Vehicle Interfaces and Their Impact on the Perception of Automated Driving , 2019, CHI.

[28]  Martin Baumann,et al.  Anthropomorphic agents, transparent automation and driver personality: towards an integrative multi-level model of determinants for effective driver-vehicle cooperation in highly automated vehicles , 2015, AutomotiveUI.

[29]  Michael P. Clamann,et al.  Evaluation of Vehicle-to-Pedestrian Communication Displays for Autonomous Vehicles , 2017 .

[30]  Alexander G. Mirnig,et al.  First Workshop on Trust in the Age of Automated Driving , 2017, AutomotiveUI.

[31]  Jonas Andersson,et al.  Workshop on Methodology: Evaluating Interactions between Automated Vehicles and Other Road Users---What Works in Practice? , 2018, AutomotiveUI.

[32]  Alexander G. Mirnig,et al.  Second Workshop on Trust in the Age of Automated Driving , 2018, AutomotiveUI.

[33]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[34]  Makoto Itoh,et al.  Trust in and use of automation: their dependence on occurrence patterns of malfunctions , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[35]  Yahui Wang,et al.  To Cross or Not to Cross: Urgency-Based External Warning Displays on Autonomous Vehicles to Improve Pedestrian Crossing Safety , 2018, AutomotiveUI.

[36]  Melissa Cefkin,et al.  Evaluation of an Autonomous Vehicle External Communication System Concept: A Survey Study , 2017 .

[37]  P. Koopman,et al.  A Philosophy for Developing Trust in Self-driving Cars , 2015 .

[38]  Chao Wang,et al.  Interface Concepts for Intent Communication from Autonomous Vehicles to Vulnerable Road Users , 2018, AutomotiveUI.

[39]  Florian Alt,et al.  Investigating the Influence of External Car Displays on Pedestrians' Crossing Behavior in Virtual Reality , 2019, MobileHCI.

[40]  Nicolas Guéguen,et al.  A pedestrian’s stare and drivers’ stopping behavior: A field experiment at the pedestrian crossing , 2015 .

[41]  Alan R. Wagner,et al.  Overtrust in the robotic age , 2018, Commun. ACM.

[42]  Bruce N. Walker,et al.  Development and Preliminary Evaluation of Reliability Displays for Automated Lane Keeping , 2017, AutomotiveUI.

[43]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[44]  Martin Tomitsch,et al.  Designing for Projection-based Communication between Autonomous Vehicles and Pedestrians , 2019, AutomotiveUI.

[45]  Matúš Šucha,et al.  Road users’ strategies and communication: driver-pedestrian interaction , 2014 .

[46]  Alexander G. Mirnig,et al.  Workshop on Communication between Automated Vehicles and Vulnerable Road Users , 2018, AutomotiveUI.

[47]  John K. Tsotsos,et al.  Agreeing to cross: How drivers and pedestrians communicate , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).