Machines versus humans: People's biased responses to traffic accidents involving self-driving vehicles.

Although self-driving vehicles (SDVs) bring with them the promise of improved traffic safety, they cannot eliminate all crashes. Little is known about whether people respond crashes involving SDVs and human drivers differently and why. Across five vignette-based experiments in two studies (total N = 1267), for the first time, we witnessed that participants had a tendency to perceive traffic crashes involving SDVs to be more severe than those involving conventionally human-driven vehicles (HDVs) regardless of their severity (injury or fatality) or cause (SDVs/HDVs or others). Furthermore, we found that this biased response could be a result of people's reliance on the affect heuristic. More specifically, higher prior negative affect tagged with an SDV (vs. an HDV) intensifies people's negative affect evoked by crashes involving the SDV (vs. those involving the HDV), which subsequently results in higher perceived severity and lower acceptability of the crash. Our results imply that people's over-reaction to crashes involving SDVs may be a psychological barrier to their adoption and that we may need to forestall a less stringent introduction policy that allows SDVs on public roads as it may lead to more crashes that could possibly deter people from adopting SDVs. We discuss other theoretical and practical implications of our results and suggest potential approaches to de-biasing people's responses to crashes involving SDVs.

[1]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Tyler H. Shaw,et al.  Designing Artificial Agents as Social Companions , 2017 .

[3]  S. Chaiken,et al.  Dual-process theories in social psychology , 1999 .

[4]  Pamela J. Hinds,et al.  Who Should I Blame? Effects of Autonomy and Transparency on Attributions in Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  N. Epley,et al.  The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle , 2014 .

[6]  D. Kahneman Thinking, Fast and Slow , 2011 .

[7]  A. Shariff,et al.  Psychological roadblocks to the adoption of self-driving vehicles , 2017, Nature Human Behaviour.

[8]  Ravishankar K. Iyer,et al.  Hands Off the Wheel in Autonomous Vehicles?: A Systems Perspective on over a Million Miles of Field Data , 2018, 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN).

[9]  A. Hayes Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[10]  Berkeley J. Dietvorst,et al.  Algorithm Aversion: People Erroneously Avoid Algorithms after Seeing Them Err , 2014, Journal of experimental psychology. General.

[11]  Peter R Harris,et al.  Does heightening risk appraisals change people's intentions and behavior? A meta-analysis of experimental studies. , 2014, Psychological bulletin.

[12]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[13]  G. Gigerenzer Dread Risk, September 11, and Fatal Traffic Accidents , 2004, Psychological science.

[14]  Zhigang Xu,et al.  Public Acceptance of Fully Automated Driving: Effects of Social Trust and Risk/Benefit Perceptions , 2018, Risk analysis : an official publication of the Society for Risk Analysis.

[15]  Paul Slovic,et al.  The affect heuristic , 2007, Eur. J. Oper. Res..

[16]  Isabell M. Welpe,et al.  Not fearless, but self-enhanced: The effects of anxiety on the willingness to use autonomous cars depend on individual levels of self-enhancement , 2017 .

[17]  Takayuki Kanda,et al.  Do people hold a humanoid robot morally accountable for the harm it causes? , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Melissa L. Finucane,et al.  Risk as Analysis and Risk as Feelings: Some Thoughts about Affect, Reason, Risk, and Rationality , 2004, Risk analysis : an official publication of the Society for Risk Analysis.

[19]  J. Lerner,et al.  Emotion and decision making. , 2015, Annual review of psychology.

[20]  A. Pradhan,et al.  Psychosocial factors associated with intended use of automated vehicles: A simulated driving study. , 2018, Accident; analysis and prevention.

[21]  J. Henrich,et al.  The Moral Machine experiment , 2018, Nature.

[22]  Tyler H. Shaw,et al.  Trust Repair Strategies with Self-Driving Vehicles: An Exploratory Study , 2018, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[23]  Kara M. Kockelman,et al.  Assessing Public Opinions of and Interest in New Vehicle Technologies: An Austin Perspective , 2016 .

[24]  Michael Sivak,et al.  Public opinion about self-driving vehicles in China, India, Japan, the U.S., the U.K., and Australia , 2014 .

[25]  Scott R. Winter,et al.  Patient perceptions on the use of driverless ambulances: An affective perspective , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.

[26]  P. Slovic,et al.  Risk Perception and Affect , 2006 .

[27]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[28]  Michael Siegrist,et al.  Affective Imagery and Acceptance of Replacing Nuclear Power Plants , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[29]  Michael Siegrist,et al.  New Information and Social Trust: Asymmetry and Perseverance of Attributions about Hazard Managers , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[30]  Riender Happee,et al.  Public opinion on automated driving: results of an international questionnaire among 5000 respondents , 2015 .

[31]  Linda G. Pierce,et al.  The Perceived Utility of Human and Automated Aids in a Visual Detection Task , 2002, Hum. Factors.

[32]  Thorsten Pachur,et al.  How do people judge risks: availability heuristic, affect heuristic, or both? , 2012, Journal of experimental psychology. Applied.

[33]  Daniel J. Fagnant,et al.  Preparing a Nation for Autonomous Vehicles: Opportunities, Barriers and Policy Recommendations , 2015 .

[34]  E. Broadbent Interactions With Robots: The Truths We Reveal About Ourselves , 2017, Annual review of psychology.

[35]  Don A. Moore,et al.  Algorithm Appreciation: People Prefer Algorithmic To Human Judgment , 2018, Organizational Behavior and Human Decision Processes.

[36]  Gregory N. Mandel,et al.  The Polarizing Impact of Science Literacy and Numeracy on Perceived Climate Change Risks , 2012 .

[37]  Peng Liu,et al.  How Safe Is Safe Enough for Self‐Driving Vehicles? , 2019, Risk analysis : an official publication of the Society for Risk Analysis.

[38]  Samuel S. Monfort,et al.  Almost human: Anthropomorphism increases trust resilience in cognitive agents. , 2016, Journal of experimental psychology. Applied.

[39]  Iyad Rahwan,et al.  Blaming humans in autonomous vehicle accidents: Shared responsibility across levels of automation , 2018, ArXiv.

[40]  Stephen M. Johnson,et al.  The affect heuristic in judgments of risks and benefits , 2000 .

[41]  Bernadette Sütterlin,et al.  Human and Nature‐Caused Hazards: The Affect Heuristic Causes Biased Decisions , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[42]  Zhen Wang,et al.  What drives people to accept automated vehicles? Findings from a field experiment , 2018, Transportation Research Part C: Emerging Technologies.

[43]  George Dimitrakopoulos,et al.  An empirical investigation on consumers’ intentions towards autonomous driving , 2018, Transportation Research Part C: Emerging Technologies.

[44]  Nidhi Kalra,et al.  Autonomous Vehicle Technology: A Guide for Policymakers , 2014 .

[45]  Jun-Wen Tan,et al.  Similarities and differences of emotions in human–machine and human–human interactions: what kind of emotions are relevant for future companion systems? , 2014, Ergonomics.

[46]  Clifford Nass,et al.  Are computers scapegoats? Attributions of responsibility in human-computer interaction , 1998, Int. J. Hum. Comput. Stud..

[47]  H. Krcmar,et al.  Anticipating acceptance of emerging technologies using twitter: the case of self-driving cars , 2018, Journal of Business Economics.

[48]  Isabell M. Welpe,et al.  How and why do men and women differ in their willingness to use automated cars? The influence of emotions across different age groups , 2016 .

[49]  Nidhi Kalra,et al.  Driving to Safety , 2016 .

[50]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[51]  Christopher K. Hsee,et al.  Risk as Feelings , 2001, Psychological bulletin.

[52]  Matthias Uhl,et al.  Rage against the machine: Automation in the moral domain , 2018, Journal of Behavioral and Experimental Economics.

[53]  S. Epstein Integration of the cognitive and the psychodynamic unconscious. , 1994, The American psychologist.

[54]  S Lewandowsky,et al.  The dynamics of trust: comparing humans to automation. , 2000, Journal of experimental psychology. Applied.

[55]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..

[56]  G. Clore,et al.  Feelings and phenomenal experiences , 1996 .

[57]  Nazanin Nader,et al.  Examining accident reports involving autonomous vehicles in California , 2017, PloS one.

[58]  Nidhi Kalra,et al.  The Enemy of Good , 2017 .

[59]  Cees J H Midden,et al.  The Role of Trust in the Affective Evaluation of Novel Risks: The Case of CO2 Storage , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[60]  Yochanan E. Bigman,et al.  People are averse to machines making moral decisions , 2018, Cognition.

[61]  D. Wiegmann,et al.  Similarities and differences between human–human and human–automation trust: an integrative review , 2007 .

[62]  Nancy Rhodes,et al.  Age and gender differences in risky driving: the roles of positive affect and risk perception. , 2011, Accident; analysis and prevention.

[63]  Lyn M. Van Swol,et al.  Understanding algorithm aversion: When is advice from automation discounted? , 2017 .