From Trolley to Autonomous Vehicle: Perceptions of Responsibility and Moral Norms in Traffic Accidents with Self-Driving Cars

Autonomous vehicles represent a new class of transportation that may be qualitatively different from existing cars. Two online experiments assessed lay perceptions of moral norms and responsibility for traffic accidents involving autonomous vehicles. In Experiment 1, 120 US adults read a narrative describing a traffic incident between a pedestrian and a motorist. In different experimental conditions, the pedestrian, the motorist, or both parties were at fault. Participants assigned less responsibility to a self-driving car that was at fault than to a human driver who was at fault. Participants confronted with a self-driving car at fault allocated greater responsibility to the manufacturer and the government than participants who were confronted with a human driver at fault did. In Experiment 2, 120 US adults read a narrative describing a moral dilemma in which a human driver or a self-driving car must decide between either allowing five pedestrians to die or taking action to hit a single pedestrian in order to save the five. The “utilitarian” decision to hit the single pedestrian was considered the moral norm for both a self-driving and a human-driven car. Moreover, participants assigned the obligation of setting moral norms for selfdriving cars to ethics researchers and to car manufacturers. This research reveals patterns of public perception of autonomous cars and may aid lawmakers and car manufacturers in designing such cars.

[1]  P. Foot The Problem of Abortion and the Doctrine of the Double Effect , 2020, The Doctrine of Double Effect.

[2]  David Allan Stern A survey to determine the influence of traffic accident severity and selected variables on seat belt usage by the general public , 1977 .

[3]  Ruth Barcan Marcus,et al.  Moral Dilemmas and Consistency , 1980 .

[4]  V. Folkes Consumer Reactions to Product Failure: An Attributional Approach , 1984 .

[5]  David W. Payton,et al.  An architecture for reflexive autonomous vehicle control , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[6]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[7]  F M Streff,et al.  SURVEY OF PUBLIC PERCEPTIONS OF TRAFFIC LAW ENFORCEMENT IN MICHIGAN , 2000 .

[8]  Massimo Bertozzi,et al.  Shape-based pedestrian detection , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[9]  Dariu Gavrila,et al.  Pedestrian Detection from a Moving Vehicle , 2000, ECCV.

[10]  Jonathan D. Cohen,et al.  An fMRI Investigation of Emotional Engagement in Moral Judgment , 2001, Science.

[11]  Viswanath Venkatesh,et al.  A Longitudinal Investigation of Personal Computers in Homes: Adoption Determinants and Emerging Challenges , 2001, MIS Q..

[12]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..

[13]  Justin L. Barrett,et al.  The Role of Control in Attributing Intentional Agency to Inanimate Objects , 2003 .

[14]  Alan E Stewart,et al.  Attributions of responsibility for motor vehicle crashes. , 2005, Accident; analysis and prevention.

[15]  Nicholas A. Sinnott-Armstrong,et al.  Wording effects in moral judgments , 2010, Judgment and Decision Making.

[16]  M. Coeckelbergh,et al.  Moral appearances: emotions, robots, and human morality , 2010, Ethics and Information Technology.

[17]  Tobias Gerstenberg,et al.  Spreading the blame: The allocation of responsibility amongst multiple agents , 2010, Cognition.

[18]  Gudmundur F. Ulfarsson,et al.  Analyzing fault in pedestrian-motor vehicle crashes in North Carolina. , 2010, Accident; analysis and prevention.

[19]  Ryan Calo,et al.  Legal Aspects of Autonomous Driving , 2010 .

[20]  鈴木 聡 Media Equation 研究の背景と動向 , 2011 .

[21]  Paul Atchley,et al.  Stuck in the 70s: the role of social norms in distracted driving. , 2012, Accident; analysis and prevention.

[22]  Matthias Scheutz,et al.  Moral competence in social robots , 2014, 2014 IEEE International Symposium on Ethics in Science, Technology and Engineering.

[23]  Christoph Bartneck,et al.  Anthropomorphism: Opportunities and Challenges in Human–Robot Interaction , 2014, International Journal of Social Robotics.

[24]  Paul M Salmon,et al.  Sharing the responsibility for driver distraction across road transport systems: a systems approach to the management of distracted driving. , 2015, Accident; analysis and prevention.

[25]  Julian Nida-Rümelin,et al.  Responsibility for Crashes of Autonomous Vehicles: An Ethical Analysis , 2014, Science and Engineering Ethics.

[26]  Matthias Scheutz,et al.  Sacrifice One For the Good of Many? People Apply Different Moral Norms to Human and Robot Agents , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).