Autonomous Driving Ethics: from Trolley Problem to Ethics of Risk

In 2017, the German ethics commission for automated and connected driving released 20 ethical guidelines for autonomous vehicles. It is now up to the research and industrial sectors to enhance the development of autonomous vehicles based on such guidelines. In the current state of the art, we find studies on how ethical theories can be integrated. To the best of the authors’ knowledge, no framework for motion planning has yet been published which allows for the true implementation of any practical ethical policies. This paper makes four contributions: Firstly, we briefly present the state of the art based on recent works concerning unavoidable accidents of autonomous vehicles (AVs) and identify further need for research. While most of the research focuses on decision strategies in moral dilemmas or crash optimization, we aim to develop an ethical trajectory planning for all situations on public roads. Secondly, we discuss several ethical theories and argue for the adoption of the theory “ethics of risk.” Thirdly, we propose a new framework for trajectory planning, with uncertainties and an assessment of risks. In this framework, we transform ethical specifications into mathematical equations and thus create the basis for the programming of an ethical trajectory. We present a risk cost function for trajectory planning that considers minimization of the overall risk, priority for the worst-off and equal treatment of people. Finally, we build a connection between the widely discussed trolley problem and our proposed framework.

[1]  Oren Etzioni,et al.  Incorporating Ethics into Artificial Intelligence , 2017, The Journal of Ethics.

[2]  J. Henrich,et al.  The Moral Machine experiment , 2018, Nature.

[3]  Noah J. Goodall,et al.  Away from Trolley Problems and Toward Risk Management , 2016, Appl. Artif. Intell..

[4]  The Trolley Problem Revisited. An Exploratory Study , 2018, Annales. Etyka w Życiu Gospodarczym.

[5]  Technology and the Virtues: a Response to My Critics , 2018 .

[6]  Thomas M. Powers Prospects for a Kantian Machine , 2006, IEEE Intelligent Systems.

[7]  Kevin M. Murphy,et al.  The Value of Health and Longevity , 2005, Journal of Political Economy.

[8]  J. Christian Gerdes,et al.  Incorporating Ethical Considerations Into Automated Vehicle Control , 2017, IEEE Transactions on Intelligent Transportation Systems.

[9]  C. Patten,et al.  Literature review on the acceptance and road safety, ethical, legal, social and economic implications of automated vehicles , 2017 .

[10]  Christoph Luetge,et al.  The German Ethics Code for Automated and Connected Driving , 2017 .

[11]  Ulrich Sander,et al.  Pedestrian fatality risk as a function of car impact speed. , 2009, Accident; analysis and prevention.

[12]  Philipp Wintersberger,et al.  First Person Trolley Problem: Evaluation of Drivers' Ethical Decisions in a Driving Simulator , 2016, AutomotiveUI.

[13]  M. Weinstein,et al.  QALYs: the basics. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[14]  Jan Gogoll,et al.  Autonomous Cars: In Favor of a Mandatory Ethics Setting , 2016, Science and Engineering Ethics.

[15]  T. Scanlon The Difficulty of Tolerance: Essays in Political Philosophy , 2003 .

[16]  Susanne Ernst,et al.  Representing the Unknown – Impact of Uncertainty on the Interaction between Decision Making and Trajectory Generation , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[17]  Wesley Kumfer,et al.  Investigation into the Role of Rational Ethics in Crashes of Automated Vehicles , 2015 .

[18]  René F. Kizilcec How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface , 2016, CHI.

[19]  Sven Nyholm,et al.  The Ethics of Accident-Algorithms for Self-Driving Cars: an Applied Trolley Problem? , 2016, Ethical Theory and Moral Practice.

[20]  Ediriweera Desapriya,et al.  Bull Bars and Vulnerable Road Users , 2012, Traffic injury prevention.

[21]  Iyad Rahwan,et al.  The social dilemma of autonomous vehicles , 2015, Science.

[22]  J. Thomson The Trolley Problem , 1985 .

[23]  C. Ess Charles Ess—Commentary on The Onlife Manifesto , 2015 .

[24]  Rebecca Davnall,et al.  Solving the Single-Vehicle Self-Driving Car Trolley Problem Using Risk Theory and Vehicle Dynamics , 2019, Science and Engineering Ethics.

[25]  Giuseppe Contissa,et al.  The Ethical Knob: ethically-customisable automated vehicles and the law , 2017, Artificial Intelligence and Law.

[26]  Noah J. Goodall,et al.  Ethical Decision Making during Automated Vehicle Crashes , 2014, ArXiv.

[27]  Yong Gu Ji,et al.  Investigating the Importance of Trust on Adopting an Autonomous Vehicle , 2015, Int. J. Hum. Comput. Interact..

[28]  Wei Zhan,et al.  Probabilistic Prediction of Vehicle Semantic Intention and Motion , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[29]  T. Scanlon The Difficulty of Tolerance by T. M. Scanlon , 2003 .

[30]  Joshua D. Greene Moral Tribes: Emotion, Reason, and the Gap Between Us and Them , 2001 .

[31]  A. Kauppinen Who Should Bear the Risk When Self‐Driving Vehicles Crash? , 2020, Journal of Applied Philosophy.

[32]  Johannes Himmelreich Never Mind the Trolley: The Ethics of Autonomous Vehicles in Mundane Situations , 2018, Ethical Theory and Moral Practice.

[33]  Mayank Bansal,et al.  ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst , 2018, Robotics: Science and Systems.

[34]  E. Emanuel,et al.  Principles for allocation of scarce medical interventions , 2009, The Lancet.

[35]  J. C. Gerdes,et al.  Implementable Ethics for Autonomous Vehicles , 2016 .

[36]  Derek Leben,et al.  A Rawlsian algorithm for autonomous vehicles , 2017, Ethics and Information Technology.

[37]  Iyad Rahwan,et al.  The Trolley, the Bull Bar, and Why Engineers Should Care About the Ethics of Autonomous Cars , 2019, Proc. IEEE.

[38]  David Logan,et al.  A kinetic energy model of two-vehicle crash injury severity. , 2011, Accident; analysis and prevention.

[39]  Geoff Keeling,et al.  Against Leben's Rawlsian Collision Algorithm for Autonomous Vehicles , 2017, PT-AI.

[40]  D. Hübner,et al.  Crash Algorithms for Autonomous Cars: How the Trolley Problem Can Move Us Beyond Harm Minimisation , 2018, Ethical Theory and Moral Practice.

[41]  Stamatis Karnouskos,et al.  Self-Driving Car Acceptance and the Role of Ethics , 2020, IEEE Transactions on Engineering Management.

[42]  Patrick Lin Why Ethics Matters for Autonomous Cars , 2016 .