A Voting-Based System for Ethical Decision Making

We present a general approach to automating ethical decisions, drawing on machine learning and computational social choice. In a nutshell, we propose to learn a model of societal preferences, and, when faced with a specific ethical dilemma at runtime, efficiently aggregate those preferences to identify a desirable choice. We provide a concrete algorithm that instantiates our approach; some of its crucial steps are informed by a new theory of swap-dominance efficient voting rules. Finally, we implement and evaluate a system for ethical decision making in the autonomous vehicle domain, using preference data collected from 1.3 million people through the Moral Machine website.

[1]  F. Mosteller.  Remarks on the method of paired comparisons: I. The least squares solution assuming equal standard deviations and equal correlations , 1951 .

[2]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[3]  F. Mosteller,et al.  Remarks on the method of paired comparisons: III. A test of significance for paired comparisons when equal standard deviations and equal correlations are assumed , 1951, Psychometrika.

[4]  J. Marden.  Analyzing and Modeling Rank Data , 1996 .

[5]  Matthias Grossglauser,et al.  Fast and Accurate Inference of Plackett-Luce Models , 2015, NIPS.

[6]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[7]  Ariel D. Procaccia,et al.  When do noisy votes reveal the truth? , 2013, EC '13.

[8]  R S Downie,et al.  Ethics and the Limits of Philosophy , 1986, Ethics Beyond the Limits.

[9]  Eong Jinkyu,et al.  What is the Trolley Problem , 2015 .

[10]  Iyad Rahwan,et al.  A Computational Model of Commonsense Moral Decision Making , 2018, AIES.

[11]  Ariel D. Procaccia,et al.  WeBuildAI: Participatory Framework for Fair and Efficient Algorithmic Governance , 2018 .

[12]  Pradeep Ravikumar,et al.  Distributional Rank Aggregation, and an Axiomatic Analysis , 2015, ICML.

[13]  R. Duncan Luce,et al.  Individual Choice Behavior: A Theoretical Analysis , 1979 .

[14]  David C. Parkes,et al.  Random Utility Theory for Social Choice , 2012, NIPS.

[15]  Arun Rajkumar,et al.  A Statistical Convergence Perspective of Algorithms for Rank Aggregation from Pairwise Data , 2014, ICML.

[16]  L. Thurstone.  A law of comparative judgment. , 1994 .

[17]  Vincent Conitzer,et al.  Moral Decision Making Frameworks for Artificial Intelligence , 2017, ISAIM.

[18]  J. Henrich,et al.  The Moral Machine experiment , 2018, Nature.

[19]  Dan W. Brockt,et al.  The Theory of Justice , 2017 .

[20]  Francesca Rossi,et al.  Embedding Ethical Principles in Collective Decision Support Systems , 2016, AAAI.

[21]  John Guiver,et al.  Bayesian inference for Plackett-Luce ranking models , 2009, ICML '09.

[22]  David C. Parkes,et al.  Computing Parametric Ranking Models via Rank-Breaking , 2014, ICML.

[23]  C. Allen,et al.  Moral Machines: Teaching Robots Right from Wrong , 2008 .

[24]  Vincent Conitzer,et al.  Adapting a Kidney Exchange Algorithm to Align with Human Values , 2018, AAAI.

[25]  Yee Whye Teh,et al.  Bayesian nonparametric models for ranked data , 2012, NIPS.

[26]  Iyad Rahwan,et al.  The social dilemma of autonomous vehicles , 2015, Science.

[27]  H. Moulin.  The strategy of social choice , 1983 .

[28]  R. Plackett.  The Analysis of Permutations , 1975 .

[29]  A. Sen,et al.  Choice Functions and Revealed Preference , 1971 .