An optimizable scalar objective value cannot be objective and should not be the sole objective

This paper concerns the ethics and morality of algorithms and computational systems, and has been circulating internally at Facebook for the past couple years. The paper reviews many Nobel laureates' work, as well as the work of other prominent scientists such as Richard Dawkins, Andrei Kolmogorov, Vilfredo Pareto, and John von Neumann. The paper draws conclusions based on such works, as summarized in the title. The paper argues that the standard approach to modern machine learning and artificial intelligence is bound to be biased and unfair, and that longstanding traditions in the professions of law, justice, politics, and medicine should help.

[1]  V. Arnold.  Mathematical Methods of Classical Mechanics , 1974 .

[2]  S J Pocock,et al.  Randomized trials or observational tribulations? , 2000, The New England journal of medicine.

[3]  D. Ellsberg.  Decision, probability, and utility: Risk, ambiguity, and the Savage axioms , 1961 .

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Kenneth E. Boulding,et al.  The World as a Total System , 1970 .

[6]  D. Raine.  General relativity , 1980, Nature.

[7]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[8]  T. Kurth,et al.  Propensity scores: help or hype? , 2004, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[9]  Jon M. Kleinberg,et al.  On Fairness and Calibration , 2017, NIPS.

[10]  A. Copeland.  Review: John von Neumann and Oskar Morgenstern, Theory of games and economic behavior , 1945 .

[11]  N. McGlynn.  Thinking fast and slow. , 2014, Australian veterinary journal.

[12]  Wg.Cdr. Pongphet Congpuong.  How to lie With Statistics , 2013 .

[13]  L. Bertalanffy.  Organismic psychology and systems theory , 1966 .

[14]  Robert E. Goodin,et al.  The Oxford Handbook of Political Science , 2011 .

[15]  S. Turkle,et al.  Epistemological Pluralism and the Revaluation of the Concrete. , 1992 .

[16]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.

[17]  Henri Theil,et al.  On the Theory of Economic Policy , 1992 .

[18]  P. Whitney,et al.  Impulsive decision making and working memory. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[19]  M. Allais.  Le comportement de l'homme rationnel devant le risque : critique des postulats et axiomes de l'ecole americaine , 1953 .

[20]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[21]  Joseph C. Gardiner,et al.  Applying Propensity Score Methods in Medical Research: Pitfalls and Prospects , 2010, Medical care research and review : MCRR.

[22]  R. Lewontin.  ‘The Selfish Gene’ , 1977, Nature.

[23]  J. Brady,et al.  The Belmont Report. Ethical principles and guidelines for the protection of human subjects of research. , 2015, The Journal of the American College of Dentists.

[24]  D. Good,et al.  Individuals, Interpersonal Relations, and Trust , 2000 .

[25]  Shlomo Zilberstein,et al.  Models of Bounded Rationality , 1995 .

[26]  J. Hull.  Options, Futures, and Other Derivatives , 1989 .

[27]  R. Thaler.  Misbehaving: The Making of Behavioral Economics , 2015 .