AI safety engineering through introduction of self-reference into felicific calculus via artificial pain and pleasure

In the 18th century the Utilitarianism movement produced a morality system based on the comparative pain and pleasure that an action created. Called felicific calculus, this system would judge an action to be morally right or wrong based on several factors like the amount of pleasure it would provide and how much pain the action would inflict upon others. Because of its basis as a type of “moral mathematics” felicific calculus may be a viable candidate as a working ethical system for artificial intelligent agents. This paper examines the concepts of felicific calculus and Utilitarianism in the light of their possible application to artificial intelligence, and proposes methods for its adoption in an actual intelligent machine. In order to facilitate the calculations necessary for this moral system, novel approaches to synthetic pain, pleasure, and empathy are also proposed.

[1]  J. Bentham An Introduction to the Principles of Morals and Legislation , 1945, Princeton Readings in Political Thought.

[2]  James L Olds,et al.  Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. , 1954, Journal of comparative and physiological psychology.

[3]  Douglas B. Lenat,et al.  EURISKO: A Program That Learns New Heuristics and Domain Concepts , 1983, Artif. Intell..

[4]  J. Wade,et al.  Cognitive impairment in patients with chronic pain: The significance of stress , 2003, Current pain and headache reports.

[5]  D. Dennett Why you can't make a computer that feels pain , 1978, Synthese.

[6]  Chris Armen,et al.  Towards Machine Ethics: Implementing Two Action-Based Ethical Theories , 2005 .

[7]  Christopher Grau,et al.  There Is No "I" in "Robot": Robots and Utilitarianism , 2006, IEEE Intelligent Systems.

[8]  Michael Anderson,et al.  Machine Ethics: Creating an Ethical Intelligent Agent , 2007, AI Mag..

[9]  James C. Lester,et al.  Modeling and evaluating empathy in embodied companion agents , 2007, Int. J. Hum. Comput. Stud..

[10]  Mark Bishop,et al.  Why Computers Can’t Feel Pain , 2009, Minds and Machines.

[11]  Guilherme A. S. Pereira,et al.  Robot Navigation in Multi-terrain Outdoor Environments , 2009, Int. J. Robotics Res..

[12]  Ramón López-Cózar,et al.  Predicting user mental states in spoken dialogue systems , 2011, EURASIP J. Adv. Signal Process..

[13]  Britta K. Hölzel,et al.  How Does Mindfulness Meditation Work? Proposing Mechanisms of Action From a Conceptual and Neural Perspective , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[14]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[15]  Roman V Yampolskiy,et al.  Safety Engineering for Artificial General Intelligence , 2012, Topoi.

[16]  Roman V Yampolskiy,et al.  Artificial General Intelligence and the Human Mental Model , 2012 .