Robot Lies in Health Care: When Is Deception Morally Permissible?

Autonomous robots are increasingly interacting with users who have limited knowledge of robotics and are likely to have an erroneous mental model of the robot’s workings, capabilities, and internal structure. The robot’s real capabilities may diverge from this mental model to the extent that one might accuse the robot’s manufacturer of deceiving the user, especially in cases where the user naturally tends to ascribe exaggerated capabilities to the machine (e.g. conversational systems in elder-care contexts, or toy robots in child care). This poses the question, whether misleading or even actively deceiving the user of an autonomous artifact about the capabilities of the machine is morally bad and why. By analyzing trust, autonomy, and the erosion of trust in communicative acts as consequences of deceptive robot behavior, we formulate four criteria that must be fulfilled in order for robot deception to be morally permissible, and in some cases even morally indicated.

[1]  Cory D. Kidd,et al.  Relational artifacts with children and elders: the complexities of cybercompanionship , 2006, Connect. Sci..

[2]  Herman T. Tavani,et al.  Trust and multi-agent systems: applying the “diffuse, default model” of trust to experiments involving artificial agents , 2011, Ethics and Information Technology.

[3]  Debra L. Shapiro,et al.  Betrayal of Trust in Organizations , 1998 .

[4]  B. Clifford.  Detecting lies and deceit: the psychology of lying and the implications for professional practice , 2001 .

[5]  J. Mahon.  Two Definitions of Lying , 2008 .

[6]  Judee K. Burgoon,et al.  Interpersonal deception: V. Accuracy in deception detection , 1994 .

[7]  A. Strudler.  The Distinctive Wrong in Lying , 2010 .

[8]  S. van Dulmen,et al.  Communication in context: new directions in communication research. , 2003, Patient education and counseling.

[9]  K. Dautenhahn,et al.  Towards interactive robots in autism therapy: background, motivation and challenges , 2004 .

[10]  Sukhan Lee,et al.  Designing robotic avatars Are user's impression affected by avatar's age? , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  T. Shibata,et al.  Robot therapy for elders affected by dementia , 2008, IEEE Engineering in Medicine and Biology Magazine.

[12]  Takanori Shibata,et al.  Living With Seal Robots—Its Sociopsychological and Physiological Influences on the Elderly at a Care House , 2007, IEEE Transactions on Robotics.

[13]  Joseph W. Koterski.  On the Virtues , 2002 .

[14]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[15]  Em Griffin.  A First Look at Communication Theory , 2005 .

[16]  Anne Barnhill.  What It Takes to Defend Deceptive Placebo Use , 2011, Kennedy Institute of Ethics journal.

[17]  T. Carson,et al.  Lying and Deception: Theory and Practice , 2010 .

[18]  R. Schröck.  A question of honesty in nursing practice. , 1980, Journal of advanced nursing.

[19]  L. Snyder,et al.  Ethics manual: fifth edition. , 2005, Annals of internal medicine.

[20]  N. Luhmann,et al.  Trust: Making and Breaking Cooperative Relations , 1990 .

[21]  S. Goold,et al.  Trust and the ethics of health care institutions. , 2001, The Hastings Center report.

[22]  Siobhan Chapman.  Logic and Conversation , 2005 .

[23]  G. Kent,et al.  The use of deception in nursing. , 1995, Journal of medical ethics.

[24]  Marina A. L. Oshana.  HOW MUCH SHOULD WE VALUE AUTONOMY? , 2003, Social Philosophy and Policy.

[25]  P. Wallace.  Improving palliative care through effective communication. , 2001, International journal of palliative nursing.

[26]  P. Benn.  Medicine, lies and deceptions , 2001, Journal of medical ethics.

[27]  Don Fallis,et al.  Lying and Deception , 2010 .

[28]  M. Marzanski.  On telling the truth to patients with dementia. , 2000, The Western journal of medicine.

[29]  K. Lützén,et al.  Balancing truth-telling in the preservation of hope , 2012, Nursing ethics.

[30]  Sara B. Kiesler,et al.  Mental models of robotic assistants , 2002, CHI Extended Abstracts.

[31]  Benjamin Kuipers,et al.  Computer power and human reason , 1976, SGAR.

[32]  B. R. Hasselkus.  Everyday ethics in dementia day care: narratives of crossing the line. , 1997, The Gerontologist.

[33]  Andreas Matthias,et al.  The responsibility gap: Ascribing responsibility for the actions of learning automata , 2004, Ethics and Information Technology.

[34]  D. Over,et al.  Studies in the Way of Words. , 1989 .

[35]  A. Hadley.  Lying , 1908, Encyclopedia of Evolutionary Psychological Science.

[36]  L. Candib.  Truth telling and advance planning at the end of life: Problems with autonomy in a multicultural world. , 2002 .