Facial Deception in Humans and ECAs

Deception is a relevant issue for the theories of cognition and social interaction. When we deceive, we influence others through manipulating their beliefs. This paper presents a definition of deception and of its functions in terms of a model of cognition and social action. We define as deceptive any act or omission aimed at making others believe something false or not believe something true about the invironment, our identity or our mental states. A typology of ways to deceive is outlined (omission, concealment, falsification, masking, negation, and false confirmation), and applied to deception in facial and bodily expression. An ECA is presented that can simulate, mask, or suppress facial expressions of emotions. The relationship of deception and politeness is investigated theoretically and through analysis of a video corpus. The results of the analysis are used to determine when an ECA masks, suppresses or simulates emotional expression.

[1]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[2]  S. Bok,et al.  Lying: Moral Choice in Public and Private Life , 1979 .

[3]  P. Ekman,et al.  Felt, false, and miserable smiles , 1982 .

[4]  M. Mancini,et al.  An expressive ECA showing complex emotions , 2007 .

[5]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[6]  P. Ekman,et al.  Behavioral Markers and Recognizability of the Smile of Enjoyment , 1993 .

[7]  Cristiano Castelfranchi,et al.  Bugie, finzioni, sotterfugi. Per una scienza dell'inganno , 1998 .

[8]  A. Manstead,et al.  The social and emotional functions of facial displays , 1999 .

[9]  J. Burgoon,et al.  Interpersonal Deception Theory , 1996 .

[10]  Elisabeth André,et al.  Catch me if you can: exploring lying agents in social settings , 2005, AAMAS '05.

[11]  D. Keltner.  Signs of appeasement: evidence for the distinct displays of embarrassment, amusement, and shame , 1995 .

[12]  Franco Lorenzi.  Linguaggio, conoscenze e scopi [Language, cognition, and goals.]: Cristiano Castelfranchi and Domenico Parisi, Bologna: I1 Mulino, 1980. 561 pp. Lit. 20.000. , 1982 .

[13]  Stefan Kopp,et al.  Simulating the Emotion Dynamics of a Multimodal Conversational Agent , 2004, ADS.

[14]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[15]  Randall W. Hill,et al.  Toward a New Generation of Virtual Humans for Interactive Experiences , 2002, IEEE Intell. Syst..

[16]  Jean-Claude Martin,et al.  Representing Real-Life Emotions in Audiovisual Data with Non Basic Emotional Patterns and Context Features , 2005, ACII.

[17]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[18]  Penelope Brown,et al.  Politeness: Some Universals in Language Usage , 1989 .

[19]  R. Christie,et al.  Studies in Machiavellianism , 1970 .

[20]  H. Spencer-Oatey.  Reconsidering power and distance , 1996 .

[21]  Stefan Kopp,et al.  Synthesizing multimodal utterances for conversational agents: Research Articles , 2004 .

[22]  P. Gosselin,et al.  Components and recognition of facial expression in the communication of emotion by actors. , 1995, Journal of personality and social psychology.

[23]  Cristiano Castelfranchi,et al.  An Interactive System for Generating Arguments in Deceptive Communication , 2001, AI*IA.

[24]  J. Krebs.  Deception: Perspectives on Human and Nonhuman Deceit, Robert W. Mitchell, Nicholas S. Thompson (Eds.). State University of New York Press, New York (1986), xxix , 1986 .

[25]  C. Elliott.  The affective reasoner: a process model of emotions in a multi-agent system , 1992 .

[26]  H. Grotius,et al.  De iure belli ac pacis , 1948 .

[27]  H. Wagner,et al.  Facial expression in the presence of friends and strangers , 1991 .

[28]  C. Castelfranchi,et al.  On Various Sources of Uncertainty in Modeling Suspicion and How to Treat Them , 2000 .

[29]  P. Ekman.  Telling lies: clues to deceit in the marketplace , 1985 .

[30]  Catherine Pelachaud,et al.  Behavior Planning for a Reflexive Agent , 2001, IJCAI.

[31]  Cristiano Castelfranchi,et al.  Menzogna e simulazione , 1997 .

[32]  Floriana Esposito.  AI*IA 2001: Advances in Artificial Intelligence , 2001, Lecture Notes in Computer Science.

[33]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[34]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[35]  Radoslaw Niewiadomski,et al.  Intelligent Expressions of Emotions , 2005, ACII.

[36]  Cristiano Castelfranchi,et al.  Reasons: belief support and goal dynamics , 1996 .

[37]  Cristiano Castelfranchi.  To believe and to feel: The case of "needs" , 1998 .

[38]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[39]  J. S. Wiggins,et al.  Psychometric and Geometric Characteristics of the Revised Interpersonal Adjective Scales (IAS-R). , 1988, Multivariate behavioral research.

[40]  Mitsuru Ishizuka,et al.  Social role awareness in animated agents , 2001, AGENTS '01.

[41]  Siobhan Chapman.  Logic and Conversation , 2005 .

[42]  Laila Dybkjær,et al.  Affective Dialogue Systems , 2004, Lecture Notes in Computer Science.

[43]  P. Ekman.  Darwin, Deception, and Facial Expression , 2003, Annals of the New York Academy of Sciences.

[44]  R. Trivers.  The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[45]  Elisabeth André,et al.  Informing the Design of Embodied Conversational Agents by Analyzing Multimodal Politeness Behaviors in Human-Human Communication , 2005 .

[46]  Michael A. Arbib,et al.  Who Needs Emotions? - The brain meets the robot , 2004, Who Needs Emotions?.

[47]  Paul J. Costanzo,et al.  Social facilitation and inhibition of emotional expression and communication. , 1992, Journal of personality and social psychology.

[48]  Karl Grammer,et al.  Empathy, communication, deception. , 2003, Collegium antropologicum.

[49]  R. Byrne,et al.  Machiavellian intelligence : social expertise and the evolution of intellect in monkeys, apes, and humans , 1990 .

[50]  Robert W. Mitchell,et al.  Deception, perspectives on human and nonhuman deceit , 1986 .

[51]  P. Ekman.  Unmasking The Face , 1975 .

[52]  Jonathan Swift,et al.  Gulliver's Travels, 1726 , 1986 .

[53]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[54]  R. Conte,et al.  Cognitive and social action , 1995 .

[55]  R. Byrne,et al.  Why creative intelligence is hard to find , 1988, Behavioral and Brain Sciences.

[56]  Randall W. Hill,et al.  Steve Goes to Bosnia: Towards a New Generation of Virtual Humans for Interactive Experiences , 2001 .

[57]  D. Keltner,et al.  Love and the commitment problem in romantic relations and friendship. , 2001, Journal of personality and social psychology.

[58]  Alex Black,et al.  Truths, Lies, and Equivocations: The Effects of Conflicting Goals on Discourse , 1990 .

[59]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[60]  Radoslaw Niewiadomski,et al.  Perception of Blended Emotions: From Video Corpus to Expressive Agent , 2006, IVA.

[61]  A. Hadley.  Lying , 1908, Encyclopedia of Evolutionary Psychological Science.

[62]  Marianne LaFrance,et al.  Option or obligation to smile: The effects of power and gender on facial expression. , 1999 .

[63]  J. M. Smith,et al.  Do animals convey information about their intentions , 1982 .

[64]  Hugo Grotius,et al.  Hugonis Grotii De iure belli ac pacis libri tres, in quibus ius naturae et gentium, item iuris publici praecipua explicantur, cum annotatis auctoris , 1919 .

[65]  Isabella Poggi,et al.  The goals of persuasion , 2005 .

[66]  Stefan Kopp,et al.  Synthesizing multimodal utterances for conversational agents , 2004, Comput. Animat. Virtual Worlds.