A computational model of social attitude effects on the nonverbal behavior for a relational agent

The relations we have with others influence in a very subtle way our body gestures. These are cues that are used in an interaction in an unconscious process to communicate and understand an attitude. Depending on the gestures and facial signals one is displaying, a social attitude can be perceived. In this paper, we propose to model socio-emotional agents and how they can express such an attitude in a dyadic interaction. The focus will be on generating the nonverbal behavior of the virtual agent given the social attitude it wants to convey. Depending on the nature of the relation an agent has with someone else, its role and desires, it should display a different attitude and therefore it should display different nonverbal behaviors. In this paper, we propose a computational model based on the findings in Human and Social Sciences on the correspondence between social attitudes and nonverbal behaviors. This computational model is used to select the proper behavior of an agent during an interaction depending on the social attitudes it wants to convey and depending on its gender.

[1]  Nadia Magnenat-Thalmann,et al.  Making Them Remember—Emotional Virtual Characters with Memory , 2009, IEEE Computer Graphics and Applications.

[2]  Marilyn A. Walker,et al.  Bossy or Wimpy: Expressing Social Dominance by Combining Gaze and Linguistic Behaviors , 2010, IVA.

[3]  Maurizio Mancini,et al.  Dynamic Behavior Qualifiers for Conversational Agents , 2007, IVA.

[4]  Timothy W. Bickmore,et al.  Relational Agents Improve Engagement and Learning in Science Museum Visitors , 2011, IVA.

[5]  Jean-claude Martin,et al.  Appraising emotional events during a real-time interactive game , 2009, AFFINE '09.

[6]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[7]  Ursula Hess,et al.  Display of Empathy and Perception of Out-Group Members , 2007 .

[8]  Magalie Ochs,et al.  Simulation of the Dynamics of Nonplayer Characters' Emotions and Social Relations in Games , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[9]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[10]  Jerold L. Hale,et al.  Relational Messages Associated with Nonverbal Behaviors. , 1984 .

[11]  Reginald B. Adams,et al.  Who may frown and who should smile? Dominance, affiliation, and the display of happiness and anger , 2005 .

[12]  Timothy W. Bickmore,et al.  Establishing and maintaining long-term human-computer relationships , 2005, TCHI.

[13]  M. Gurtman.  Exploring Personality with the Interpersonal Circumplex , 2009 .

[14]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[15]  Mark Grimshaw,et al.  Relational agents: A critical review , 2009 .

[16]  Ursula Hess,et al.  Why the Same Expression May Not Mean the Same When Shown on Different Faces or Seen by Different People , 2009, Affective Information Processing.

[17]  Catherine Pelachaud,et al.  Design and implementation of an expressive gesture model for a humanoid robot , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[18]  B. Knutson.  Facial expressions of emotion influence interpersonal trait inferences , 1996 .

[19]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[20]  Justine Cassell,et al.  Relational agents: a model and implementation of building user trust , 2001, CHI.

[21]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[22]  Judith A. Hall,et al.  Beliefs about the nonverbal expression of social power , 2005 .

[23]  Maurizio Mancini,et al.  Design and evaluation of expressive gesture synthesis for embodied conversational agents , 2005, AAMAS '05.

[24]  Timothy V. Schafer.  Better Game Characters by Design: A Psychological Approach , 2006 .

[25]  Judith A. Hall,et al.  Beliefs about female and male nonverbal communication , 1995 .

[26]  Ana Paiva,et al.  MAY: My Memories Are Yours , 2010, IVA.

[27]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[28]  Stefan Kopp,et al.  Why emotions should be integrated into conversational agents , 2007 .

[29]  Elisabetta Bevacqua,et al.  A Listening Agent Exhibiting Variable Behaviour , 2008, IVA.

[30]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[31]  Françoise J. Prêteux,et al.  Critic review on MPEG-4 face and body animation , 2002, Proceedings. International Conference on Image Processing.

[32]  J. Burgoon,et al.  Nonverbal cues and interpersonal judgments: Participant and observer perceptions of intimacy, dominance, composure, and formality , 1999 .

[33]  Radoslaw Niewiadomski,et al.  Greta: an interactive expressive ECA system , 2009, AAMAS.