Modeling Warmth and Competence in Virtual Characters

Developing believable virtual characters has been a subject of research in many fields including graphics, animations, artificial intelligence, and human-computer interaction. One challenge towards commoditizing the use of virtual humans is the ability to algorithmically construct characters of different stereotypes. In this paper, we present our efforts in designing virtual characters that can exhibit non-verbal behaviors to reflect varying degrees of warmth and competence, two personality traits shown to underlie social judgments and form stereotypical perception. To embark on developing a computational behavior model that portrays these traits, we adopt an iterative design methodology tuning the design using theory from theatre, animation and psychology, expert reviews, user testing and feedback. Using this process we were able to construct a set of virtual characters that portray variations of warmth and competence through combination of gestures, use of space, and gaze behaviors. In this paper we discuss the design methodology, the resultant system, and initial experiment results showing the promise of the model.

[1]  Stacy Marsella,et al.  SmartBody: behavior realization for embodied conversational agents , 2008, AAMAS.

[2]  Amy J. C. Cuddy,et al.  Universal dimensions of social cognition: warmth and competence , 2007, Trends in Cognitive Sciences.

[3]  P. Petta,et al.  Computational models of emotion , 2010 .

[4]  Denise C. Park,et al.  Young and Old Adults' Concerns About Morality and Competence , 2001 .

[5]  Mark P. Zanna,et al.  The Nonverbal Mediation of Self-Fulfilling Prophecies in Interracial Interaction. , 1974 .

[6]  M. Lipkin,et al.  A randomized trial of teaching clinical skills using virtual and live standardized patients , 2006, Journal of General Internal Medicine.

[7]  C. Sanders,et al.  Caring for children with intellectual and developmental disabilities: virtual patient instruction improves students' knowledge and comfort level. , 2007, Journal of pediatric nursing.

[8]  D. McNeill Hand and Mind: What Gestures Reveal about Thought , 1992 .

[9]  Linda L. Carli,et al.  Nonverbal behavior, gender, and influence. , 1995 .

[10]  J. Hietanen,et al.  Facial and emotional reactions to Duchenne and non-Duchenne smiles. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  C. Judd,et al.  Fundamental dimensions of social judgment: understanding the relations between judgments of competence and warmth. , 2005, Journal of personality and social psychology.

[12]  Paula J. Durlach,et al.  BiLAT: A Game-Based Environment for Practicing Negotiation in a Cultural Context , 2009, Int. J. Artif. Intell. Educ..

[13]  Judith A. Hall,et al.  Beliefs about the nonverbal expression of social power , 2005 .

[14]  Simona Sacchi,et al.  The Effects of Status on Perceived Warmth and Competence Malleability of the Relationship Between Status and Stereotype Content , 2010 .

[15]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[16]  Amy J. C. Cuddy,et al.  The dynamics of warmth and competence judgments, and their outcomes in organizations , 2011 .

[17]  Bogdan Wojciszke,et al.  On the Dominance of Moral Categories in Impression Formation , 1998 .

[18]  Judith A. Hall,et al.  Nonverbal behavior and the vertical dimension of social relations: a meta-analysis. , 2005, Psychological bulletin.

[19]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[20]  Rudolf von Laban,et al.  Effort; economy of human movement , 1974 .

[21]  Nadia Magnenat-Thalmann,et al.  A Model for Personality and Emotion Simulation , 2003, KES.

[22]  Anton Leuski,et al.  All Together Now - Introducing the Virtual Human Toolkit , 2013, IVA.

[23]  Kyle Johnsen,et al.  The validity of a virtual human experience for interpersonal skills education , 2007, CHI.

[24]  Stefan Kopp,et al.  The Behavior Markup Language: Recent Developments and Challenges , 2007, IVA.

[25]  W. Lewis Johnson,et al.  Tactical Language and Culture Training Systems: Using AI to Teach Foreign Languages and Cultures , 2009, AI Mag..

[26]  W. S. Reilly,et al.  Believable Social and Emotional Agents. , 1996 .

[27]  Naomi I. Eisenberger,et al.  Perceptions of Trust 1 MAJOR CLASSIFICATION: SOCIAL SCIENCES MINOR CLASSIFICATION: PSYCHOLOGICAL AND COGNITIVE SCIENCES Running Head: Perceptions of Trust Neural and Behavioral Bases of Age Differences in Perceptions of Trust , 2012 .

[28]  Jesse Fox,et al.  Recommendations for Designing Maximally Effective and Persuasive Health Agents , 2014, IVA.

[29]  Sara Boyd,et al.  Improving student dentist competencies and perception of difficulty in delivering care to children with developmental disabilities using a virtual patient module. , 2007, Journal of dental education.

[30]  K. Scherer,et al.  Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus , 2010 .

[31]  Bn Colby,et al.  THE COGNITIVE STRUCTURE OF EMOTIONS - ORTONY,A, CLORE,GL, COLLINS,A , 1989 .

[32]  P. Costa,et al.  Normal Personality Assessment in Clinical Practice: The NEO Personality Inventory. , 1992 .