Expressing social attitudes in virtual agents for social training games

The use of virtual agents in social coaching has increased rapidly in the last decade. In order to train the user in different situations than can occur in real life, the virtual agent should be able to express different social attitudes. In this paper, we propose a model of social attitudes that enables a virtual agent to reason on the appropriate social attitude to express during the interaction with a user given the course of the interaction, but also the emotions, mood and personality of the agent. Moreover, the model enables the virtual agent to display its social attitude through its non-verbal behaviour. The proposed model has been developed in the context of job interview simulation. The methodology used to develop such a model combined a theoretical and an empirical approach. Indeed, the model is based both on the literature in Human and Social Sciences on social attitudes but also on the analysis of an audiovisual corpus of job interviews and on post-hoc interviews with the recruiters on their expressed attitudes during the job interview.

[1]  D. Ballin,et al.  A framework for interpersonal attitude and non-verbal communication in improvisational visual media production , 2004 .

[2]  G. Bower,et al.  The Influence of Mood on Perceptions of Social Interactions , 1984 .

[3]  David J. Klein,et al.  Effects of mood on high elaboration attitude change: The mediating role of likelihood judgments , 1994 .

[4]  Hazaël Jones LIP,et al.  TARDIS-A simulation platform with an affective virtual recruiter for job interviews , 2013 .

[5]  Catherine Pelachaud,et al.  From a User-created Corpus of Virtual Agent's Non-verbal Behavior to a Computational Model of Interpersonal Attitudes , 2013, IVA.

[6]  Tobias Baur,et al.  The social signal interpretation (SSI) framework: multimodal signal processing and recognition in real-time , 2013, ACM Multimedia.

[7]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[8]  Louis-Philippe Morency,et al.  Cicero - Towards a Multimodal Virtual Audience Platform for Public Speaking Training , 2013, IVA.

[9]  Patrick Gebhard,et al.  ALMA: a layered model of affect , 2005, AAMAS '05.

[10]  K. Scherer Appraisal considered as a process of multilevel sequential checking. , 2001 .

[11]  Björn W. Schuller,et al.  Building Autonomous Sensitive Artificial Listeners , 2012, IEEE Transactions on Affective Computing.

[12]  Bilge Mutlu,et al.  MACH: my automated conversation coach , 2013, UbiComp.

[13]  Ana Paiva,et al.  Affective Agents for Education Against Bullying , 2009, Affective Information Processing.

[15]  D. Goleman Social Intelligence: The New Science of Human Relationships , 2006 .

[16]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[17]  Catherine Pelachaud,et al.  The TARDIS Framework: Intelligent Virtual Agents for Social Coaching in Job Interviews , 2013, Advances in Computer Entertainment.

[18]  Vipin Kumar,et al.  Introduction to Data Mining, (First Edition) , 2005 .

[19]  Timothy Leary,et al.  Interpersonal diagnosis of personality : a functional theory and methodology for personality evaluation , 1958 .

[20]  D. Keltner Signs of appeasement: evidence for the distinct displays of embarrassment, amusement, and shame , 1995 .

[21]  Katherine Isbister Better game characters by design : a psychological approach , 2006 .

[22]  P. Tremblay,et al.  The Buss and Perry Aggression Questionnaire and its relations to values, the Big Five, provoking hypothetical situations, alcohol consumption patterns, and alcohol expectancies , 2005 .

[23]  M. Argyle Bodily communication, 2nd ed. , 1988 .

[24]  Catherine Pelachaud,et al.  A multimodal corpus for the study of non-verbal behavior expressing interpersonal stances , 2013 .

[25]  Timothy V. Schafer Better Game Characters by Design: A Psychological Approach , 2006 .

[26]  Paulo J. Azevedo,et al.  Protein Sequence Classification Through Relevant Sequence Mining and Bayes Classifiers , 2005, EPIA.

[27]  Georgios N. Yannakakis,et al.  Mining multimodal sequential patterns: a case study on affect detection , 2011, ICMI '11.

[28]  Jerold L. Hale,et al.  Relational Messages Associated with Nonverbal Behaviors. , 1984 .

[29]  Justine Cassell,et al.  Playing with virtual peers: bootstrapping contingent discourse in children with autism , 2008, ICLS.

[30]  Cristina Conati,et al.  Knowledge Elicitation Methods for Affect Modelling in Education , 2013, Int. J. Artif. Intell. Educ..

[31]  M. Snyder The influence of individuals on situations: Implications for understanding the links between personality and social behavior. , 1983, Journal of personality.

[32]  Ramakrishnan Srikant,et al.  Mining Sequential Patterns: Generalizations and Performance Improvements , 1996, EDBT.

[33]  M. Sieverding ‘Be Cool!’: Emotional Costs of Hiding Feelings in a Job Interview , 2009 .

[34]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .