Reactive Virtual Agents: A Viewpoint-Driven Approach for Bodily Nonverbal Communication

Non-verbal communication body cues are paramount to interact. In this preliminary work, we explore ways to let Intelligent Virtual Agents (IVAs) simulating nonverbal communication capabilities. We propose an approach to control IVAs' reactive behaviour from the analysis of other agents' apparent motions, in a situation of "observed" IVAs that act and "observers" that react. For that, first a viewpoint-driven analysis of the observed agent's motion is done, and then a synthesis of this analysis induces the observers' reaction.

[1]  W. Lamb.  Posture and gesture : an introduction to the study of physical behaviour , 1965 .

[2]  Catherine Pelachaud,et al.  Conversational Behavior Reflecting Interpersonal Attitudes in Small Group Interactions , 2015, IVA.

[3]  B. Gelder,et al.  Why bodies? Twelve reasons for including bodily expressions in affective neuroscience , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[4]  K. Scherer,et al.  The New Handbook of Methods in Nonverbal Behavior Research , 2008 .

[5]  Catherine Pelachaud,et al.  Expressive Body Animation Pipeline for Virtual Agent , 2012, IVA.

[6]  Paolo Dario,et al.  Expected perception: an anticipation-based perception-action scheme in robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[7]  Catherine Pelachaud,et al.  Towards a Socially Adaptive Virtual Agent , 2015, IVA.

[8]  Alexander Nareyek,et al.  INTEGRATING FACIAL , GESTURE , AND POSTURE EMOTION EXPRESSION FOR A 3 D VIRTUAL AGENT , 2009 .

[9]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[10]  Mubbasir Kapadia,et al.  An Interdependent Model of Personality, Motivation, Emotion, and Mood for Intelligent Virtual Agents , 2019, IVA.

[11]  Judee K. Burgoon,et al.  Nonverbal Communication Skills , 2003 .

[12]  Robert Gifford,et al.  Personality and Nonverbal Behavior: A Complex Conundrum , 2006 .

[13]  Dinesh Manocha,et al.  EVA: Generating Emotional Behavior of Virtual Agents using Expressive Features of Gait and Gaze , 2019, SAP.

[14]  Ana Paiva,et al.  Virtual Agents in Conflict , 2012, IVA.

[15]  Norman I. Badler,et al.  Real-time virtual humans , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[16]  Daniel Thalmann,et al.  Individualized reaction movements for virtual humans , 2006, GRAPHITE '06.

[17]  B. de Gelder.  Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. , 2009, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  Daniel Thalmann,et al.  Emotional face expression profiles supported by virtual human ontology , 2006, Comput. Animat. Virtual Worlds.

[19]  Daniel Thalmann,et al.  Nonverbal communication interface for collaborative virtual environments , 1999, Virtual Reality.

[20]  Ludovic Hoyet,et al.  Exploring the Effect of Motion Type and Emotions on the Perception of Gender in Virtual Humans , 2015, ACM Trans. Appl. Percept..

[21]  Andreas Aristidou,et al.  Emotion Recognition for Exergames using Laban Movement Analysis , 2013, MIG.

[22]  Catherine Pelachaud,et al.  Studies on gesture expressivity for a virtual agent , 2009, Speech Commun..

[23]  Fabri,et al.  Expressive Agents : Non-verbal Communication in Collaborative Virtual Environments , 2002 .

[24]  Michael Neff,et al.  Mimebot—Investigating the Expressibility of Non-Verbal Communication Across Agent Embodiments , 2017, ACM Trans. Appl. Percept..

[25]  Catherine Pelachaud,et al.  Modelling multimodal expression of emotion in a virtual agent , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  G. Aschersleben,et al.  Interactions between perception and action in a reaction task with overlapping S-R assignments , 2001, Psychological research.

[27]  Masaki Oshita,et al.  Expressive Human Pose Deformation Based on the Rules of Attractive Poses , 2017, ArtsIT/DLI.