The Effects of Interpersonal Attitude of a Group of Agents on User’s Presence and Proxemics Behavior

In the everyday world people form small conversing groups where social interaction takes place, and much of the social behavior takes place through managing interpersonal space (i.e., proxemics) and group formation, signaling their attentio to others (i.e., through gaze behavior), and expressing certain attitudes, for example, friendliness, by smiling, getting close through increased engagement and intimacy, and welcoming newcomers. Many real-time interactive systems feature virtual anthropomorphic characters in order to simulate conversing groups and add plausibility and believability to the simulated environments. However, only a few have dealt with autonomous behavior generation, and in those cases, the agents’ exhibited behavior should be evaluated by users in terms of appropriateness, believability, and conveyed meaning (e.g., attitudes). In this article we present an integrated intelligent interactive system for generating believable nonverbal behavior exhibited by virtual agents in small simulated group conversations. The produced behavior supports group formation management and the expression of interpersonal attitudes (friendly vs. unfriendly) both among the agents in the group (i.e., in-group attitude) and towards an approaching user in an avatar-based interaction (out-group attitude). A user study investigating the effects of these attitudes on users’ social presence evaluation and proxemics behavior (with their avatar) in a three-dimensional virtual city environment is presented. We divided the study into two trials according to the task assigned to users, that is, joining a conversing group and reaching a target destination behind the group. Results showed that the out-group attitude had a major impact on social presence evaluations in both trials, whereby friendly groups were perceived as more socially rich. The user’s proxemics behavior depended on both out-group and in-group attitudes expressed by the agents. Implications of these results for the design and implementation of similar intelligent interactive systems for the autonomous generation of agents’ multimodal behavior are briefly discussed.

[1]  Mark T. Palmer,et al.  Interpersonal communication and virtual reality: mediating interpersonal relationships , 1995 .

[2]  Dirk Heylen,et al.  First impressions in user-agent encounters: the impact of an agent's nonverbal behavior on users' relational decisions , 2013, AAMAS.

[3]  C. O'Sullivan,et al.  Seeing is believing: body motion dominates in multisensory conversations , 2010, ACM Trans. Graph..

[4]  Birgit Endrass,et al.  Rapid prototyping of social group dynamics in multiagent systems , 2009, AI & SOCIETY.

[5]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[6]  D. Ballin,et al.  A framework for interpersonal attitude and non-verbal communication in improvisational visual media production , 2004 .

[7]  J. V. Bradley.  Complete Counterbalancing of Immediate Sequential Effects in a Latin Square Design , 1958 .

[8]  Hannes Högni Vilhjálmsson,et al.  Prediction in social path following , 2014, MIG.

[9]  Catherine Pelachaud,et al.  Suggestions for Extending SAIBA with the VIB Platform , 2014 .

[10]  A. Mehrabian.  Significance of posture and posiion in the communication of attitude and status relationships. , 1969, Psychological bulletin.

[11]  Maxim J. Schlossberg.  Our Sweetest Hours: Recreation and the Mental State of Absorption. , 1990 .

[12]  J. Burgoon,et al.  Nonverbal cues and interpersonal judgments: Participant and observer perceptions of intimacy, dominance, composure, and formality , 1999 .

[13]  E. Hall,et al.  The Hidden Dimension , 1970 .

[14]  R. D'Agostino.  Transformation to normality of the null distribution of g1 , 1970 .

[15]  Jerold L. Hale,et al.  Relational Messages Associated with Nonverbal Behaviors. , 1984 .

[16]  Douglas G. Altman,et al.  Statistics Notes: Transforming data , 1996 .

[17]  David R. Traum,et al.  Dynamic movement and positioning of embodied agents in multiparty conversations , 2007, AAMAS '07.

[18]  Mel Slater,et al.  Spatial Social Behavior in Second Life , 2007, IVA.

[19]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[20]  F. Atelsek,et al.  Firo: A Three-Dimensional Theory of Interpersonal Behavior , 1959 .

[21]  Maja J. Mataric,et al.  Automated Proxemic Feature Extraction and Behavior Recognition: Applications in Human-Robot Interaction , 2013, Int. J. Soc. Robotics.

[22]  Kipling D. Williams,et al.  Virtually Ostracized: Studying Ostracism in Immersive Virtual Environments , 2012, Cyberpsychology Behav. Soc. Netw..

[23]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[24]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[25]  Mel Slater,et al.  Proxemics with multiple dynamic characters in an immersive virtual environment , 2010, TAP.

[26]  V. Yngve.  On getting a word in edgewise , 1970 .

[27]  Vittorio Murino,et al.  Towards Computational Proxemics: Inferring Social Relations from Interpersonal Distances , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[28]  Catherine Pelachaud,et al.  Conversational Behavior Reflecting Interpersonal Attitudes in Small Group Interactions , 2015, IVA.

[29]  Gene Quarrick.  Our Sweetest Hours: Recreation and the Mental State of Absorption , 1989 .

[30]  A. Mehrabian.  Some referents and measures of nonverbal behavior , 1968 .

[31]  John Short,et al.  The social psychology of telecommunications , 1976 .

[32]  Ralph Schroeder,et al.  Small-Group Behavior in a Virtual and Real Environment: A Comparative Study , 2000, Presence: Teleoperators & Virtual Environments.

[33]  Elisabetta Bevacqua,et al.  Multimodal Backchannels for Embodied Conversational Agents , 2010, IVA.

[34]  Stefan Kopp,et al.  The Next Step towards a Function Markup Language , 2008, IVA.

[35]  A. Mehrabian.  Silent Messages: Implicit Communication of Emotions and Attitudes , 1971 .

[36]  Brett Stevens,et al.  Emotional body language displayed by artificial agents , 2012, TIIS.

[37]  Carol O'Sullivan,et al.  Perceptually plausible formations for virtual conversers , 2012, Comput. Animat. Virtual Worlds.

[38]  M. Argyle.  Bodily communication, 2nd ed. , 1988 .

[39]  Stacy Marsella,et al.  Modeling Side Participants and Bystanders: The Importance of Being a Laugh Track , 2011, IVA.

[40]  Takayuki Kanda,et al.  Conversational gaze mechanisms for humanlike robots , 2012, TIIS.

[41]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[42]  Catherine Pelachaud,et al.  From Non-verbal Signals Sequence Mining to Bayesian Networks for Interpersonal Attitudes Expression , 2014, IVA.

[43]  Jeremy N. Bailenson,et al.  The Unbearable Likeness of Being Digital: The Persistence of Nonverbal Social Norms in Online Virtual Environments , 2007, Cyberpsychology Behav. Soc. Netw..

[44]  D. McNeill.  Hand and Mind , 1995 .

[45]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[46]  Ionut Damian,et al.  Natural interaction with culturally adaptive virtual characters , 2012, Journal on Multimodal User Interfaces.

[47]  Takayuki Kanda,et al.  Friendly Patrolling: A Model of Natural Encounters , 2011, Robotics: Science and Systems.

[48]  Hannes Högni Vilhjálmsson,et al.  Lifelike interactive characters with behavior trees for social territorial intelligence , 2012, SIGGRAPH '12.

[49]  Catherine Pelachaud,et al.  From a User-created Corpus of Virtual Agent's Non-verbal Behavior to a Computational Model of Interpersonal Attitudes , 2013, IVA.

[50]  Tom Duckett,et al.  From Individual Characters to Large Crowds: Augmenting the Believability of Open-World Games through Exploring Social Emotion in Pedestrian Groups , 2011, DiGRA Conference.

[51]  Bilge Mutlu,et al.  How social distance shapes human-robot interaction , 2014, Int. J. Hum. Comput. Stud..

[52]  L. Smith-Lovin,et al.  INTERRUPTIONS IN GROUP DISCUSSIONS: THE EFFECTS OF GENDER AND GROUP COMPOSITION* , 1989 .

[53]  Catherine Pelachaud,et al.  Interpersonal Attitude of a Speaking Agent in Simulated Group Conversations , 2014, IVA.

[54]  A. Scheflen,et al.  Human territories : how we behave in space-time , 1976 .

[55]  Angelo Cangelosi,et al.  ACM Transactions on Interactive Intelligent Systems (TiiS) Special Issue on Trust and Influence in Intelligent Human-Machine Interaction , 2018, ACM Trans. Interact. Intell. Syst..

[56]  Jerold L. Hale,et al.  The fundamental topoi of relational communication , 1984 .

[57]  Gamini Dissanayake,et al.  Nonverbal robot-group interaction using an imitated gaze cue , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[58]  Clyde Kluckhohn,et al.  Human Behavior and the Principle of Least Effort. George Kingsley Zipf , 1950 .

[59]  Hannes Högni Vilhjálmsson,et al.  SPONTANEOUS AVATAR BEHAVIOR FOR HUMAN TERRITORIALITY , 2010, Appl. Artif. Intell..

[60]  Craig W. Reynolds.  Steering Behaviors For Autonomous Characters , 1999 .

[61]  J. Loomis,et al.  Interpersonal Distance in Immersive Virtual Environments , 2003, Personality & social psychology bulletin.

[62]  Julien Pettré,et al.  Going Through, Going Around: A Study on Individual Avoidance of Groups , 2015, IEEE Transactions on Visualization and Computer Graphics.

[63]  Gwenn Englebienne,et al.  Dynamics of social positioning patterns in group-robot interactions , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[64]  F. Biocca,et al.  Communication in the age of virtual reality , 1995 .

[65]  Michael Argyle,et al.  The communication of friendly and hostile attitudes by verbal and non‐verbal signals , 1971 .

[66]  Yukiko I. Nakano,et al.  Investigating culture-related aspects of behavior for virtual characters , 2013, Autonomous Agents and Multi-Agent Systems.

[67]  Ana Paiva,et al.  Believable groups of synthetic characters , 2005, AAMAS '05.

[68]  Nasser Nassiri,et al.  Human interactions and personal space in collaborative virtual environments , 2010, Virtual Reality.

[69]  Lauren I. Labrecque.  Fostering Consumer–Brand Relationships in Social Media Environments: The Role of Parasocial Interaction , 2014 .

[70]  A. Kendon.  Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[71]  Dirk Heylen,et al.  First Impressions: Users' Judgments of Virtual Agents' Personality and Interpersonal Attitude in First Encounters , 2012, IVA.

[72]  Petri Lankoski.  Character-driven game design : a design approach and its foundations in character engagement , 2010 .

[73]  Masafumi Nishida,et al.  Gaze and turn-taking behavior in casual conversational interactions , 2013, TIIS.

[74]  Marta Kristín Lárusdóttir,et al.  Avatars in Conversation: The Importance of Simulating Territorial Behavior , 2010, IVA.

[75]  Brett A.S. Martin,et al.  Forming Parasocial Relationships in Online Communities , 2005 .