Effect of the Opponent's Appearance on Interpersonal Cognition that Affects User-to-User Relationship in Virtual Whole-Body Interaction

People infer the internal characteristics (attitude, intent, thoughts, ability, relationship, etc.) of others (interpersonal cognition, IC) from the impressions they form from the personality or attributes of those others (impression formation). Studies premised on interpersonal communication in a seated condition have confirmed that, regardless of whether the communication is in the real world or in a media environment, the appearance of the other person affects IC and the outcome of the communication. People also develop relationships based on impressions or images of the other party. The psychological relationship manifests in physical relationships, that is, the relative positions of the body or the movement. In this study, we evaluate the effects of the appearance of the opponent’s avatar on the players’ IC in whole-body interaction taking place in a virtual reality (VR) space. Moreover, we examine the feasibility of constructing a method of changing the players’ relationship in interpersonal interactions that accompany the control and interference of the entire body, “whole-body interaction,” by manipulating their appearances. In this study, we selected the party game Twister as a case model of whole-body interaction and developed a system that allows users to play Twister in VR space. Using this system environment, we conducted an experiment to evaluate the players’ IC based on the gender and realism of the opponent’s avatar. The results showed that differences in the appearance of the opponent’s avatar affected the IC of male players. We also indicated that changes in IC observed in the experiment can affect the players’ relationship, thus identifying issues that must be resolved in order to realize the method.

[1]  Takuji Narumi,et al.  Gender-Impression Modification Enhances the Effect of Mediated Social Touch Between Persons of the Same Gender , 2016 .

[2]  Takanori Komatsu,et al.  Comparing an On-Screen Agent with a Robotic Agent in Non-Face-to-Face Interactions , 2008, IVA.

[3]  M. Tsakiris,et al.  Action sounds recalibrate perceived tactile distance , 2012, Current Biology.

[4]  Konstantinos Chorianopoulos,et al.  The effects of Avatars’ Gender and Appearance on Social Behavior in Online 3D Virtual Worlds , 2010 .

[5]  A. Galinsky,et al.  Why It Pays to Get Inside the Head of Your Opponent The Differential Effects of Perspective Taking and Empathy in Strategic Interactions , 2022 .

[6]  F. McGlone,et al.  Social touch and human development , 2018, Developmental Cognitive Neuroscience.

[7]  Larry F. Hodges,et al.  Can a virtual cat persuade you?: the role of gender and realism in speaker persuasiveness , 2006, CHI.

[8]  J. Bailenson,et al.  The Proteus Effect: The Effect of Transformed Self-Representation on Behavior , 2007 .

[9]  L. DeBruine,et al.  Facial resemblance increases the attractiveness of same–sex faces more than other–sex faces , 2004, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  Takafumi Sakamoto,et al.  Simulation of Spatial Behavior Based on an Agent Model in Human-Agent Initial Interaction , 2018, HAI.

[11]  Honest Signals , 2020, God Had a Body.

[12]  A. Mehrabian,et al.  Inference of attitudes from nonverbal communication in two channels. , 1967, Journal of consulting psychology.

[13]  K. Scherer.  Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[14]  Lynne Y. Williams,et al.  Gender patterns in social touch: the impact of setting and age. , 1990, Journal of personality and social psychology.

[15]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[16]  Takuji Narumi,et al.  Smart Face: enhancing creativity during video conferences using real-time facial deformation , 2014, CSCW.

[17]  M. Argyle,et al.  EYE-CONTACT, DISTANCE AND AFFILIATION. , 1965, Sociometry.

[18]  Maya B. Mathur,et al.  Navigating a social world with robot partners: A quantitative cartography of the Uncanny Valley , 2016, Cognition.

[19]  L. DeBruine.  Facial resemblance enhances trust , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[20]  A. Day,et al.  An Exploratory Investigation of the Process of Perspective Taking in Interpersonal Situations , 2013, Journal of Relationships Research.

[21]  E. Berscheid,et al.  What is beautiful is good. , 1972, Journal of personality and social psychology.

[22]  Mel Slater,et al.  Virtually Being Einstein Results in an Improvement in Cognitive Task Performance and a Decrease in Age Bias , 2018, Front. Psychol..

[23]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[24]  Hiroshi Ishiguro,et al.  Survey of Social Touch Interaction Between Humans and Robots , 2020, J. Robotics Mechatronics.

[25]  Takuji Narumi,et al.  Double Shellf: What Psychological Effects can be Caused through Interaction with a Doppelganger? , 2019, AH.

[26]  Mark T. Greenberg,et al.  The Early Development of Conceptual Perspective Taking: Distinguishing among Multiple Perspectives , 1976 .

[27]  John E. Hunter,et al.  Physical attractiveness and intellectual competence : a meta-analytic review , 1995 .

[28]  Reginald B. Adams,et al.  The Intersection of Gender-Related Facial Appearance and Facial Displays of Emotion , 2015 .