The social perceptual salience effect.

Affective processes appraise the salience of external stimuli preparing the agent for action. So far, the relationship between stimuli, affect, and action has been mainly studied in highly controlled laboratory conditions. In order to find the generalization of this relationship to social interaction, we assess the influence of the salience of social stimuli on human interaction. We constructed reality ball game in a mixed reality space where pairs of people collaborated in order to compete with an opposing team. We coupled the players with team members with varying social salience by using both physical and virtual representations of remote players (i.e., avatars). We observe that, irrespective of the team composition, winners and losers display significantly different inter- and intrateam spatial behaviors. We show that subjects regulate their interpersonal distance to both virtual and physical team members in similar ways, but in proportion to the vividness of the stimulus. As an independent validation of this social salience effect, we show that this behavioral effect is also displayed in physiological correlates of arousal. In addition, we found a strong correlation between performance, physiology, and the subjective reports of the subjects. Our results show that proxemics is consistent with affective responses, confirming the existence of a social salience effect. This provides further support for the so-called law of apparent reality, and it generalizes it to the social realm, where it can be used to design more efficient social artifacts.

[1]  Eugene Borgida,et al.  The Differential Impact of Abstract vs. Concrete Information on Decisions , 1977 .

[2]  Jeremy N. Bailenson,et al.  Detecting digital chameleons , 2008, Comput. Hum. Behav..

[3]  Paul F. M. J. Verschure,et al.  Allostatic Control for Robot Behavior Regulation: a Comparative Rodent-Robot Study , 2010, Adv. Complex Syst..

[4]  Jay Schulkin Rethinking Homeostasis: Allostatic Regulation in Physiology and Pathophysiology , 2002 .

[5]  Shelley E. Taylor,et al.  Social cognition, 2nd ed. , 1991 .

[6]  Tobi Delbrück,et al.  Ada - intelligent space: an artificial creature for the SwissExpo.02 , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[7]  U. Rajendra Acharya,et al.  Heart rate variability: a review , 2006, Medical and Biological Engineering and Computing.

[8]  Márcio O. Costa,et al.  Design for a Brain Revisited: The Neuromorphic Design and Functionality of the Interactive Space 'Ada' , 2003, Reviews in the neurosciences.

[9]  J. Mccroskey,et al.  Nonverbal Behavior in Interpersonal Relations , 1987 .

[10]  A. Craig The sentient self , 2010, Brain Structure and Function.

[11]  Brian Sternthal,et al.  Examining the Vividness Controversy: An Availability-Valence Interpretation , 1986 .

[12]  B. Latané,et al.  The Unresponsive Bystander: Why Doesn't He Help? , 1972 .

[13]  Daniel P. Kennedy,et al.  Personal Space Regulation by the Human Amygdala , 2009, Nature Neuroscience.

[14]  Aleksander Väljamäe,et al.  Quantifying human subjective experience and social interaction using the eXperience Induction Machine , 2011, Brain Research Bulletin.

[15]  Joseph E LeDoux The emotional brain , 1996 .

[16]  T. Jones,et al.  Interpersonal distance, body orientation, and touch: effects of culture, gender, and age. , 1995, The Journal of social psychology.

[17]  A. Damasio,et al.  Individuals with sociopathic behavior caused by frontal damage fail to respond autonomically to social stimuli , 1990, Behavioural Brain Research.

[18]  Paul F. M. J. Verschure,et al.  A Novel Brain-Based Approach for Multi-Modal Multi- Target Tracking in a Mixed Reality Space , 2007 .

[19]  Dan J Stein,et al.  Social anxiety disorder , 2008, The Lancet.

[20]  Ray L. Birdwhistell,et al.  Introduction to kinesics : an annotation system for analysis of body motion and gesture , 1952 .

[21]  L. Hayduk,et al.  Personal Space: An Evaluative and Orienting Overview. , 1978 .

[22]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[23]  A. Baddeley,et al.  Working memory and the vividness of imagery. , 2000, Journal of experimental psychology. General.

[24]  Jônatas Manzolli,et al.  The eXperience Induction Machine: A New Paradigm for Mixed-Reality Interaction Design and Psychological Experimentation , 2010, The Engineering of Mixed Reality Systems.

[25]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.

[26]  R. Haase,et al.  Power of nonverbal cues in counseling interactions: Availability, vividness, or salience? , 1985 .

[27]  N. Frijda,et al.  Emotions and respiratory patterns: review and critical analysis. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  Joseph E LeDoux Emotion: clues from the brain. , 1995, Annual review of psychology.

[29]  A. Bandura Social learning theory , 1977 .

[30]  Paul F. M. J. Verschure,et al.  Social cooperation and competition in the mixed reality space eXperience Induction Machine XIM , 2009, Virtual Reality.

[31]  Jeremy N. Bailenson Keynote speaker: Infinite reality: Avatars, eternal life, new worlds, and the dawn of the virtual revolution , 2013, VR.

[32]  W. Bridger,et al.  A COMPARISON OF GSR FEAR RESPONSES PRODUCED BY THREAT AND ELECTRIC SHOCK. , 1964, Journal of psychiatric research.

[33]  Jeremy N. Bailenson,et al.  The Unbearable Likeness of Being Digital: The Persistence of Nonverbal Social Norms in Online Virtual Environments , 2007, Cyberpsychology Behav. Soc. Netw..

[34]  Marco Leyton,et al.  The role of serotonin in human mood and social interaction Insight from altered tryptophan levels , 2002, Pharmacology Biochemistry and Behavior.

[35]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[36]  H. Ishiguro,et al.  The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions , 2011, Social cognitive and affective neuroscience.

[37]  M. Baldassare Human Spatial Behavior , 1978 .

[38]  Paul F. M. J. Verschure,et al.  An interactive space that learns to influence human behavior , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[39]  Tobi Delbrück,et al.  A tactile luminous floor for an interactive autonomous space , 2007, Robotics Auton. Syst..

[40]  P. Lang The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[41]  E. Hall,et al.  The Hidden Dimension , 1970 .

[42]  S. A. Neumann,et al.  Similar patterns of cardiovascular response during emotional activation as a function of affective valence and arousal and gender. , 2001, Journal of psychosomatic research.

[43]  Marika Lüders Book review: Being There Together: Social Interaction in Virtual Environments , 2011, New Media Soc..

[44]  D. Lloyd,et al.  The space between us: A neurophilosophical framework for the investigation of human interpersonal space , 2009, Neuroscience & Biobehavioral Reviews.

[45]  J. Decety,et al.  From the perception of action to the understanding of intention , 2001, Nature reviews. Neuroscience.

[46]  Tommy Gärling,et al.  EFFECTS OF INTERACTIONAL SPACE ON NEIGHBOURING , 1997 .

[47]  Robert Sommer,et al.  Personal space : the behavioral basis of design , 1970 .

[48]  P. Emmelkamp Technological Innovations in Clinical Assessment and Psychotherapy , 2005, Psychotherapy and Psychosomatics.

[49]  Edward T. Hall,et al.  A System for the Notation of Proxemic Behavior1 , 1963 .

[50]  A. Damasio The somatic marker hypothesis and the possible functions of the prefrontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[51]  S. Folkman,et al.  Stress, appraisal, and coping , 1974 .

[52]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[53]  Chrysa D. Lithari,et al.  Are Females More Responsive to Emotional Stimuli? A Neurophysiological Study Across Arousal and Valence Dimensions , 2009, Brain Topography.

[54]  J. Wesley Burgess,et al.  Interpersonal spacing behavior between surrounding nearest neighbors reflects both familiarity and environmental density , 1983 .

[55]  Tobi Delbrück,et al.  An Investigation of Collective Human Behavior in Large-Scale Mixed Reality Spaces , 2006, PRESENCE: Teleoperators and Virtual Environments.

[56]  A. J. Fridlund Sociality of Solitary Smiling: Potentiation by an Implicit Audience , 1991 .

[57]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962 .

[58]  Paul F. M. J. Verschure,et al.  PASAR: An integrated model of prediction, anticipation, sensation, attention and response for artificial sensorimotor systems , 2012, Inf. Sci..

[59]  Paul F. M. J. Verschure,et al.  A real-world rational agent: unifying old and new AI , 2003 .

[60]  Shelley E. Taylor,et al.  Stalking the elusive "vividness" effect. , 1982 .

[61]  K. Scherer The dynamic architecture of emotion: Evidence for the component process model , 2009 .

[62]  Alan D. Castel,et al.  Seeing is believing: The effect of brain images on judgments of scientific reasoning , 2008, Cognition.

[63]  D. Blanchard,et al.  Antipredator defensive behaviors in a visible burrow system. , 1989, Journal of comparative psychology.

[64]  A. Manstead,et al.  Arousal, cognition and emotion: an appraisal of two-factor theory , 1981 .

[65]  J. Gray,et al.  Brain systems that mediate both emotion and cognition. , 1990 .

[66]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[67]  Joseph E LeDoux Rethinking the Emotional Brain , 2012, Neuron.

[68]  B. Latané,et al.  Bystander intervention in emergencies: diffusion of responsibility. , 1968, Journal of personality and social psychology.

[69]  Ulysses Bernardet The eXperience Induction Machine and its Role in the Research on Presence , 2007 .

[70]  G. Evans,et al.  The role of interior design elements in human responses to crowding. , 1996 .