Neural responses to visually observed social interactions

ABSTRACT Success in the social world requires the ability to perceive not just individuals and their actions, but pairs of people and the interactions between them. Despite the complexity of social interactions, humans are adept at interpreting those interactions they observe. Although the brain basis of this remarkable ability has remained relatively unexplored, converging functional MRI evidence suggests the posterior superior temporal sulcus (pSTS) is centrally involved. Here, we sought to determine whether this region is sensitive to both the presence of interactive information, as well as to the content of qualitatively different interactions (i.e. competition vs. cooperation). Using point‐light human figure stimuli, we demonstrate that the right pSTS is maximally activated when contrasting dyadic interactions vs. dyads performing independent, non‐interactive actions. We then used this task to localize the same pSTS region in an independent participant group, and tested responses to non‐human moving shape stimuli (i.e. two circles' movements conveying either interactive or non‐interactive behaviour). We observed significant support vector machine classification for both the presence and type of interaction (i.e. interaction vs. non‐interaction, and competition vs. cooperation, respectively) in the pSTS, as well as neighbouring temporo‐parietal junction (TPJ). These findings demonstrate the important role that these regions play in perceiving and understanding social interactions, and lay the foundations for further research to fully characterize interaction responses in these areas. HighlightsThe pSTS is sensitive to visual dynamic social interactions.We show that the pSTS is sensitive to both the presence & contents of interactions.This effect is independent of face & body information.

[1]  Béatrice de Gelder,et al.  Tease or threat? Judging social interactions from bodily expressions , 2010, NeuroImage.

[2]  Martin N. Hebart,et al.  The Decoding Toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data , 2015, Front. Neuroinform..

[3]  Gregory McCarthy,et al.  Attributing intentions to random motion engages the posterior superior temporal sulcus. , 2014, Social cognitive and affective neuroscience.

[4]  Rebecca Saxe,et al.  Live face-to-face interaction during fMRI: A new tool for social cognitive neuroscience , 2010, NeuroImage.

[5]  Hugh Silk The Power of a Handshake , 2019 .

[6]  Stefano F. Cappa,et al.  The Neural Bases of Social Intention Understanding: The Role of Interaction Goals , 2012, PloS one.

[7]  C. Frith,et al.  Movement and Mind: A Functional Imaging Study of Perception and Interpretation of Complex Intentional Movement Patterns , 2000, NeuroImage.

[8]  P. Downing,et al.  The lateral occipitotemporal cortex in action , 2015, Trends in Cognitive Sciences.

[9]  Mowei Shen,et al.  Two Equals One: Two Human Actions During Social Interaction Are Grouped as One Unit in Working Memory , 2017, Psychological science.

[10]  J. Perner,et al.  Neuroscience and Biobehavioral Reviews Fractionating Theory of Mind: a Meta-analysis of Functional Brain Imaging Studies , 2022 .

[11]  Salvador Soto-Faraco,et al.  The Two-Body Inversion Effect , 2017, Psychological science.

[12]  Paula Tavares,et al.  Paying attention to social meaning: an FMRI study. , 2008, Cerebral cortex.

[13]  Florin Dolcos,et al.  The Power of a Handshake: Neural Correlates of Evaluative Judgments in Observed Social Interactions , 2012, Journal of Cognitive Neuroscience.

[14]  Christopher Baldassano,et al.  Human‐Object Interactions Are More than the Sum of Their Parts , 2016, Cerebral cortex.

[15]  Cristina Becchio,et al.  Inferring intentions from biological motion: A stimulus set of point-light communicative interactions , 2010, Behavior research methods.

[16]  Russell A. Epstein,et al.  Neural Representations of Observed Actions Generalize across Static and Dynamic Visual Input , 2017, The Journal of Neuroscience.

[17]  Swann Pichon,et al.  Perceiving fear in dynamic body expressions , 2007, NeuroImage.

[18]  Aaron C. Koralek,et al.  Two Takes on the Social Brain: A Comparison of Theory of Mind Tasks , 2007, Journal of Cognitive Neuroscience.

[19]  Karl Verfaillie,et al.  Perception of biological motion: A stimulus set of human point-light actions , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[20]  Nancy Kanwisher,et al.  Functional Organization of Social Perception and Cognition in the Superior Temporal Sulcus , 2015, Cerebral cortex.

[21]  Karl J. Friston,et al.  Activation in Posterior Superior Temporal Sulcus Parallels Parameter Inducing the Percept of Animacy , 2005, Neuron.

[22]  Brian J Scholl,et al.  Dissociating the Detection of Intentionality from Animacy in the Right Posterior Superior Temporal Sulcus , 2012, The Journal of Neuroscience.

[23]  Alex Martin,et al.  NEURAL FOUNDATIONS FOR UNDERSTANDING SOCIAL AND MECHANICAL CONCEPTS , 2003, Cognitive neuropsychology.

[24]  Istvan Molnar-Szakacs,et al.  Watching social interactions produces dorsomedial prefrontal and medial parietal BOLD fMRI signal increases compared to a resting baseline , 2004, NeuroImage.

[25]  J. Sliwa,et al.  A dedicated network for social interaction processing in the primate brain , 2017, Science.

[26]  Kevin A. Pelphrey,et al.  Grasping the Intentions of Others: The Perceived Intentionality of an Action Influences Activity in the Superior Temporal Sulcus during Social Perception , 2004, Journal of Cognitive Neuroscience.

[27]  Mikko Sams,et al.  Naturalistic fMRI Mapping Reveals Superior Temporal Sulcus as the Hub for the Distributed Brain Network for Social Perception , 2012, Front. Hum. Neurosci..

[28]  N. Kanwisher,et al.  Perceiving social interactions in the posterior superior temporal sulcus , 2017, Proceedings of the National Academy of Sciences.

[29]  James Dungan,et al.  Distinct neural patterns of social cognition for cooperation versus competition , 2016, NeuroImage.

[30]  N. Kanwisher,et al.  The Human Body , 2001 .

[31]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[32]  Rebecca Saxe,et al.  fMRI item analysis in a theory of mind task , 2011, NeuroImage.

[33]  Alfonso Caramazza,et al.  Action categories in lateral occipitotemporal cortex are organized along sociality and transitivity. , 2016, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  T. Wolbers,et al.  Physiological Signal Variability in hMT+ Reflects Performance on a Direction Discrimination Task , 2011, Front. Psychology.

[35]  B. Argall,et al.  Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus , 2004, Neuron.

[36]  Andrew N. Meltzoff,et al.  The neural bases of cooperation and competition: an fMRI investigation , 2004, NeuroImage.

[37]  S. Quadflieg,et al.  The neuroscience of people watching: how the human brain makes sense of other people's encounters , 2017, Annals of the New York Academy of Sciences.

[38]  Jean-Luc Anton,et al.  Recruitment of Both the Mirror and the Mentalizing Networks When Observing Social Interactions Depicted by Point-Lights: A Neuroimaging Study , 2011, PloS one.

[39]  K. Vogeley,et al.  Toward a second-person neuroscience 1 , 2013, Behavioral and Brain Sciences.

[40]  D. Perrett,et al.  A region of right posterior superior temporal sulcus responds to observed intentional actions , 2004, Neuropsychologia.

[41]  M. Rushworth,et al.  Connectivity-based subdivisions of the human right "temporoparietal junction area": evidence for different areas participating in different cortical networks. , 2012, Cerebral cortex.

[42]  K. Pelphrey,et al.  An integrative neural model of social perception, action observation, and theory of mind , 2015, Neuroscience & Biobehavioral Reviews.

[43]  Mariko Osaka,et al.  Effect of Intentional Bias on Agency Attribution of Animated Motion: An Event-Related fMRI Study , 2012, PloS one.

[44]  Natacha S. Santos,et al.  Perceiving nonverbal behavior: Neural correlates of processing movement fluency and contingency in dyadic interactions , 2014, Human brain mapping.