Neural correlates of observing joint actions with shared intentions

Studies on the neural bases of action perception have largely focused on the perception of individual actions. Little is known about perception of joint actions where two or more individuals coordinate their actions based on a shared intention. In this fMRI study we asked whether observing situations where two individuals act on a shared intention elicits a different neural response than observing situations where individuals act on their independent parallel intentions. We compared the neural response to perceptually identical yet intentionally ambiguous actions observed in varying contexts. A dialog between two individuals conveyed either a shared intention or two independent parallel intentions. The dialogs were followed by an identical video clip where the two individuals performed certain actions. In one task condition participants tracked the intentions of the actors, in the other, they monitored moving colored dots placed on the same videos. We found that in the intention task versus the color task, observing joint actions based on shared intentions activated the temporal poles, precuneus, and the ventral striatum compared to observing interactions based on parallel intentions. Precuneus and the temporal poles are thought to support mental state reasoning, the latter with a more specific role in retrieving memories associated with social scripts. Activation in the ventral striatum, an area involved in reward processing, likely indicates a hedonistic response to observed shared intentional relations similarly to those experienced when personally sharing mental states with others.

[1]  C. Chiu,et al.  Birds of a feather and birds flocking together: physical versus behavioral cues may lead to trait- versus goal-based group perception. , 2006, Journal of personality and social psychology.

[2]  Roel M. Willems,et al.  Complementary Systems for Understanding Action Intentions , 2008, Current Biology.

[3]  J. Braithwaite,et al.  Seeing it their way: evidence for rapid and involuntary computation of what other people see. , 2010, Journal of experimental psychology. Human perception and performance.

[4]  G. Juckel,et al.  Cooperation and Deception Recruit Different Subsets of the Theory-of-Mind Network , 2008, PloS one.

[5]  Henrik Walter,et al.  Understanding Intentions in Social Interaction: The Role of the Anterior Paracingulate Cortex , 2004, Journal of Cognitive Neuroscience.

[6]  Hanneke E. M. den Ouden,et al.  Thinking about intentions , 2005, NeuroImage.

[7]  C. Macrae,et al.  The rhythm of rapport: Interpersonal synchrony and social perception , 2009 .

[8]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[9]  Michael E. Bratman,et al.  Shared Cooperative Activity , 1991 .

[10]  E. D. Paolo,et al.  Can social interaction constitute social cognition? , 2010, Trends in Cognitive Sciences.

[11]  R. E Passingham,et al.  Inferring false beliefs from the actions of oneself and others: an fMRI study , 2004, NeuroImage.

[12]  N. Andreasen,et al.  Visualizing how one brain understands another: a PET study of theory of mind. , 2003, The American journal of psychiatry.

[13]  A. Friederici,et al.  Time Perception and Motor Timing: A Common Cortical and Subcortical Basis Revealed by fMRI , 2000, NeuroImage.

[14]  Matthew F S Rushworth,et al.  The Computation of Social Behavior , 2009, Science.

[15]  Hein T. van Schie,et al.  Neural mechanisms underlying immediate and final action goals in object use reflected by slow wave brain potentials , 2007, Brain Research.

[16]  Nadim Joni Shah,et al.  Neural Representations of Self versus Other: Visual-Spatial Perspective Taking and Agency in a Virtual Ball-tossing Game , 2006, Journal of Cognitive Neuroscience.

[17]  Nadim Joni Shah,et al.  Duration matters: Dissociating neural correlates of detection and evaluation of social gaze , 2009, NeuroImage.

[18]  Christopher D. Frith,et al.  Imaging the Intentional Stance in a Competitive Game , 2002, NeuroImage.

[19]  Chris Moore,et al.  Young children overimitate in third-party contexts. , 2012, Journal of experimental child psychology.

[20]  N. Sadato,et al.  Processing of Social and Monetary Rewards in the Human Striatum , 2008, Neuron.

[21]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[22]  Vince D. Calhoun,et al.  Brain Activity Dissociates Mentalization from Motivation During an Interpersonal Competitive Game , 2009, Brain Imaging and Behavior.

[23]  Hannes Rakoczy,et al.  Minds, persons, and space: An fMRI investigation into the relational complexity of higher-order intentionality , 2008, Consciousness and Cognition.

[24]  C. Frith,et al.  Rapid Response Subject Collections , 2022 .

[25]  Philip R. Cohen,et al.  Collective Intentions and Actions , 2003 .

[26]  Umberto Castiello,et al.  Social grasping: From mirroring to mentalizing , 2012, NeuroImage.

[27]  Daniel Houser,et al.  A functional imaging study of cooperation in two-person reciprocal exchange , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Kai Vogeley,et al.  Why we interact: On the functional role of the striatum in the subjective experience of social interaction , 2014, NeuroImage.

[29]  U. Castiello,et al.  Cues to intention: The role of movement information , 2011, Cognition.

[30]  R. Saxe,et al.  Making sense of another mind: The role of the right temporo-parietal junction , 2005, Neuropsychologia.

[31]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[32]  Alan M. Leslie,et al.  Belief-desire reasoning as a process of selection , 2005, Cognitive Psychology.

[33]  Patrice D. Tremoulet,et al.  Perceptual causality and animacy , 2000, Trends in Cognitive Sciences.

[34]  Beate Sodian,et al.  Neural correlates of true and false belief reasoning , 2007, NeuroImage.

[35]  Rebecca Saxe,et al.  Live face-to-face interaction during fMRI: A new tool for social cognitive neuroscience , 2010, NeuroImage.

[36]  Cristina Becchio,et al.  Communicative Interactions Improve Visual Detection of Biological Motion , 2011, PloS one.

[37]  C. Frith,et al.  Movement and Mind: A Functional Imaging Study of Perception and Interpretation of Complex Intentional Movement Patterns , 2000, NeuroImage.

[38]  E. Funnell Evidence for scripts in semantic dementia: Implications for theories of semantic memory , 2001, Cognitive neuropsychology.

[39]  D. Lakens Movement synchrony and perceived entitativity , 2010 .

[40]  Lindsey J. Powell,et al.  It's the Thought That Counts , 2006, Psychological science.

[41]  Stefanie I. Becker,et al.  Implicit false-belief processing in the human brain , 2014, NeuroImage.

[42]  Béatrice de Gelder,et al.  Tease or threat? Judging social interactions from bodily expressions , 2010, NeuroImage.

[43]  B. Abler,et al.  Motivating forces of human actions Neuroimaging reward and social interaction , 2005, Brain Research Bulletin.

[44]  James K Rilling,et al.  The neural correlates of theory of mind within interpersonal interactions , 2004, NeuroImage.

[45]  Ingrid R. Olson,et al.  Social cognition and the anterior temporal lobes , 2010, NeuroImage.

[46]  J. Searle Consciousness and Language: Collective Intentions and Actions , 2002 .

[47]  Stephen Lawrie,et al.  Functional Specialization within Rostral Prefrontal Cortex (Area 10): A Meta-analysis , 2006, Journal of Cognitive Neuroscience.

[48]  Riitta Hari,et al.  Engagement of amygdala in third‐person view of face‐to‐face interaction , 2012, Human brain mapping.

[49]  C. Frith The social brain? , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  N. Akhtar,et al.  Imitative learning from a third-party interaction: relations with self-recognition and perspective taking. , 2008, Journal of experimental child psychology.

[51]  Ivan Toni,et al.  The role of immediate and final goals in action planning: An fMRI study , 2007, NeuroImage.

[52]  Eleanor A. Maguire,et al.  Spontaneous mentalizing during an interactive real world task: An fMRI study , 2006, Neuropsychologia.

[53]  Dylan D Wagner,et al.  Individual Differences in the Spontaneous Recruitment of Brain Regions Supporting Mental State Understanding When Viewing Natural Social Scenes , 2011 .

[54]  G. Pagnoni,et al.  A Neural Basis for Social Cooperation , 2002, Neuron.

[55]  N. Wright Let's work together , 1968 .

[56]  H. Walter,et al.  The intentional network: How the brain reads varieties of intentions , 2007, Neuropsychologia.

[57]  Jason P. Mitchell,et al.  Mentalizing under Uncertainty: Dissociated Neural Responses to Ambiguous and Unambiguous Mental State Inferences , 2009, Cerebral cortex.

[58]  A. Endress,et al.  The Social Sense: Susceptibility to Others’ Beliefs in Human Infants and Adults , 2010, Science.

[59]  M. Delgado,et al.  Motivation-dependent responses in the human caudate nucleus. , 2004, Cerebral cortex.

[60]  M. Jeannerod,et al.  The motor theory of social cognition: a critique , 2005, Trends in Cognitive Sciences.

[61]  David Baddeley,et al.  4D Super-Resolution Microscopy with Conventional Fluorophores and Single Wavelength Excitation in Optically Thick Cells and Tissues , 2011, PloS one.

[62]  Annette M. E. Henderson,et al.  “Let’s work together”: What do infants understand about collaborative goals? , 2011, Cognition.

[63]  D. Lakens,et al.  If They Move in Sync, They Must Feel in Sync: Movement Synchrony Leads to Attributions of Rapport and Entitativity , 2011 .

[64]  Georgene L. Troseth,et al.  Third-party social interaction and word learning from video. , 2011, Child development.

[65]  Margaret Gilbert,et al.  Shared intention and personal intentions , 2009 .

[66]  Jean-Luc Anton,et al.  Recruitment of Both the Mirror and the Mentalizing Networks When Observing Social Interactions Depicted by Point-Lights: A Neuroimaging Study , 2011, PloS one.

[67]  Istvan Molnar-Szakacs,et al.  Watching social interactions produces dorsomedial prefrontal and medial parietal BOLD fMRI signal increases compared to a resting baseline , 2004, NeuroImage.

[68]  M. Tomasello A Natural History of Human Thinking , 2014 .

[69]  Nadim Joni Shah,et al.  Minds Made for Sharing: Initiating Joint Attention Recruits Reward-related Neurocircuitry , 2010, Journal of Cognitive Neuroscience.

[70]  Luca Turella,et al.  Observing social interactions: The effect of gaze , 2008, Social neuroscience.

[71]  N. Sebanz,et al.  Do people automatically track others’ beliefs? Evidence from a continuous measure , 2014, Cognition.

[72]  S. Garrod,et al.  Opus: University of Bath Online Publication Store Look at Those Two! the Precuneus Role in Unattended Third-person Perspective of Social Interactions , 2022 .

[73]  Karl J. Friston,et al.  Spatial registration and normalization of images , 1995 .

[74]  David I. Perrett,et al.  An fMRI study of joint attention experience , 2005, NeuroImage.

[75]  C. Frith,et al.  Functional imaging of ‘theory of mind’ , 2003, Trends in Cognitive Sciences.

[76]  C. Moore,et al.  Intentional relations and social understanding , 1996, Behavioral and Brain Sciences.

[77]  Günther Knoblich,et al.  Observing shared attention modulates gaze following , 2011, Cognition.

[78]  L. Young,et al.  The Group-Member Mind Trade-Off , 2012, Psychological science.

[79]  A. Owen,et al.  Anterior prefrontal cortex: insights into function from anatomy and neuroimaging , 2004, Nature Reviews Neuroscience.

[80]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.