Plasticity in unimodal and multimodal brain areas reflects multisensory changes in self-face identification.

Nothing provides as strong a sense of self as seeing one's face. Nevertheless, it remains unknown how the brain processes the sense of self during the multisensory experience of looking at one's face in a mirror. Synchronized visuo-tactile stimulation on one's own and another's face, an experience that is akin to looking in the mirror but seeing another's face, causes the illusory experience of ownership over the other person's face and changes in self-recognition. Here, we investigate the neural correlates of this enfacement illusion using fMRI. We examine activity in the human brain as participants experience tactile stimulation delivered to their face, while observing either temporally synchronous or asynchronous tactile stimulation delivered to another's face on either a specularly congruent or incongruent location. Activity in the multisensory right temporo-parietal junction, intraparietal sulcus, and the unimodal inferior occipital gyrus showed an interaction between the synchronicity and the congruency of the stimulation and varied with the self-reported strength of the illusory experience, which was recorded after each stimulation block. Our results highlight the important interplay between unimodal and multimodal information processing for self-face recognition, and elucidate the neurobiological basis for the plasticity required for identifying with our continuously changing visual appearance.

[1]  Ana Tajadura-Jiménez,et al.  The person in the mirror: Using the enfacement illusion to investigate the experiential structure of self-identification , 2012, Consciousness and Cognition.

[2]  E. Cabanis,et al.  The Human Brain: Surface, Three-Dimensional Sectional Anatomy and Mri , 1991 .

[3]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[4]  M. Sereno,et al.  Mapping multisensory parietal face and body areas in humans , 2012, Proceedings of the National Academy of Sciences.

[5]  Francesco Pavani,et al.  Synchronous Multisensory Stimulation Blurs Self-Other Boundaries , 2010, Psychological science.

[6]  C. Frith,et al.  The Neural Basis of Mentalizing , 2006, Neuron.

[7]  Olaf Blanke,et al.  Out-of-body experience, heautoscopy, and autoscopic hallucination of neurological origin Implications for neurocognitive mechanisms of corporeal awareness and self-consciousness , 2005, Brain Research Reviews.

[8]  Susan Carey,et al.  Developmental changes within the core of artifact concepts , 2001, Cognition.

[9]  H. Ehrsson The Experimental Induction of Out-of-Body Experiences , 2007, Science.

[10]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[11]  T. Allison,et al.  Social perception from visual cues: role of the STS region , 2000, Trends in Cognitive Sciences.

[12]  M. Goldberg,et al.  Ventral intraparietal area of the macaque: congruent visual and somatic response properties. , 1998, Journal of neurophysiology.

[13]  P. Benson,et al.  Towards a functional neuroanatomy of self processing: effects of faces and words. , 2000, Brain research. Cognitive brain research.

[14]  Thomas Suddendorf,et al.  Visual self-recognition in mirrors and live videos: Evidence for a developmental asynchrony , 2007 .

[15]  Marco Iacoboni,et al.  The self across the senses: an fMRI study of self-face and self-voice recognition. , 2008, Social cognitive and affective neuroscience.

[16]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[17]  Steven M. Platek,et al.  Neural correlates of self-face recognition: An effect-location meta-analysis , 2008, Brain Research.

[18]  Josef Perner,et al.  Temporo-parietal Junction Activity in Theory-of-Mind Tasks: Falseness, Beliefs, or Attention , 2009, Journal of Cognitive Neuroscience.

[19]  Nancy Kanwisher,et al.  The Functional Architecture of the Face System: integrating Evidence from fMRI and Patient Studies , 2011 .

[20]  D. Pandya,et al.  Parietal, temporal, and occipita projections to cortex of the superior temporal sulcus in the rhesus monkey: A retrograde tracer study , 1994, The Journal of comparative neurology.

[21]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[22]  J. Barton Structure and function in acquired prosopagnosia: lessons from a series of 10 patients with brain damage. , 2008, Journal of neuropsychology.

[23]  Caren M. Walker,et al.  Mental state attribution and the temporoparietal junction: An fMRI study comparing belief, emotion, and perception , 2010, Neuropsychologia.

[24]  Ruey-Song Huang,et al.  Dodecapus: An MR-compatible system for somatosensory stimulation , 2007, NeuroImage.

[25]  Martin Tegenthoff,et al.  An rTMS study into self-face recognition using video-morphing technique. , 2011, Social cognitive and affective neuroscience.

[26]  Gian Luca Romani,et al.  Viewing One's Own Face Being Touched Modulates Tactile Perception: An fMRI Study , 2011, Journal of Cognitive Neuroscience.

[27]  Kosha Ruparel,et al.  Neural substrates for functionally discriminating self‐face from personally familiar faces , 2006, Human brain mapping.

[28]  Istvan Molnar-Szakacs,et al.  rTMS to the right inferior parietal lobule disrupts self-other discrimination. , 2006, Social cognitive and affective neuroscience.

[29]  Gordon G. Gallup,et al.  Which Primates Recognize Themselves in Mirrors? , 2011, PLoS biology.

[30]  Geoffrey Bird,et al.  Enhancing Social Ability by Stimulating Right Temporoparietal Junction Tdcs of Right Tpj , 2022 .

[31]  D. Pandya,et al.  Converging visual and somatic sensory cortical input to the intraparietal sulcus of the rhesus monkey , 1980, Brain Research.

[32]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[33]  Uta Frith,et al.  Theory of mind , 2001, Current Biology.

[34]  D. Pandya,et al.  Distinct Parietal and Temporal Pathways to the Homologues of Broca's Area in the Monkey , 2009, PLoS biology.

[35]  Ana Tajadura-Jiménez,et al.  It feels like it's me: interpersonal multisensory stimulation enhances visual remapping of touch from other to self. , 2013, Journal of experimental psychology. Human perception and performance.

[36]  Shigeru Sato,et al.  Face-specific and domain-general characteristics of cortical responses during self-recognition , 2008, NeuroImage.

[37]  A. Pouget,et al.  Reference frames for representing visual and tactile locations in parietal cortex , 2005, Nature Neuroscience.

[38]  D. Pandya,et al.  Efferent cortical connections of multimodal cortex of the superior temporal sulcus in the rhesus monkey , 1992, The Journal of comparative neurology.

[39]  M. Tsakiris Looking for Myself: Current Multisensory Input Alters Self-Face Recognition , 2008, PloS one.

[40]  Ana Tajadura-Jiménez,et al.  The different faces of one's self: An fMRI study into the recognition of current and past self-facial appearances , 2012, NeuroImage.

[41]  O. Blanke,et al.  The thalamocortical vestibular system in animals and humans , 2011, Brain Research Reviews.

[42]  J. Maunsell,et al.  Touching a Rubber Hand: Feeling of Body Ownership Is Associated with Activity in Multisensory Brain Areas , 2005, The Journal of Neuroscience.

[43]  Valeria I. Petkova,et al.  fMRI Adaptation Reveals a Cortical Mechanism for the Coding of Space Near the Hand , 2011, The Journal of Neuroscience.

[44]  S. Platek,et al.  Is family special to the brain? An event-related fMRI study of familiar, familial, and self-face recognition , 2009, Neuropsychologia.

[45]  D. Pandya,et al.  Posterior parietal projections to the intraparietal sulcus of the rhesus monkey , 2004, Experimental Brain Research.

[46]  A. Young,et al.  Neuropsychology of fear and loathing , 2001 .

[47]  D. Pandya,et al.  Frontal lobe connections of the superior temporal sulcus in the rhesus monkey , 1989, The Journal of comparative neurology.

[48]  Salvatore Maria Aglioti,et al.  My face in yours: Visuo-tactile facial stimulation influences sense of identity , 2010, Social neuroscience.

[49]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[50]  Edward T. Bullmore,et al.  Specialization of right temporo-parietal junction for mentalizing and its relation to social impairments in autism , 2011, NeuroImage.

[51]  Manos Tsakiris,et al.  Trust in Me , 2014, Psychological science.

[52]  P. Ruby,et al.  What is self-specific? Theoretical investigation and critical review of neuroimaging results. , 2009, Psychological review.

[53]  J. R. Augustine Circuitry and functional aspects of the insular lobe in primates including humans , 1996, Brain Research Reviews.

[54]  Henrik Walter,et al.  Functional relations of empathy and mentalizing: An fMRI study on the neural basis of cognitive empathy , 2011, NeuroImage.

[55]  P. C. Murphy,et al.  Cerebral Cortex , 2017, Cerebral Cortex.

[56]  H. Duvernoy The Human Brain Stem and Cerebellum: Surface, Structure, Vascularization, and Three-Dimensional Sectional Anatomy, with MRI , 2013 .

[57]  O. Blanke Multisensory brain mechanisms of bodily self-consciousness , 2012, Nature Reviews Neuroscience.

[58]  M. Tsakiris My body in the brain: A neurocognitive model of body-ownership , 2010, Neuropsychologia.

[59]  C. Degueldre,et al.  Here I am: The cortical correlates of visual self-recognition , 2007, Brain Research.

[60]  C. Spence,et al.  Seeing Your Own Touched Hands in a Mirror Modulates Cross-Modal Interactions , 2002, Psychological science.

[61]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[62]  Serge Brédart,et al.  The neural correlates of visual self-recognition , 2011, Consciousness and Cognition.

[63]  Shihui Han,et al.  Functional dissociation of the left and right fusiform gyrus in self‐face recognition , 2012, Human brain mapping.

[64]  Thomas W. Schubert,et al.  Self-other bodily merging in the context of synchronous but arbitrary-related multisensory inputs , 2011, Experimental Brain Research.

[65]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[66]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[67]  George R. Mangun,et al.  Right temporoparietal junction activation by a salient contextual cue facilitates target discrimination , 2011, NeuroImage.

[68]  G. Gallup Chimpanzees: Self-Recognition , 1970, Science.

[69]  Peter Bossaerts,et al.  Neural correlates of mentalizing-related computations during strategic interactions in humans , 2008, Proceedings of the National Academy of Sciences.

[70]  Gordon G. Gallup,et al.  Self-recognition in chimpanzees and orangutans, but not gorillas , 1981 .

[71]  Valeria I. Petkova,et al.  From Part- to Whole-Body Ownership in the Multisensory Brain , 2011, Current Biology.

[72]  H. Ehrsson,et al.  That's Near My Hand! Parietal and Premotor Coding of Hand-Centered Space Contributes to Localization and Self-Attribution of the Hand , 2012, Journal of Neuroscience.

[73]  D. Perrett,et al.  From single cells to social perception , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[74]  M. Rushworth,et al.  Connectivity-based subdivisions of the human right "temporoparietal junction area": evidence for different areas participating in different cortical networks. , 2012, Cerebral cortex.

[75]  Istvan Molnar-Szakacs,et al.  Self-face recognition activates a frontoparietal “mirror” network in the right hemisphere: an event-related fMRI study , 2005, NeuroImage.

[76]  P. B. Cipolloni,et al.  Cortical connections of the frontoparietal opercular areas in the Rhesus monkey , 1999, The Journal of comparative neurology.

[77]  Ana Tajadura-Jiménez,et al.  The Other in Me: Interpersonal Multisensory Stimulation Changes the Mental Representation of the Self , 2011, PloS one.

[78]  Scott Peltier,et al.  Differential neural activity and connectivity for processing one's own face: A preliminary report , 2011, Psychiatry Research: Neuroimaging.

[79]  S. Huettel,et al.  A Distinct Role of the Temporal-Parietal Junction in Predicting Socially Guided Decisions , 2012, Science.

[80]  Karl J. Friston,et al.  Predictive Coding or Evidence Accumulation? False Inference and Neuronal Fluctuations , 2010, PloS one.

[81]  O. Blanke,et al.  Multisensory Mechanisms in Temporo-Parietal Cortex Support Self-Location and First-Person Perspective , 2011, Neuron.

[82]  P. Benson,et al.  Recognizing one's own face , 2001, Cognition.

[83]  Manos Tsakiris,et al.  I feel your fear: shared touch between faces facilitates recognition of fearful facial expressions. , 2013, Emotion.

[84]  M. Sereno,et al.  A human parietal face area contains aligned head-centered visual and tactile maps , 2006, Nature Neuroscience.

[85]  M. Iacoboni,et al.  Neural Basis of Self and Other Representation in Autism: An fMRI Study of Self-Face Recognition , 2008, PloS one.

[86]  D. Pandya,et al.  Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey , 1978, Brain Research.

[87]  Alexander Todorov,et al.  Differential neural responses to faces physically similar to the self as a function of their valence , 2010, NeuroImage.

[88]  Charles Spence,et al.  When mirrors lie: “Visual capture” of arm position impairs reaching performance , 2004, Cognitive, affective & behavioral neuroscience.

[89]  M. Tsakiris,et al.  The free-energy self: A predictive coding account of self-recognition , 2014, Neuroscience & Biobehavioral Reviews.

[90]  Mark W Woolrich,et al.  Associative learning of social value , 2008, Nature.

[91]  Bennett I. Bertenthal,et al.  Development of Self-Recognition in the Infant. , 1978 .