The Invisible Hand Illusion: Multisensory Integration Leads to the Embodiment of a Discrete Volume of Empty Space

The dynamic integration of signals from different sensory modalities plays a key role in bodily self-perception. When visual information is used in the multisensory process of localizing and identifying one's own limbs, the sight of a body part often plays a dominant role. For example, it has repeatedly been shown that a viewed object must resemble a humanoid body part to permit illusory self-attribution of that object. Here, we report a perceptual illusion that challenges these assumptions by demonstrating that healthy (nonamputated) individuals can refer somatic sensations to a discrete volume of empty space and experience having an invisible hand. In 10 behavioral and one fMRI experiment, we characterized the perceptual rules and multisensory brain mechanisms that produced this “invisible hand illusion.” Our behavioral results showed that the illusion depends on visuotactile-proprioceptive integration that obeys key spatial and temporal multisensory rules confined to near-personal space. The fMRI results associate the illusion experience with increased activity in regions related to the integration of multisensory body-related signals, most notably the bilateral ventral premotor, intraparietal, and cerebellar cortices. We further showed that a stronger feeling of having an invisible hand is associated with a higher degree of effective connectivity between the intraparietal and ventral premotor cortices. These findings demonstrate that the integration of temporally and spatially congruent multisensory signals in a premotor-intraparietal circuit is sufficient to redefine the spatial boundaries of the bodily self, even when visual information directly contradicts the presence of a physical limb at the location of the perceived illusory hand.

[1]  F. Lacquaniti,et al.  Eye-hand coordination during reaching. I. Anatomical relationships between parietal and frontal cortex. , 2001, Cerebral cortex.

[2]  A. Farnè,et al.  Visuo-tactile representation of near-the-body space , 2004, Journal of Physiology-Paris.

[3]  H. Ehrsson,et al.  Behavioural Brain Research , 1999 .

[4]  Tracy L. Faber,et al.  Role of posterior parietal cortex in the recalibration of visually guided reaching , 1996, Nature.

[5]  M. Graziano Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[6]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[7]  M. Mesulam,et al.  Insula of the old world monkey. III: Efferent cortical output and comments on function , 1982, The Journal of comparative neurology.

[8]  Lorraine E. Bahrick,et al.  Detection of Intermodal Proprioceptive-Visual Contingency as a , Potential Basis of Self-Perception in Infancy , 1985 .

[9]  M. Preul The Human Brain: Surface, Blood Supply, and Three-Dimensional Sectional Anatomy , 2001 .

[10]  P. Downing,et al.  The role of occipitotemporal body-selective regions in person perception , 2011, Cognitive neuroscience.

[11]  H. Henrik Ehrsson,et al.  Disowning one’s seen real body during an out-of-body illusion , 2012, Consciousness and Cognition.

[12]  Alain Berthoz,et al.  Increased functional connectivity between superior colliculus and brain regions implicated in bodily self‐consciousness during the rubber hand illusion , 2015, Human brain mapping.

[13]  H. Henrik Ehrsson,et al.  The Illusion of Owning a Third Arm , 2011, PloS one.

[14]  C. Spence,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[15]  P. Haggard,et al.  Having a body versus moving your body: How agency structures body-ownership , 2006, Consciousness and Cognition.

[16]  Karl J. Friston,et al.  Sensory Processing and the Rubber Hand Illusion—An Evoked Potentials Study , 2015, Journal of Cognitive Neuroscience.

[17]  M. Dawson,et al.  The electrodermal system , 2007 .

[18]  Scott T Grafton,et al.  Telling the Right Hand From the Left Hand , 2012, Psychological science.

[19]  Masaya Hirashima,et al.  The “Cutaneous Rabbit” Hopping out of the Body , 2010, The Journal of Neuroscience.

[20]  Justin M. Harris,et al.  If I Were You: Perceptual Illusion of Body Swapping , 2008, PloS one.

[21]  V. Ramachandran,et al.  Projecting sensations to external objects: evidence from skin conductance response , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[22]  Robert J. van Beers,et al.  How humans combine simultaneous proprioceptive and visual position information , 1996, Experimental Brain Research.

[23]  Paul T. Sowden,et al.  Your hand or mine? The extrastriate body area , 2008, NeuroImage.

[24]  D. Wolpert,et al.  The cerebellum is involved in predicting the sensory consequences of action , 1999, Neuroreport.

[25]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[26]  Massimiliano Di Luca,et al.  The Rubber Hand Illusion: Feeling of Ownership and Proprioceptive Drift Do Not Go Hand in Hand , 2011, PloS one.

[27]  T. Metzinger,et al.  Video Ergo Sum: Manipulating Bodily Self-Consciousness , 2007, Science.

[28]  O. Blanke Multisensory brain mechanisms of bodily self-consciousness , 2012, Nature Reviews Neuroscience.

[29]  Axel Cleeremans,et al.  New frontiers in the rubber hand experiment: when a robotic hand becomes one’s own , 2014, Behavior Research Methods.

[30]  J. Lackner,et al.  Influence of vision on vibration-induced illusions of limb movement , 1984, Experimental Neurology.

[31]  M. Costantini,et al.  Haptic perception and body representation in lateral and medial occipito-temporal cortices , 2011, Neuropsychologia.

[32]  K. Nagai,et al.  SCN output drives the autonomic nervous system: with special reference to the autonomic function related to the regulation of glucose metabolism. , 1996, Progress in brain research.

[33]  S. Obayashi,et al.  Subjective image of invisible hand coded by monkey intraparietal neurons , 2000, Neuroreport.

[34]  H. Ehrsson,et al.  Moving a Rubber Hand that Feels Like Your Own: A Dissociation of Ownership and Agency , 2012, Front. Hum. Neurosci..

[35]  Dottie M. Clower,et al.  The Inferior Parietal Lobule Is the Target of Output from the Superior Colliculus, Hippocampus, and Cerebellum , 2001, The Journal of Neuroscience.

[36]  J. Maunsell,et al.  Touching a Rubber Hand: Feeling of Body Ownership Is Associated with Activity in Multisensory Brain Areas , 2005, The Journal of Neuroscience.

[37]  P. Haggard,et al.  The rubber hand illusion: Sensitivity and reference frame for body ownership , 2007, Consciousness and Cognition.

[38]  Anthony Campbell,et al.  Seeing the Body: A New Mechanism for Acupuncture Analgesia? , 2013, Acupuncture in medicine : journal of the British Medical Acupuncture Society.

[39]  V. Ramachandran,et al.  The perception of phantom limbs , 1998 .

[40]  G. Rizzolatti,et al.  The organization of the cortical motor system: new concepts. , 1998, Electroencephalography and clinical neurophysiology.

[41]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[42]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[43]  C. Spence,et al.  Multisensory representation of limb position in human premotor cortex , 2003, Nature Neuroscience.

[44]  Chen Li,et al.  Motor and Nonmotor Domains in the Monkey Dentate , 2002, Annals of the New York Academy of Sciences.

[45]  S. Gandevia,et al.  Proprioceptive signals contribute to the sense of body ownership , 2011, The Journal of physiology.

[46]  H. Ehrsson,et al.  Owning the body in the mirror: The effect of visual perspective and mirror view on the full-body illusion , 2015, Scientific Reports.

[47]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[48]  H. Henrik Ehrsson,et al.  Human Neuroscience , 2022 .

[49]  R. Dolan,et al.  Threatening a rubber hand that you feel is yours elicits a cortical anxiety response , 2007, Proceedings of the National Academy of Sciences.

[50]  M. Jeannerod,et al.  Sense of body and sense of action both contribute to self-recognition , 2002, Cognition.

[51]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[52]  M S Graziano,et al.  Coding the locations of objects in the dark. , 1997, Science.

[53]  M. Corbetta,et al.  Extrastriate body area in human occipital cortex responds to the performance of motor actions , 2004, Nature Neuroscience.

[54]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[55]  Michael Lewis,et al.  Social cognition and the acquisition of self , 1979 .

[56]  D. Lloyd Spatial limits on referred touch to an alien limb may reflect boundaries of visuo-tactile peripersonal space surrounding the hand , 2007, Brain and Cognition.

[57]  Kazumichi Matsumiya,et al.  Moving One’s Own Body Part Induces a Motion Aftereffect Anchored to the Body Part , 2014, Current Biology.

[58]  R. Passingham,et al.  Medial frontal cortex: from self-generated action to reflection on one's own performance , 2010, Trends in Cognitive Sciences.

[59]  Dylan F. Cooke,et al.  Parieto-frontal interactions, personal space, and defensive behavior , 2006, Neuropsychologia.

[60]  Masao Ito Mechanisms of motor learning in the cerebellum 1 1 Published on the World Wide Web on 24 November 2000. , 2000, Brain Research.

[61]  Yvonne de Kort,et al.  Is This My Hand I See Before Me? The Rubber Hand Illusion in Reality, Virtual Reality, and Mixed Reality , 2006, PRESENCE: Teleoperators and Virtual Environments.

[62]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[63]  H. Flor,et al.  Phantom limb pain: a case of maladaptive CNS plasticity? , 2006, Nature Reviews Neuroscience.

[64]  Valeria I. Petkova,et al.  fMRI Adaptation Reveals a Cortical Mechanism for the Coding of Space Near the Hand , 2011, The Journal of Neuroscience.

[65]  C. Spence,et al.  Multisensory Integration: Space, Time and Superadditivity , 2005, Current Biology.

[66]  M. Tsakiris,et al.  Hands only illusion: multisensory integration elicits sense of ownership for body parts but not for non-corporeal objects , 2010, Experimental Brain Research.

[67]  C. Gross,et al.  Visuospatial properties of ventral premotor cortex. , 1997, Journal of neurophysiology.

[68]  W. IJsselsteijn,et al.  The effect of similarities in skin texture and hand shape on perceived ownership of a fake limb. , 2008, Body image.

[69]  M S Graziano,et al.  Coding the location of the arm by sight. , 2000, Science.

[70]  G. Rizzolatti,et al.  Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses , 1981, Behavioural Brain Research.

[71]  H. Henrik Ehrsson,et al.  Illusory ownership of an invisible body reduces autonomic and subjective social anxiety responses , 2015, Scientific Reports.

[72]  R B Welch,et al.  An examination of the relationship between visual capture and prism adaptation , 1979, Perception & psychophysics.

[73]  C. Spence,et al.  Multisensory integration and the body schema: close to hand and within reach , 2003, Current Biology.

[74]  E. Zohary,et al.  Topographic Representation of the Human Body in the Occipitotemporal Cortex , 2010, Neuron.

[75]  P. Haggard,et al.  Neural signatures of body ownership: a sensory network for bodily self-consciousness. , 2007, Cerebral cortex.

[76]  E. Naito,et al.  Activity in the Posterior Parietal Cortex Mediates Visual Dominance over Kinesthesia , 2007, The Journal of Neuroscience.

[77]  H. Ehrsson The Experimental Induction of Out-of-Body Experiences , 2007, Science.

[78]  P. Rochat Self-perception and action in infancy , 1998, Experimental Brain Research.

[79]  H. Henrik Ehrsson,et al.  The spatial distance rule in the moving and classical rubber hand illusions , 2014, Consciousness and Cognition.

[80]  L. Goldstein The frontal lobes and voluntary action , 1996 .

[81]  G. Rizzolatti,et al.  Afferent properties of periarcuate neurons in macaque monkeys. I. Somatosensory responses , 1981, Behavioural Brain Research.

[82]  J. Danckert Common Mechanisms in Perception and Action: Attention and Performance XIX Wolfgang Prinz, Bernhard Hommel (Eds.), Oxford University Press, 2002, Price: £ 65.00, ISBN: 0-19-851069 , 2003, Neuropsychologia.

[83]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[84]  Ehud Zohary,et al.  Is That Near My Hand? Multisensory Representation of Peripersonal Space in Human Intraparietal Sulcus , 2007, The Journal of Neuroscience.

[85]  J. Hohwy,et al.  Explaining Away the Body: Experiences of Supernaturally Caused Touch and Touch on Non-Hand Objects within the Rubber Hand Illusion , 2010, PloS one.

[86]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[87]  A. Pouget,et al.  Reference frames for representing visual and tactile locations in parietal cortex , 2005, Nature Neuroscience.

[88]  P. Strick,et al.  Cerebellar connections with the motor cortex and the arcuate premotor area: An analysis employing retrograde transneuronal transport of WGA‐HRP , 1989, The Journal of comparative neurology.

[89]  C. Spence,et al.  Psychologically induced cooling of a specific body part caused by the illusory ownership of an artificial counterpart , 2008, Proceedings of the National Academy of Sciences.

[90]  M. Tsakiris My body in the brain: A neurocognitive model of body-ownership , 2010, Neuropsychologia.

[91]  H. Chris Dijkerman,et al.  Affective touch modulates the rubber hand illusion , 2014, Cognition.

[92]  V. Ramachandran,et al.  The perception of phantom limbs. The D. O. Hebb lecture. , 1998, Brain : a journal of neurology.

[93]  Valeria I. Petkova,et al.  Integration of visual and tactile signals from the hand in the human brain: an FMRI study. , 2011, Journal of neurophysiology.

[94]  A. Craig How do you feel? Interoception: the sense of the physiological condition of the body , 2002, Nature Reviews Neuroscience.

[95]  N. Kanwisher,et al.  The Human Body , 2001 .

[96]  H. Henrik Ehrsson,et al.  When Right Feels Left: Referral of Touch and Ownership between the Hands , 2009, PloS one.

[97]  Valeria I. Petkova,et al.  From Part- to Whole-Body Ownership in the Multisensory Brain , 2011, Current Biology.

[98]  H. Ehrsson,et al.  That's Near My Hand! Parietal and Premotor Coding of Hand-Centered Space Contributes to Localization and Self-Attribution of the Hand , 2012, Journal of Neuroscience.