Auditory Cues Influence the Rubber-Hand Illusion

The perception of one’s own body depends on the dynamic integration of signals from different sensory modalities. Earlier studies have shown that visual, tactile, and proprioceptive information contributes to this process. However, little is known about the role of auditory cues in the multisensory integration of bodily signals. To address this issue, we studied the effect of auditory feedback on the rubber-hand illusion and the somatic version of this illusion. In each experiment, we tested 30 healthy participants using four different conditions: synchronous touches without auditory cues (original illusion), asynchronous touches without auditory cues (original control), synchronous touches with synchronous auditory cues (illusion positively modulated by sound), and synchronous touches with asynchronous auditory cues (illusion negatively modulated by sound). For the classic rubber-hand illusion, we found that synchronous auditory cues made the illusion stronger compared with asynchronous auditory cues, as evidenced by both the results of the questionnaires and proprioceptive drift. In both versions of the illusion, proprioceptive drift indicated that the synchronous auditory cues enhanced the illusion compared with the condition without auditory feedback and that the asynchronous auditory cues reduced the illusion compared with the nonauditory condition. Taken together, these results demonstrate that auditory cues modulate the rubber-hand illusion, which suggests that auditory information is used in the formation of the coherent multisensory representation of one’s own body.

[1]  J. Lackner,et al.  Influence of vision on vibration-induced illusions of limb movement , 1984, Experimental Neurology.

[2]  J. Lackner Some proprioceptive influences on the perceptual representation of body shape and orientation. , 1988, Brain : a journal of neurology.

[3]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[4]  K. Zilles,et al.  Illusory Arm Movements Activate Cortical Motor Areas: A Positron Emission Tomography Study , 1999, The Journal of Neuroscience.

[5]  C. Gross,et al.  A neuronal representation of the location of nearby sounds , 1999, Nature.

[6]  M S Graziano,et al.  Coding the location of the arm by sight. , 2000, Science.

[7]  B. Edin Cutaneous afferents provide information about knee joint movements in humans , 2001, The Journal of physiology.

[8]  D. Wolpert,et al.  When Feeling Is More Important Than Seeing in Sensorimotor Adaptation , 2002, Current Biology.

[9]  P. Roland,et al.  I Feel My Hand Moving A New Role of the Primary Motor Cortex in Somatic Perception of Limb Movement , 2002, Neuron.

[10]  P. Bertelson,et al.  Multisensory integration, perception and ecological validity , 2003, Trends in Cognitive Sciences.

[11]  C. Spence,et al.  Multisensory Integration: Maintaining the Perception of Synchrony , 2003, Current Biology.

[12]  C. Spence,et al.  Multisensory representation of limb position in human premotor cortex , 2003, Nature Neuroscience.

[13]  M. Botvinick Probing the Neural Basis of Body Ownership , 2004, Science.

[14]  Matthew Botvinick,et al.  Neuroscience. Probing the neural basis of body ownership. , 2004, Science.

[15]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[16]  Robert J. van Beers,et al.  How humans combine simultaneous proprioceptive and visual position information , 1996, Experimental Brain Research.

[17]  J. Maunsell,et al.  Touching a Rubber Hand: Feeling of Body Ownership Is Associated with Activity in Multisensory Brain Areas , 2005, The Journal of Neuroscience.

[18]  C. Spence,et al.  Multisensory Integration: Space, Time and Superadditivity , 2005, Current Biology.

[19]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[20]  P. Haggard,et al.  Bodily Illusions Modulate Tactile Perception , 2005, Current Biology.

[21]  Charles Spence,et al.  Reaching with alien limbs: Visual exposure to prosthetic hands in a mirror biases proprioception without accompanying illusions of ownership , 2006, Perception & psychophysics.

[22]  Daniel Senkowski,et al.  Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations , 2007, Neuropsychologia.

[23]  Satoshi Hirose,et al.  Activity in posterior parietal cortex mediates the visual dominance over kinesthesia , 2007, Neuroscience Research.

[24]  D. Lloyd Spatial limits on referred touch to an alien limb may reflect boundaries of visuo-tactile peripersonal space surrounding the hand , 2007, Brain and Cognition.

[25]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[26]  E. Naito,et al.  Activity in the Posterior Parietal Cortex Mediates Visual Dominance over Kinesthesia , 2007, The Journal of Neuroscience.

[27]  C. Spence,et al.  Crossmodal binding: Evaluating the “unity assumption” using audiovisual speech stimuli , 2007, Perception & psychophysics.

[28]  H. Ehrsson,et al.  Behavioural Brain Research , 1999 .

[29]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[30]  H. Ehrsson,et al.  Upper limb amputees can be induced to experience a rubber hand as their own , 2008, Brain : a journal of neurology.

[31]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[32]  Justin M. Harris,et al.  If I Were You: Perceptual Illusion of Body Swapping , 2008, PloS one.

[33]  Allan M. Lees The invisible hand , 2008, Nature.

[34]  P. Haggard,et al.  Visual enhancement of touch and the bodily self , 2008, Consciousness and Cognition.

[35]  M. Tsakiris,et al.  Hands only illusion: multisensory integration elicits sense of ownership for body parts but not for non-corporeal objects , 2010, Experimental Brain Research.

[36]  Marjolein P. M. Kammers,et al.  The rubber hand illusion in action , 2009, Neuropsychologia.

[37]  P. Haggard,et al.  Distorting the visual size of the hand affects hand pre-shaping during grasping , 2009, Experimental Brain Research.

[38]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[39]  O. Blanke,et al.  How vestibular stimulation interacts with illusory hand ownership , 2010, Consciousness and Cognition.

[40]  M. Murray,et al.  Auditory–somatosensory multisensory interactions in humans: Dissociating detection and spatial discrimination , 2010, Neuropsychologia.

[41]  H. Henrik Ehrsson,et al.  Being Barbie: The Size of One’s Own Body Determines the Perceived Size of the World , 2011, PloS one.

[42]  Valeria I. Petkova,et al.  From Part- to Whole-Body Ownership in the Multisensory Brain , 2011, Current Biology.

[43]  Valeria I. Petkova,et al.  Hand in the Human Brain: An fMRI Study Integration of Visual and Tactile Signals From the , 2011 .

[44]  Keehoon Kim,et al.  Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. , 2011, Brain : a journal of neurology.

[45]  Valeria I. Petkova,et al.  Integration of visual and tactile signals from the hand in the human brain: an FMRI study. , 2011, Journal of neurophysiology.

[46]  Massimiliano Di Luca,et al.  The Rubber Hand Illusion: Feeling of Ownership and Proprioceptive Drift Do Not Go Hand in Hand , 2011, PloS one.

[47]  H. Ehrsson,et al.  Moving a Rubber Hand that Feels Like Your Own: A Dissociation of Ownership and Agency , 2012, Front. Hum. Neurosci..

[48]  Valeria I. Petkova,et al.  Rubber Hands Feel Touch, but Not in Blind Individuals , 2012, PloS one.

[49]  H. Ehrsson,et al.  That's Near My Hand! Parietal and Premotor Coding of Hand-Centered Space Contributes to Localization and Self-Attribution of the Hand , 2012, Journal of Neuroscience.

[50]  A. Mussap,et al.  Rubber-Hand Illusion , 2012 .

[51]  S. Gandevia,et al.  The proprioceptive senses: their roles in signaling body shape, body position and movement, and muscle force. , 2012, Physiological reviews.

[52]  Ana Tajadura-Jiménez,et al.  Action sounds recalibrate perceived tactile distance , 2012 .

[53]  Giovanni Gentile,et al.  The Invisible Hand Illusion: Multisensory Integration Leads to the Embodiment of a Discrete Volume of Empty Space , 2013, Journal of Cognitive Neuroscience.

[54]  Nadia Bolognini,et al.  The marble-hand illusion , 2013 .

[55]  M. Slater,et al.  The building blocks of the full body ownership illusion , 2013, Front. Hum. Neurosci..

[56]  Andrew J. Bremner,et al.  Children’s Responses to the Rubber-Hand Illusion Reveal Dissociable Pathways in Body Representation , 2013, Psychological science.

[57]  Catherine Preston,et al.  The role of distance from the body and distance from the real hand in ownership and disownership during the rubber hand illusion. , 2013, Acta psychologica.

[58]  H. Ehrsson,et al.  Disintegration of Multisensory Signals from the Real Hand Reduces Default Limb Self-Attribution: An fMRI Study , 2013, The Journal of Neuroscience.

[59]  Mel Slater,et al.  Drumming in immersive virtual reality: The body shapes the way we play , 2013, VR.

[60]  Yosuke Kurihara,et al.  Virtual Robotization of the Human Body via Data-Driven Vibrotactile Feedback , 2013, Advances in Computer Entertainment.

[61]  Auditory-tactile induced changes in represented leg height when dropping a ball , 2014 .

[62]  B. Röder,et al.  Both developmental and adult vision shape body representations , 2014, Scientific Reports.

[63]  H. Ehrsson,et al.  The moving rubber hand illusion revisited: Comparing movements and visuotactile stimulation to induce illusory ownership , 2014, Consciousness and Cognition.

[64]  H. Henrik Ehrsson,et al.  The spatial distance rule in the moving and classical rubber hand illusions , 2014, Consciousness and Cognition.

[65]  M. Tsakiris,et al.  Action sounds update the mental representation of arm dimension: contributions of kinaesthesia and agency , 2015, Front. Psychol..

[66]  Olaf Blanke,et al.  Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness , 2015, Neuron.

[67]  Ana Tajadura-Jiménez,et al.  As Light as your Footsteps: Altering Walking Sounds to Change Perceived Body Weight, Emotional State and Gait , 2015, CHI.

[68]  Ana Tajadura-Jiménez,et al.  Emotion-inducing approaching sounds shape the boundaries of multisensory peripersonal space , 2015, Neuropsychologia.

[69]  H. Henrik Ehrsson,et al.  No causal link between changes in hand position sense and feeling of limb ownership in the rubber hand illusion , 2015, Attention, Perception, & Psychophysics.

[70]  Jakub Limanowski,et al.  Integration of Visual and Proprioceptive Limb Position Information in Human Posterior Parietal, Premotor, and Extrastriate Cortex , 2016, The Journal of Neuroscience.

[71]  Mirta Fiorio,et al.  Individual Differences in the Rubber Hand Illusion Are Related to Sensory Suggestibility , 2016, PloS one.

[72]  Jean-Paul Noel,et al.  Relative contributions of visual and auditory spatial representations to tactile localization , 2016, Neuropsychologia.

[73]  Jeffrey G. Ojemann,et al.  Ownership of an artificial limb induced by electrical brain stimulation , 2016, Proceedings of the National Academy of Sciences.

[74]  Sally A. Linkenauger,et al.  Multimodal contributions to body representation , 2016 .

[75]  Andreas Kalckert,et al.  The Onset Time of the Ownership Sensation in the Moving Rubber Hand Illusion , 2017, Front. Psychol..

[76]  J. Kállai,et al.  Hearing visuo‐tactile synchrony – Sound‐induced proprioceptive drift in the invisible hand illusion , 2017, British journal of psychology.

[77]  N. Bianchi-Berthouze,et al.  Contingent sounds change the mental representation of one’s finger length , 2017, Scientific Reports.