Influence of the Body Schema on Multisensory Integration: Evidence from the Mirror Box Illusion

When placing one hand on each side of a mirror and making synchronous bimanual movements, the mirror-reflected hand feels like one’s own hand that is hidden behind the mirror. We developed a novel mirror box illusion to investigate whether motoric, but not spatial, visuomotor congruence is sufficient for inducing multisensory integration, and importantly, if biomechanical constraints encoded in the body schema influence multisensory integration. Participants placed their hands in a mirror box in opposite postures (palm up, palm down), creating a conflict between visual and proprioceptive feedback for the hand behind the mirror. After synchronous bimanual hand movements in which the viewed and felt movements were motorically congruent but spatially in the opposite direction, participants felt that the hand behind the mirror rotated or completely flipped towards matching the hand reflection (illusory displacement), indicating facilitation of multisensory integration by motoric visuomotor congruence alone. Some wrist rotations are more difficult due to biomechanical constraints. We predicted that these biomechanical constraints would influence illusion effectiveness, even though the illusion does not involve actual limb movement. As predicted, illusory displacement increased as biomechanical constraints and angular disparity decreased, providing evidence that biomechanical constraints are processed in multisensory integration.

[1]  H. Coslett,et al.  The influence of embodiment on multisensory integration using the mirror box illusion , 2015, Consciousness and Cognition.

[2]  D. Harrison.  Frontal Lobe Syndromes , 2015 .

[3]  J. Friedman,et al.  The plausibility of visual information for hand ownership modulates multisensory synchrony perception , 2015, Experimental Brain Research.

[4]  Ivan Toni,et al.  Posture influences motor imagery: An fMRI study , 2006, NeuroImage.

[5]  Albert Jin Chung,et al.  Perception of Body Ownership Is Driven by Bayesian Sensory Inference , 2015, PloS one.

[6]  H. Coslett,et al.  From maps to form to space: Touch and the body schema , 2010, Neuropsychologia.

[7]  M. Guerraz,et al.  Kinaesthetic mirror illusion and spatial congruence , 2015, Experimental Brain Research.

[8]  H. Pick,et al.  Visual capture produced by prism spectacles , 1965 .

[9]  H. Flor,et al.  Sensorimotor Incongruence and Body Perception: An Experimental Investigation , 2013, Front. Hum. Neurosci..

[10]  Yali Amit,et al.  Encoding of Coordinated Grasp Trajectories in Primary Motor Cortex , 2010, The Journal of Neuroscience.

[11]  P. Grant,et al.  Dopaminergic foundations of schizotypy as measured by the German version of the Oxford-Liverpool Inventory of Feelings and Experiences (O-LIFE)—a suitable endophenotype of schizophrenia , 2013, Front. Hum. Neurosci..

[12]  O. Blanke,et al.  Differential influence of hands posture on mental rotation of hands and feet in left and right handers , 2009, Experimental Brain Research.

[13]  H. Henrik Ehrsson,et al.  No causal link between changes in hand position sense and feeling of limb ownership in the rubber hand illusion , 2015, Attention, Perception, & Psychophysics.

[14]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[15]  H. Ehrsson,et al.  Moving a Rubber Hand that Feels Like Your Own: A Dissociation of Ownership and Agency , 2012, Front. Hum. Neurosci..

[16]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[17]  Ulrik R. Beierholm,et al.  Causal inference in perception , 2010, Trends in Cognitive Sciences.

[18]  M. Tsakiris.  My body in the brain: A neurocognitive model of body-ownership , 2010, Neuropsychologia.

[19]  G. Holmes,et al.  Sensory disturbances from cerebral lesions , 1911 .

[20]  M. Guerraz,et al.  The kinaesthetic mirror illusion: How much does the mirror matter? , 2016, Experimental Brain Research.

[21]  Masakazu Ide,et al.  The Effect of “Anatomical Plausibility” of Hand Angle on the Rubber-Hand Illusion , 2013, Perception.

[22]  D. H. Warren,et al.  Intermodality relations in localization in blind and sighted people , 1970 .

[23]  L. Parsons.  Temporal and kinematic properties of motor behavior reflected in mentally simulated action. , 1994, Journal of experimental psychology. Human perception and performance.

[24]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[25]  Olaf Blanke,et al.  Anatomically plausible illusory posture affects mental rotation of body parts , 2013, Cognitive, affective & behavioral neuroscience.

[26]  Konrad Paul Kording,et al.  Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception , 2015, Front. Hum. Neurosci..

[27]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[28]  V. Ramachandran,et al.  Synaesthesia in phantom limbs induced with mirrors , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[29]  A. Davies,et al.  The Nonvisual Illusion of Self-Touch: Misaligned Hands and Anatomical Implausibility , 2015, Perception.

[30]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[31]  R. Shepard,et al.  Mental transformations in the identification of left and right hands. , 1975, Journal of experimental psychology. Human perception and performance.

[32]  Catherine Preston,et al.  The role of distance from the body and distance from the real hand in ownership and disownership during the rubber hand illusion. , 2013, Acta psychologica.

[33]  Nicholas P. Holmes,et al.  Visual bias of unseen hand position with a mirror: spatial and temporal factors , 2005, Experimental Brain Research.

[34]  Souta Hidaka,et al.  Visual presentation of hand image modulates visuo–tactile temporal order judgment , 2013, Experimental Brain Research.

[35]  S. Aglioti,et al.  The influence of hands posture on mental rotation of hands and feet , 2007, Experimental Brain Research.

[36]  L. Parsons.  Imagined spatial transformations of one's hands and feet , 1987, Cognitive Psychology.

[37]  Charles Spence,et al.  Reaching with alien limbs: Visual exposure to prosthetic hands in a mirror biases proprioception without accompanying illusions of ownership , 2006, Perception & psychophysics.

[38]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[39]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[40]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[41]  K. Sekiyama,et al.  Kinesthetic aspects of mental representations in the identification of left and right hands , 1982, Perception & psychophysics.

[42]  David R. Wozny,et al.  Human trimodal perception follows optimal statistical inference. , 2008, Journal of vision.

[43]  P. Haggard,et al.  The rubber hand illusion revisited: visuotactile integration and self-attribution. , 2005, Journal of experimental psychology. Human perception and performance.

[44]  Charles Spence,et al.  When mirrors lie: “Visual capture” of arm position impairs reaching performance , 2004, Cognitive, affective & behavioral neuroscience.

[45]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[46]  H. Branch Coslett,et al.  Evidence for Multiple, Distinct Representations of the Human Body , 2005, Journal of Cognitive Neuroscience.

[47]  B. Stein,et al.  Spatial factors determine the activity of multisensory neurons in cat superior colliculus , 1986, Brain Research.

[48]  D. Lloyd.  Spatial limits on referred touch to an alien limb may reflect boundaries of visuo-tactile peripersonal space surrounding the hand , 2007, Brain and Cognition.

[49]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[50]  J. Marshall,et al.  The neural consequences of conflict between intention and the senses. , 1999, Brain : a journal of neurology.

[51]  B. Stein,et al.  Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  Massimiliano Di Luca,et al.  The Rubber Hand Illusion: Feeling of Ownership and Proprioceptive Drift Do Not Go Hand in Hand , 2011, PloS one.

[53]  Henning Holle,et al.  Proprioceptive drift without illusions of ownership for rotated hands in the “rubber hand illusion” paradigm , 2011, Cognitive neuroscience.