Peri-personal space as a prior in coupling visual and proprioceptive signals

It has been suggested that the integration of multiple body-related sources of information within the peri-personal space (PPS) scaffolds body ownership. However, a normative computational framework detailing the functional role of PPS is still missing. Here we cast PPS as a visuo-proprioceptive Bayesian inference problem whereby objects we see in our environment are more likely to engender sensations as they come near to the body. We propose that PPS is the reflection of such an increased a priori probability of visuo-proprioceptive coupling that surrounds the body. To test this prediction, we immersed participants in a highly realistic virtual reality (VR) simulation of their right arm and surrounding environment. We asked participants to perform target-directed reaches toward visual, proprioceptive, and visuo-proprioceptive targets while visually displaying their reaching arm (body visible condition) or not (body invisible condition). Reach end-points are analyzed in light of the coupling prior framework, where the extension of PPS is taken to be represented by the spatial dispersion of the coupling prior between visual and proprioceptive estimates of arm location. Results demonstrate that if the body is not visible, the spatial dispersion of the visuo-proprioceptive coupling relaxes, whereas the strength of coupling remains stable. By demonstrating a distance-dependent alteration in visual and proprioceptive localization attractive pull toward one another (stronger pull at small spatial discrepancies) when the body is rendered invisible – an effect that is well accounted for by the visuo-proprioceptive coupling prior – the results suggest that the visible body grounds visuo-proprioceptive coupling preferentially in the near vs. far space.

[1]  H. C. Dijkerman,et al.  Peripersonal space boundaries around the lower limbs , 2017, Experimental Brain Research.

[2]  D. Wolpert,et al.  When Feeling Is More Important Than Seeing in Sensorimotor Adaptation , 2002, Current Biology.

[3]  Albert Jin Chung,et al.  Perception of Body Ownership Is Driven by Bayesian Sensory Inference , 2015, PloS one.

[4]  Dylan F. Cooke,et al.  Sensorimotor integration in the precentral gyrus: polysensory neurons and defensive movements. , 2004, Journal of neurophysiology.

[5]  G Rizzolatti,et al.  The Space Around Us , 1997, Science.

[6]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.

[7]  H. Henrik Ehrsson,et al.  Illusory ownership of an invisible body reduces autonomic and subjective social anxiety responses , 2015, Scientific Reports.

[8]  Francesco Pavani,et al.  Multisensory contributions to the 3-D representation of visuotactile peripersonal space in humans: evidence from the crossmodal congruency task , 2004, Journal of Physiology-Paris.

[9]  M S Graziano,et al.  Coding the location of the arm by sight. , 2000, Science.

[10]  Andreas Kalckert,et al.  The Onset Time of the Ownership Sensation in the Moving Rubber Hand Illusion , 2017, Front. Psychol..

[11]  C. Gross,et al.  Visuospatial properties of ventral premotor cortex. , 1997, Journal of neurophysiology.

[12]  Olaf Blanke,et al.  The wheelchair as a full-body tool extending the peripersonal space , 2015, Front. Psychol..

[13]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[14]  H. Ehrsson,et al.  Behavioural Brain Research , 1999 .

[15]  Thomas Metzinger,et al.  Unconscious integration of multisensory bodily inputs in the peripersonal space shapes bodily self-consciousness , 2016, Cognition.

[16]  K. Zilles,et al.  Polymodal Motion Processing in Posterior Parietal and Premotor Cortex A Human fMRI Study Strongly Implies Equivalencies between Humans and Monkeys , 2001, Neuron.

[17]  Suliann Ben Hamed,et al.  Impact Prediction by Looming Visual Stimuli Enhances Tactile Detection , 2015, The Journal of Neuroscience.

[18]  Peter Willemsen,et al.  Effects of Stereo Viewing Conditions on Distance Perception in Virtual Environments , 2008, PRESENCE: Teleoperators and Virtual Environments.

[19]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[20]  A. Serino,et al.  Motor Properties of Peripersonal Space in Humans , 2009, PloS one.

[21]  Valentina Rastelli,et al.  Tool-use reshapes the boundaries of body and peripersonal space representations , 2013, Experimental Brain Research.

[22]  Mary C. Whitton,et al.  Redirected Touching: Training and adaptation in warped virtual spaces , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[23]  Suliann Ben Hamed,et al.  The Prediction of Impact of a Looming Stimulus onto the Body Is Subserved by Multisensory Integration Mechanisms , 2017, The Journal of Neuroscience.

[24]  F. Pavani,et al.  Action-specific remapping of peripersonal space , 2010, Neuropsychologia.

[25]  M. Graziano Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Anne C. Sittig,et al.  The precision of proprioceptive position sense , 1998, Experimental Brain Research.

[27]  Elisabetta Làdavas,et al.  Seeing where your hands are , 1997, Nature.

[28]  Brian F. G. Katz,et al.  Reaching nearby sources: comparison between real and virtual sound and visual targets , 2014, Front. Neurosci..

[29]  O. Blanke,et al.  Peripersonal space as the space of the bodily self , 2015, Cognition.

[30]  Rashmi Dewan,et al.  Neural Network- A Study , 2014 .

[31]  M. Goldberg,et al.  Ventral intraparietal area of the macaque: congruent visual and somatic response properties. , 1998, Journal of neurophysiology.

[32]  Olaf Blanke,et al.  Common and distinct brain regions processing multisensory bodily signals for peripersonal space and body ownership , 2017, NeuroImage.

[33]  Ladan Shams,et al.  Biases in Visual, Auditory, and Audiovisual Perception of Space , 2015, PLoS Comput. Biol..

[34]  Olaf Blanke,et al.  Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness , 2015, Neuron.

[35]  Patrick Marmaroli,et al.  Body part-centered and full body-centered peripersonal space representations , 2015, Scientific Reports.

[36]  G. D. Iannetti,et al.  How many peripersonal spaces? , 2015, Neuropsychologia.

[37]  Olaf Blanke,et al.  Vestibular modulation of peripersonal space boundaries , 2018, The European journal of neuroscience.

[38]  Katsumi Aoki,et al.  Recent development of flow visualization , 2004, J. Vis..

[39]  M. Ernst Learning to integrate arbitrary signals from vision and touch. , 2007, Journal of vision.

[40]  A. Serino,et al.  Dynamic Sounds Capture the Boundaries of Peripersonal Space Representation in Humans , 2012, PloS one.

[41]  V. Gallese,et al.  The body beyond the body: expectation of a sensory event is enough to induce ownership over a fake hand , 2013, Proceedings of the Royal Society B: Biological Sciences.

[42]  M. Wallace,et al.  The spatial self in schizophrenia and autism spectrum disorder , 2017, Schizophrenia Research.

[43]  Dylan F. Cooke,et al.  Parieto-frontal interactions, personal space, and defensive behavior , 2006, Neuropsychologia.

[44]  Tirin Moore,et al.  Complex movements evoked by microstimulation of the ventral intraparietal area , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[45]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[46]  Olaf Blanke,et al.  Audio-Tactile and Peripersonal Space Processing Around the Trunk in Human Parietal and Temporal Cortex: An Intracranial EEG Study , 2018, bioRxiv.

[47]  D. Lloyd Spatial limits on referred touch to an alien limb may reflect boundaries of visuo-tactile peripersonal space surrounding the hand , 2007, Brain and Cognition.

[48]  M. Shiffrar,et al.  Human Body Perception From The Inside Out , 2005 .

[49]  Justine C. Cléry,et al.  Frontier of Self and Impact Prediction , 2018, Front. Psychol..

[50]  Giuseppe di Pellegrino,et al.  Neuropsychological Evidence of an Integrated Visuotactile Representation of Peripersonal Space in Humans , 1998, Journal of Cognitive Neuroscience.

[51]  Giuseppe di Pellegrino,et al.  Invisible body illusion modulates interpersonal space , 2017, Scientific Reports.

[52]  Olaf Blanke,et al.  Audio-visual sensory deprivation degrades visuo-tactile peri-personal space , 2018, Consciousness and Cognition.

[53]  Peter Willemsen,et al.  Throwing versus walking as indicators of distance perception in similar real and virtual environments , 2005, TAP.

[54]  Martin Buss,et al.  Combination and Integration in the Perception of Visual-Haptic Compliance Information , 2010, IEEE Transactions on Haptics.

[55]  Nicholas P. Holmes,et al.  Tool use changes multisensory interactions in seconds: evidence from the crossmodal congruency task , 2007, Experimental Brain Research.

[56]  Roy A. Ruddle,et al.  Virtual and Adaptive Environments: Applications, Implications, and Human Performance Issues , 2004, Presence: Teleoperators & Virtual Environments.

[57]  C. Gross,et al.  A neuronal representation of the location of nearby sounds , 1999, Nature.

[58]  Hugo Zeberg,et al.  The magnetic touch illusion: A perceptual correlate of visuo-tactile integration in peripersonal space , 2016, Cognition.

[59]  Justine C. Cléry,et al.  Neuronal bases of peripersonal and extrapersonal spaces, their plasticity and their dynamics: Knowns and unknowns , 2015, Neuropsychologia.

[60]  Catherine Preston,et al.  The role of distance from the body and distance from the real hand in ownership and disownership during the rubber hand illusion. , 2013, Acta psychologica.

[61]  Valeria I. Petkova,et al.  fMRI Adaptation Reveals a Cortical Mechanism for the Coding of Space Near the Hand , 2011, The Journal of Neuroscience.

[62]  Olaf Blanke,et al.  Neural adaptation accounts for the dynamic resizing of peripersonal space: evidence from a psychophysical-computational approach , 2018, Journal of neurophysiology.

[63]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[64]  J. Duhamel,et al.  Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey , 2007, The Journal of Neuroscience.

[65]  O. Blanke Multisensory brain mechanisms of bodily self-consciousness , 2012, Nature Reviews Neuroscience.

[66]  Justine Cléry,et al.  Cortical networks for encoding near and far space in the non-human primate , 2018, NeuroImage.

[67]  Hugo Zeberg,et al.  Tool Use Changes the Spatial Extension of the Magnetic Touch Illusion , 2018, Journal of experimental psychology. General.

[68]  Stella F. Lourenco,et al.  What is peripersonal space? An examination of unresolved empirical issues and emerging findings. , 2018, Wiley interdisciplinary reviews. Cognitive science.

[69]  Konrad Paul Kording,et al.  Sensory Cue Integration , 2011 .

[70]  G. Rizzolatti,et al.  Coding of peripersonal space in inferior premotor cortex (area F4). , 1996, Journal of neurophysiology.

[71]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[72]  Will Spijkers,et al.  Depth Perception in Virtual Reality: Distance Estimations in Peri- and Extrapersonal Space , 2008, Cyberpsychology Behav. Soc. Netw..

[73]  Massimiliano Di Luca New Method to Measure End-to-End Delay of Virtual Reality , 2010, PRESENCE: Teleoperators and Virtual Environments.

[74]  Mauro Ursino,et al.  Visuotactile Representation of Peripersonal Space: A Neural Network Study , 2010, Neural Computation.

[75]  Bruno Herbelin,et al.  Peripersonal Space: An Index of Multisensory Body–Environment Interactions in Real, Virtual, and Mixed Realities , 2018, Front. ICT.

[76]  G. Davies,et al.  Knowns and Unknowns , 2003 .

[77]  David Waller,et al.  Correcting distance estimates by interacting with immersive virtual environments: effects of task and available sensory information. , 2008, Journal of experimental psychology. Applied.

[78]  O. Blanke,et al.  Full body action remapping of peripersonal space: The case of walking , 2015, Neuropsychologia.

[79]  Mauro Ursino,et al.  Neural bases of peri-hand space plasticity through tool-use: Insights from a combined computational–experimental approach , 2010, Neuropsychologia.

[80]  Giovanni Gentile,et al.  The Invisible Hand Illusion: Multisensory Integration Leads to the Embodiment of a Discrete Volume of Empty Space , 2013, Journal of Cognitive Neuroscience.

[81]  Wei Ji Ma,et al.  Comparing Bayesian models for multisensory cue combination without mandatory integration , 2007, NIPS.

[82]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[83]  G. Iannetti,et al.  The blink reflex magnitude is continuously adjusted according to both current and predicted stimulus position with respect to the face , 2016, Cortex.

[84]  Olaf Blanke,et al.  From multisensory integration in peripersonal space to bodily self‐consciousness: from statistical regularities to statistical inference , 2018, Annals of the New York Academy of Sciences.