Rapid Recalibration of Peri-Personal Space; Psychophysical, Electrophysiological, and Neural Network Modeling Evidence

Interactions between individuals and the environment are mediated by the body and occur within the peri-personal space (PPS) – the space surrounding the body. The multisensory encoding of this space plastically adapts to different bodily constraints and stimuli features. However, these remapping effects have only been demonstrated on the time-scale of days, hours, or minutes. Yet, if PPS mediates human-environment interactions in an adaptive manner, its representation should be altered by sensory history on trial-to-trial timescale. Here we test this idea first via a visuo-tactile reaction time paradigm in augmented reality where participants are asked to respond as fast as possible to touch, as visual object approach them. Results demonstrate that reaction times to touch are facilitated as a function of visual proximity, and the sigmoidal function describing this facilitation shifts closer to the body if the immediately precedent trial had indexed a smaller visuo-tactile disparity (i.e., positive serial dependency). Next, we derive the electroencephalographic correlates of PPS and demonstrate that this measure is equally shaped by recent sensory history. Finally, we demonstrate that a validated neural network model of PPS is able to account for the present results via a simple Hebbian plasticity rule. The present findings suggest that PPS encoding remaps on a very rapid time-scale and is sensitive to recent sensory history.

[1]  Mauro Ursino,et al.  Neural bases of peri-hand space plasticity through tool-use: Insights from a combined computational–experimental approach , 2010, Neuropsychologia.

[2]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[3]  N. Van der Stoep,et al.  Audiovisual integration in near and far space: effects of changes in distance and stimulus effectiveness , 2015, Experimental Brain Research.

[4]  C. Gross,et al.  Coding of visual space by premotor neurons. , 1994, Science.

[5]  M. Wallace,et al.  Event Related Potentials Index Rapid Recalibration to Audiovisual Temporal Asynchrony , 2017, Front. Integr. Neurosci..

[6]  G. Rizzolatti,et al.  Coding of peripersonal space in inferior premotor cortex (area F4). , 1996, Journal of neurophysiology.

[7]  John J. Foxe,et al.  Multisensory contributions to low-level, ‘unisensory’ processing , 2005, Current Opinion in Neurobiology.

[8]  C. Gross,et al.  Visuospatial properties of ventral premotor cortex. , 1997, Journal of neurophysiology.

[9]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[10]  David Alais,et al.  Audiovisual temporal recalibration occurs independently at two different time scales , 2015, Scientific Reports.

[11]  D. Lehmann,et al.  Reference-free identification of components of checkerboard-evoked multichannel potential fields. , 1980, Electroencephalography and clinical neurophysiology.

[12]  D. Alais,et al.  True and Perceived Synchrony are Preferentially Associated With Particular Sensory Pairings , 2015, Scientific Reports.

[13]  Jean-Paul Noel,et al.  Audiovisual integration in depth: multisensory binding and gain as a function of distance , 2018, Experimental Brain Research.

[14]  Olaf Blanke,et al.  Neural adaptation accounts for the dynamic resizing of peripersonal space: evidence from a psychophysical-computational approach , 2018, Journal of neurophysiology.

[15]  Thomas Metzinger,et al.  Unconscious integration of multisensory bodily inputs in the peripersonal space shapes bodily self-consciousness , 2016, Cognition.

[16]  D. Alais,et al.  Rapid Recalibration to Audiovisual Asynchrony , 2013, The Journal of Neuroscience.

[17]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[18]  A Farnè,et al.  Dynamic size‐change of hand peripersonal space following tool use , 2000, Neuroreport.

[19]  P. Bertelson,et al.  Recalibration of temporal order perception by exposure to audio-visual asynchrony. , 2004, Brain research. Cognitive brain research.

[20]  J. Bizley The Neural Bases of Multisensory Processes , 2011 .

[21]  Mark T. Wallace,et al.  Increased Neural Strength and Reliability to Audiovisual Stimuli at the Boundary of Peripersonal Space , 2019, Journal of Cognitive Neuroscience.

[22]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[23]  Patrick Marmaroli,et al.  Body part-centered and full body-centered peripersonal space representations , 2015, Scientific Reports.

[24]  G. Verni,et al.  Amputation and prosthesis implantation shape body and peripersonal space representations , 2013, Scientific Reports.

[25]  José del R. Millán,et al.  Peri-personal space encoding in patients with disorders of consciousness and cognitive-motor dissociation , 2019, NeuroImage: Clinical.

[26]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[27]  C. Gross,et al.  A neuronal representation of the location of nearby sounds , 1999, Nature.

[28]  Gregor Thut,et al.  Auditory–Visual Multisensory Interactions in Humans: Timing, Topography, Directionality, and Sources , 2010, The Journal of Neuroscience.

[29]  Erik Van der Burg,et al.  Rapid, generalized adaptation to asynchronous audiovisual speech , 2015, Proceedings of the Royal Society B: Biological Sciences.

[30]  S. Nishida,et al.  Recalibration of audiovisual simultaneity , 2004, Nature Neuroscience.

[31]  Micah M. Murray,et al.  The Behavioral Relevance of Multisensory Neural Response Interactions , 2009, Frontiers in neuroscience.

[32]  Elisabetta Làdavas,et al.  Seeing where your hands are , 1997, Nature.

[33]  O. Blanke,et al.  Peripersonal space as the space of the bodily self , 2015, Cognition.

[34]  H. Ehrsson,et al.  Multisensory Representation of the Space Near the Hand , 2014, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[35]  D. Lehmann,et al.  Principles of spatial analysis , 1987 .

[36]  Randolph Blake,et al.  Probing Electrophysiological Indices of Perceptual Awareness across Unisensory and Multisensory Modalities , 2018, Journal of Cognitive Neuroscience.

[37]  Francesco Pavani,et al.  Action Planning Modulates Peripersonal Space , 2019, Journal of Cognitive Neuroscience.

[38]  Francesco Pavani,et al.  Grasping actions remap peripersonal space , 2009, Neuroreport.

[39]  Alessandro Farnè,et al.  Mind the Depth: Visual Perception of Shapes Is Better in Peripersonal Space , 2018, Psychological science.

[40]  Gian Domenico Iannetti,et al.  An Action Field Theory of Peripersonal Space , 2018, Trends in Cognitive Sciences.

[41]  Dylan F. Cooke,et al.  Sensorimotor integration in the precentral gyrus: polysensory neurons and defensive movements. , 2004, Journal of neurophysiology.

[42]  Andrea Serino,et al.  High Action Values Occur Near Our Body , 2019, Trends in Cognitive Sciences.

[43]  H. C. Dijkerman,et al.  On the contribution of overt tactile expectations to visuo-tactile interactions within the peripersonal space , 2017, Experimental Brain Research.

[44]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[45]  Dylan F. Cooke,et al.  Parieto-frontal interactions, personal space, and defensive behavior , 2006, Neuropsychologia.

[46]  Denis Brunet,et al.  Topographic ERP Analyses: A Step-by-Step Tutorial Review , 2008, Brain Topography.

[47]  Andrew J. Doxon,et al.  Peri-personal space as a prior in coupling visual and proprioceptive signals , 2018, Scientific Reports.

[48]  F. Pavani,et al.  Action-specific remapping of peripersonal space , 2010, Neuropsychologia.

[49]  M. Goldberg,et al.  Ventral intraparietal area of the macaque: congruent visual and somatic response properties. , 1998, Journal of neurophysiology.

[50]  G Rizzolatti,et al.  The Space Around Us , 1997, Science.

[51]  G. Rizzolatti,et al.  Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses , 1981, Behavioural Brain Research.

[52]  Tirin Moore,et al.  Complex movements evoked by microstimulation of the ventral intraparietal area , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Matthew A. De Niear,et al.  Atypical rapid audio‐visual temporal recalibration in autism spectrum disorders , 2017, Autism research : official journal of the International Society for Autism Research.

[54]  Andrea Serino,et al.  Everyday use of the computer mouse extends peripersonal space representation , 2010, Neuropsychologia.

[55]  Mauro Ursino,et al.  Visuotactile Representation of Peripersonal Space: A Neural Network Study , 2010, Neural Computation.

[56]  Bruno Herbelin,et al.  Peripersonal Space: An Index of Multisensory Body–Environment Interactions in Real, Virtual, and Mixed Realities , 2018, Front. ICT.

[57]  O. Blanke,et al.  Full body action remapping of peripersonal space: The case of walking , 2015, Neuropsychologia.

[58]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.

[59]  Andrea Serino,et al.  Peripersonal space (PPS) as a multisensory interface between the individual and the environment, defining the space of the self , 2019, Neuroscience & Biobehavioral Reviews.

[60]  A. Arnsten,et al.  Dynamic Network Connectivity: A new form of neuroplasticity , 2010, Trends in Cognitive Sciences.

[61]  A. Serino,et al.  Dynamic Sounds Capture the Boundaries of Peripersonal Space Representation in Humans , 2012, PloS one.

[62]  Matthew A. De Niear,et al.  Audiovisual Simultaneity Judgment and Rapid Recalibration throughout the Lifespan , 2016, PloS one.

[63]  Christoph M. Michel,et al.  Spatiotemporal Analysis of Multichannel EEG: CARTOOL , 2011, Comput. Intell. Neurosci..

[64]  S. Sterbing-D’Angelo,et al.  Behavioral/systems/cognitive Multisensory Space Representations in the Macaque Ventral Intraparietal Area , 2022 .

[65]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[66]  Elisa Magosso,et al.  Extending peripersonal space representation without tool-use: evidence from a combined behavioral-computational approach , 2015, Front. Behav. Neurosci..

[67]  Jon Driver,et al.  Active Tool Use with the Contralesional Hand Can Reduce Cross-modal Extinction of Touch on that Hand , 2002, Neurocase.

[68]  Olaf Blanke,et al.  Audio-Tactile and Peripersonal Space Processing Around the Trunk in Human Parietal and Temporal Cortex: An Intracranial EEG Study , 2018, bioRxiv.