Peripersonal Space: An Index of Multisensory Body–Environment Interactions in Real, Virtual, and Mixed Realities

Human-environment interactions normally occur in the physical milieu, and thus by medium of the body and within the space immediately adjacent to and surrounding the body; the peri-personal space (PPS). However, human interactions increasingly occur with or within virtual environments, and hence novel approaches and metrics must be developed to index human-environment interactions in virtual reality (VR). Here we present a multisensory task that measures the spatial extent of human PPS in real, virtual, and augmented realities. We validated it in a mixed reality ecosystem in which real environment and virtual objects are blended together in order to administer and control visual, auditory, and tactile stimuli in ecologically valid conditions. Within this mixed-reality environment, participants are asked to respond as fast as possible to tactile stimuli on their body, while task-irrelevant visual or audio-visual stimuli approach their body. Results demonstrate that, in analogy with observations derived from monkey electrophysiology and in real environmental surroundings, tactile detection is enhanced when visual or auditory stimuli are close to the body, and not when far from it. We then calculate the location where this multisensory facilitation occurs as a proxy of the boundary of PPS. We observe that mapping of PPS via audio-visual, as opposed to visual alone, looming stimuli results in sigmoidal fits – allowing for the bifurcation between near and far space – with greater goodness of fit. In sum, our approach is able to capture the boundaries of PPS on a spatial continuum, at the individual-subject level, and within a fully controlled and previously laboratory-validated setup, while maintaining the richness and ecological validity of real-life events. The task can therefore be applied to study the properties of peri-personal space in humans and to index the features governing human-environment interactions in virtual or mixed reality. We propose PPS as an ecologically valid and neurophysiologically established metric in the study of the impact of VR and related technologies on society and individuals.

[1]  C. Gross,et al.  Visuospatial properties of ventral premotor cortex. , 1997, Journal of neurophysiology.

[2]  Olaf Blanke,et al.  The wheelchair as a full-body tool extending the peripersonal space , 2015, Front. Psychol..

[3]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[4]  G Rizzolatti,et al.  The Space Around Us , 1997, Science.

[5]  E. Làdavas Functional and dynamic properties of visual peripersonal space , 2002, Trends in Cognitive Sciences.

[6]  G. Rizzolatti,et al.  Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses , 1981, Behavioural Brain Research.

[7]  Stella F. Lourenco,et al.  Near space and its relation to claustrophobic fear , 2011, Cognition.

[8]  O. Blanke,et al.  Neural Mechanisms of Bodily Self-Consciousness and the Experience of Presence in Virtual Reality , 2016 .

[9]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[10]  G. Rizzolatti,et al.  Coding of peripersonal space in inferior premotor cortex (area F4). , 1996, Journal of neurophysiology.

[11]  Mar Gonzalez-Franco,et al.  Concurrent talking in immersive virtual reality: on the dominance of visual speech cues , 2017, Scientific Reports.

[12]  Albert Jin Chung,et al.  Perception of Body Ownership Is Driven by Bayesian Sensory Inference , 2015, PloS one.

[13]  Valentina Rastelli,et al.  Tool-use reshapes the boundaries of body and peripersonal space representations , 2013, Experimental Brain Research.

[14]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[15]  Suliann Ben Hamed,et al.  The Prediction of Impact of a Looming Stimulus onto the Body Is Subserved by Multisensory Integration Mechanisms , 2017, The Journal of Neuroscience.

[16]  B. Herbelin,et al.  Social perception of others shapes one's own multisensory peripersonal space , 2017, Cortex.

[17]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[18]  Justine C. Cléry,et al.  Neuronal bases of peripersonal and extrapersonal spaces, their plasticity and their dynamics: Knowns and unknowns , 2015, Neuropsychologia.

[19]  G. Pellegrino,et al.  Social Modulation of Peripersonal Space Boundaries , 2013, Current Biology.

[20]  M. Goldberg,et al.  Ventral intraparietal area of the macaque: congruent visual and somatic response properties. , 1998, Journal of neurophysiology.

[21]  Olaf Blanke,et al.  Behavioral, Neural, and Computational Principles of Bodily Self-Consciousness , 2015, Neuron.

[22]  Gian Domenico Iannetti,et al.  Better Safe Than Sorry? The Safety Margin Surrounding the Body Is Increased by Anxiety , 2013, The Journal of Neuroscience.

[23]  A. Farnè,et al.  Disentangling Action from Social Space: Tool-Use Differently Shapes the Space around Us , 2016, PloS one.

[24]  A. Pouget,et al.  Reference frames for representing visual and tactile locations in parietal cortex , 2005, Nature Neuroscience.

[25]  O. Blanke,et al.  Full body action remapping of peripersonal space: The case of walking , 2015, Neuropsychologia.

[26]  Elisa Magosso,et al.  Extending peripersonal space representation without tool-use: evidence from a combined behavioral-computational approach , 2015, Front. Behav. Neurosci..

[27]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[28]  Patrick Marmaroli,et al.  Body part-centered and full body-centered peripersonal space representations , 2015, Scientific Reports.

[29]  Andrea Serino,et al.  Variability in Multisensory Responses Predicts the Self-Space , 2016, Trends in Cognitive Sciences.

[30]  H. C. Dijkerman,et al.  On the contribution of overt tactile expectations to visuo-tactile interactions within the peripersonal space , 2017, Experimental Brain Research.

[31]  Dylan F. Cooke,et al.  Parieto-frontal interactions, personal space, and defensive behavior , 2006, Neuropsychologia.

[32]  Ana Tajadura-Jiménez,et al.  Emotion-inducing approaching sounds shape the boundaries of multisensory peripersonal space , 2015, Neuropsychologia.

[33]  Isabelle Viaud-Delmon,et al.  Cynophobic Fear Adaptively Extends Peri-Personal Space , 2014, Front. Psychiatry.

[34]  T. Metzinger,et al.  Full-body illusions and minimal phenomenal selfhood , 2009, Trends in Cognitive Sciences.

[35]  M. Tsakiris My body in the brain: A neurocognitive model of body-ownership , 2010, Neuropsychologia.

[36]  G. Verni,et al.  Amputation and prosthesis implantation shape body and peripersonal space representations , 2013, Scientific Reports.

[37]  O. Blanke Multisensory brain mechanisms of bodily self-consciousness , 2012, Nature Reviews Neuroscience.

[38]  M. Wallace,et al.  Multisensory simultaneity judgment and proximity to the body , 2016, Journal of vision.

[39]  T. Pozzo,et al.  Dissociating effect of upper limb non-use and overuse on space and body representations , 2015, Neuropsychologia.

[40]  Andrea Serino,et al.  Action-dependent plasticity in peripersonal space representations , 2008, Cognitive neuropsychology.

[41]  G. D. Iannetti,et al.  How many peripersonal spaces? , 2015, Neuropsychologia.

[42]  G. Rizzolatti,et al.  Afferent properties of periarcuate neurons in macaque monkeys. I. Somatosensory responses , 1981, Behavioural Brain Research.

[43]  Guido Alessandri,et al.  Evaluating Intervention Programs with a Pretest-Posttest Design: A Structural Equation Modeling Approach , 2017, Front. Psychol..

[44]  Gian Luca Romani,et al.  Intertrial Variability in the Premotor Cortex Accounts for Individual Differences in Peripersonal Space , 2015, The Journal of Neuroscience.

[45]  A. Serino,et al.  Dynamic Sounds Capture the Boundaries of Peripersonal Space Representation in Humans , 2012, PloS one.

[46]  Ulrik R. Beierholm,et al.  Causal inference in perception , 2010, Trends in Cognitive Sciences.

[47]  E. Macaluso,et al.  The representation of space near the body through touch and vision , 2010, Neuropsychologia.

[48]  Y. Coello,et al.  Body Space in Social Interactions: A Comparison of Reaching and Comfort Distance in Immersive Virtual Reality , 2014, PloS one.

[49]  Alisa Mandrigin,et al.  Bodily ownership and self-location: Components of bodily self-consciousness , 2013, Consciousness and Cognition.

[50]  F. Galante,et al.  Peripersonal and interpersonal space in virtual and real environments: Effects of gender and age , 2016 .

[51]  O. Blanke,et al.  Peripersonal space as the space of the bodily self , 2015, Cognition.

[52]  Joan López-Moliner,et al.  The sense of body ownership relaxes temporal constraints for multisensory integration , 2016, Scientific Reports.

[53]  D. Lloyd Spatial limits on referred touch to an alien limb may reflect boundaries of visuo-tactile peripersonal space surrounding the hand , 2007, Brain and Cognition.

[54]  D. Newport,et al.  Transient natural convection in a conducting enclosure heated from above , 2013, J. Vis..

[55]  J. Lanier,et al.  Model of Illusions and Virtual Reality , 2017, Front. Psychol..

[56]  Thomas Metzinger,et al.  Unconscious integration of multisensory bodily inputs in the peripersonal space shapes bodily self-consciousness , 2016, Cognition.

[57]  B. Stein The new handbook of multisensory processes , 2012 .

[58]  Giuseppe di Pellegrino,et al.  Personal space regulation in childhood autism: Effects of social interaction and person's perspective , 2017, Autism research : official journal of the International Society for Autism Research.

[59]  C. Spence,et al.  Multisensory integration and the body schema: close to hand and within reach , 2003, Current Biology.