Agency and Control for the Integration of a Virtual Tool into the Peripersonal Space

Our representation of the peripersonal space is tied to our representation of our bodies. This representation appears to be flexible and it can be updated to include the space in which tools work, particularly when the tool is actively used. One indicator of this update is the increased efficiency with which sensory events near the tool are processed. In the present study we examined the role of visuomotor control in extending peripersonal space to a common virtual tool—a computer mouse cursor. In particular, after participants were exposed to different spatial mappings between movements of the mouse cursor and movements of their hand, participants' performance in a motion-onset detection task was measured, with the mouse cursor as the stimulus. When participants, during exposure, had the ability to move the cursor efficiently and accurately (familiar hand-cursor mapping), they detected motion-onset targets more quickly than when they could not move the cursor at all during exposure (no hand-cursor mapping). Importantly, reversing the spatial correspondence between the movements of the hand and the cursor (unfamiliar hand-cursor mapping) during exposure, which was thought to preserve the ability to move the cursor (ie agency) while weakening the ability to make the movements efficiently and accurately (ie control), eliminated the detection-facilitation effect. These results provide evidence for the possible extension of peripersonal space to frequently used objects in the virtual domain. Importantly, these extensions seem to depend on the participant's knowledge of the dynamic spatial mapping between the acting limb and the visible virtual tool.

[1]  Melvyn A Goodale,et al.  Motor Force Field Learning Influences Visual Processing of Target Motion , 2007, The Journal of Neuroscience.

[2]  M. Hallett,et al.  The neural processes underlying self-agency. , 2011, Cerebral cortex.

[3]  R. Ward,et al.  Virtual limbs and body space: Critical features for the distinction between body space and near-body space. , 2009, Journal of experimental psychology. Human perception and performance.

[4]  Silvia Bonifazi,et al.  The role played by tool-use and tool-length on the Plastic Elongation of peri-hand space: a single case study , 2005, Cognitive neuropsychology.

[5]  Nicholas P. Holmes,et al.  Tool use changes multisensory interactions in seconds: evidence from the crossmodal congruency task , 2007, Experimental Brain Research.

[6]  R. Held.  Dissociation of visual functions by deprivation and rearrangement , 1968 .

[7]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[8]  W. T. Thach,et al.  Throwing while looking through prisms. I. Focal olivocerebellar lesions impair adaptation. , 1996, Brain : a journal of neurology.

[9]  G. Rognini,et al.  Extending the Body to Virtual Tools Using a Robotic Surgical Interface: Evidence from the Crossmodal Congruency Task , 2012, PloS one.

[10]  C. Spence,et al.  Tool-use changes multimodal spatial interactions between vision and touch in normal humans , 2002, Cognition.

[11]  Tamar Flash,et al.  Computational approaches to motor control , 2001, Current Opinion in Neurobiology.

[12]  R. Klein,et al.  The presence of a nonresponding effector increases inhibition of return , 2001, Psychonomic bulletin & review.

[13]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[14]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[15]  V. Gallese,et al.  Tool-use observation makes far objects ready-to-hand , 2011, Neuropsychologia.

[16]  Andrea Serino,et al.  Everyday use of the computer mouse extends peripersonal space representation , 2010, Neuropsychologia.

[17]  M. Goodale,et al.  Enhanced detection of visual targets on the hand and familiar tools , 2009, Neuropsychologia.

[18]  Robert L. Sainburg,et al.  Mechanisms underlying interlimb transfer of visuomotor rotations , 2003, Experimental Brain Research.

[19]  R. Passingham,et al.  That's My Hand! Activity in Premotor Cortex Reflects Feeling of Ownership of a Limb , 2004, Science.

[20]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[21]  Thomas A Carlson,et al.  Rapid Assimilation of External Objects Into the Body Schema , 2010, Psychological science.

[22]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[23]  Melvyn A. Goodale,et al.  Vision in the palm of your hand , 2009, Neuropsychologia.

[24]  Francesca Frassinetti,et al.  Direct evidence from parietal extinction of enhancement of visual attention near a visible hand , 2000, Current Biology.

[25]  Jon Driver,et al.  Reaching with a tool extends visual–tactile interactions into far space: evidence from cross-modal extinction , 2001, Neuropsychologia.

[26]  Catherine L. Reed,et al.  Grab it! Biased attention in functional hand and tool space , 2010, Attention, perception & psychophysics.

[27]  R. Hari,et al.  Preference of Personal to Extrapersonal Space in a Visuomotor Task , 1996, Journal of Cognitive Neuroscience.

[28]  Andrea Serino,et al.  Dynamic Size-Change of Peri-Hand Space Following Tool-Use: Determinants and Spatial Characteristics Revealed Through Cross-Modal Extinction , 2007, Cortex.

[29]  Alessandro Farnè,et al.  Peripersonal Space and Body Schema: Two Labels for the Same Concept? , 2009, Brain Topography.

[30]  Nicholas P. Holmes,et al.  Tool-Use: Capturing Multisensory Spatial Attention or Extending Multisensory Peripersonal Space? , 2007, Cortex.

[31]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[32]  P. Haggard,et al.  Visual processing and the bodily self. , 2008, Acta psychologica.

[33]  A. Dufour,et al.  Improved visual sensitivity in the perihand space , 2008, Experimental Brain Research.

[34]  Kazuo Hiraki,et al.  The parietal role in the sense of self-ownership with temporal discrepancy between visual and proprioceptive feedbacks , 2005, NeuroImage.

[35]  P. Haggard,et al.  Sense of Agency Primes Manual Motor Responses , 2009, Perception.

[36]  Atsushi Iriki,et al.  Shaping multisensory action–space with tools: evidence from patients with cross-modal extinction , 2005, Neuropsychologia.

[37]  M. Kawato,et al.  A hierarchical neural-network model for control and learning of voluntary movement , 2004, Biological Cybernetics.

[38]  P. Haggard,et al.  Facilitated Processing of Visual Stimuli Associated with the Body , 2004, Perception.

[39]  Masao Ito.  The Cerebellum And Neural Control , 1984 .

[40]  M. Graziano.  Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[41]  A. Berti,et al.  When Far Becomes Near: Remapping of Space by Tool Use , 2000, Journal of Cognitive Neuroscience.

[42]  Charles G. Gross,et al.  Visual responses with and without fixation: neurons in premotor cortex encode spatial locations independently of eye position , 1998, Experimental Brain Research.