When Kinesthesia Becomes Visual: A Theoretical Justification for Executing Motor Tasks in Visual Space

Several experimental studies in the literature have shown that even when performing purely kinesthetic tasks, such as reaching for a kinesthetically felt target with a hidden hand, the brain reconstructs a visual representation of the movement. In our previous studies, however, we did not observe any role of a visual representation of the movement in a purely kinesthetic task. This apparent contradiction could be related to a fundamental difference between the studied tasks. In our study subjects used the same hand to both feel the target and to perform the movement, whereas in most other studies, pointing to a kinesthetic target consisted of pointing with one hand to the finger of the other, or to some other body part. We hypothesize, therefore, that it is the necessity of performing inter-limb transformations that induces a visual representation of purely kinesthetic tasks. To test this hypothesis we asked subjects to perform the same purely kinesthetic task in two conditions: INTRA and INTER. In the former they used the right hand to both perceive the target and to reproduce its orientation. In the latter, subjects perceived the target with the left hand and responded with the right. To quantify the use of a visual representation of the movement we measured deviations induced by an imperceptible conflict that was generated between visual and kinesthetic reference frames. Our hypothesis was confirmed by the observed deviations of responses due to the conflict in the INTER, but not in the INTRA, condition. To reconcile these observations with recent theories of sensori-motor integration based on maximum likelihood estimation, we propose here a new model formulation that explicitly considers the effects of covariance between sensory signals that are directly available and internal representations that are ‘reconstructed’ from those inputs through sensori-motor transformations.

[1]  Anne C. Sittig,et al.  The precision of proprioceptive position sense , 1998, Experimental Brain Research.

[2]  S. Appelle Perception and discrimination as a function of stimulus orientation: the "oblique effect" in man and animals. , 1972, Psychological bulletin.

[3]  F. Rösler,et al.  Interaction between gaze and visual and proprioceptive position judgements , 2010, Experimental Brain Research.

[4]  Pietro G. Morasso,et al.  Self-Organization, Computational Maps, and Motor Control , 1997 .

[5]  Claire Leconte,et al.  The plasticity of gravitational reference frame and the subjective vertical: Peripheral visual information affects the oblique effect , 2005, Neuroscience Letters.

[6]  R. Sainburg,et al.  The effect of target modality on visual and proprioceptive contributions to the control of movement distance , 2006, Experimental Brain Research.

[7]  D. Goble,et al.  Upper limb asymmetries in the matching of proprioceptive versus visual targets. , 2008, Journal of neurophysiology.

[8]  S. Adamovich,et al.  Pointing in 3D space to remembered targets. I. Kinesthetic versus visual target presentation. , 1998, Journal of neurophysiology.

[9]  Astrid M. L. Kappers,et al.  Intramanual and intermanual transfer of the curvature aftereffect , 2008, Experimental Brain Research.

[10]  Alexandre Pouget,et al.  A computational perspective on the neural basis of multisensory spatial representations , 2002, Nature Reviews Neuroscience.

[11]  Erik J Schlicht,et al.  Impact of coordinate transformation uncertainty on human sensorimotor control. , 2007, Journal of neurophysiology.

[12]  Richard B. Ivry,et al.  Intermanual interactions during initiation and production of rhythmic and discrete movements in individuals lacking a corpus callosum , 2007, Experimental Brain Research.

[13]  Gabriele Polonara,et al.  Contribution of posterior corpus callosum to the interhemispheric transfer of tactile information. , 2005, Brain research. Cognitive brain research.

[14]  Gunnar Blohm,et al.  Multi-Sensory Weights Depend on Contextual Noise in Reference Frame Transformations , 2010, Front. Hum. Neurosci..

[15]  F. Lacquaniti,et al.  Short-Term Memory for Reaching to Visual Targets: Psychophysical Evidence for Body-Centered Reference Frames , 1998, The Journal of Neuroscience.

[16]  J. F. Soechting,et al.  Transformation from Head- to Shoulder-Centered Representation of Target Direction in Arm Movements , 1990, Journal of Cognitive Neuroscience.

[17]  J F Soechting,et al.  A coordinate system for the synthesis of visual and kinesthetic information , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Ian P. Howard,et al.  Human visual orientation , 1982 .

[19]  M. Mon-Williams,et al.  Synaesthesia in the normal limb , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[20]  Katja Fiehler,et al.  A task-dependent effect of memory and hand-target on proprioceptive localization , 2012, Neuropsychologia.

[21]  W Pieter Medendorp,et al.  Behavioral reference frames for planning human reaching movements. , 2006, Journal of neurophysiology.

[22]  M. Landy,et al.  Weighted linear cue combination with possibly correlated error , 2003, Vision Research.

[23]  Philip N. Sabes,et al.  Sensory transformations and the use of multiple reference frames for reach planning , 2009, Nature Neuroscience.

[24]  J. F. Soechting,et al.  Errors in pointing are due to approximations in sensorimotor transformations. , 1989, Journal of neurophysiology.

[25]  Joseph McIntyre,et al.  Central Processes Amplify and Transform Anisotropies of the Visual System in a Test of Visual–Haptic Coordination , 2008, The Journal of Neuroscience.

[26]  Michele Tagliabue,et al.  Necessity is the Mother of Invention: Reconstructing Missing Sensory Information in Multiple, Concurrent Reference Frames for Eye–Hand Coordination , 2011, The Journal of Neuroscience.

[27]  Robert J. van Beers,et al.  How humans combine simultaneous proprioceptive and visual position information , 1996, Experimental Brain Research.

[28]  S. Jbabdi,et al.  How can a Bayesian approach inform neuroscience? , 2012, The European journal of neuroscience.

[29]  Christopher A. Buneo,et al.  Direct visuomotor transformations for reaching , 2002, Nature.

[30]  J. Crawford,et al.  Gaze-Centered Remapping of Remembered Visual Space in an Open-Loop Pointing Task , 1998, The Journal of Neuroscience.

[31]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[32]  Philip N. Sabes,et al.  Flexible strategies for sensory integration during motor planning , 2005, Nature Neuroscience.

[33]  A. Pouget,et al.  Multisensory spatial representations in eye-centered coordinates for reaching , 2002, Cognition.

[34]  F. Lacquaniti,et al.  Viewer-centered frame of reference for pointing to memorized targets in three-dimensional space. , 1997, Journal of neurophysiology.

[35]  Michele Tagliabue,et al.  Eye-hand coordination when the body moves: Dynamic egocentric and exocentric sensory encoding , 2012, Neuroscience Letters.

[36]  J. Koenderink,et al.  Intermanual and intramanual tactual grating discrimination , 2005, Experimental Brain Research.

[37]  P Viviani,et al.  Pointing to Kinesthetic Targets in Space , 1998, The Journal of Neuroscience.

[38]  Philip N. Sabes,et al.  Sensory integration for reaching: models of optimality in the context of behavior and the underlying neural circuits. , 2011, Progress in brain research.

[39]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[40]  Gabriel Baud-Bovy,et al.  Amplitude and direction errors in kinesthetic pointing , 2004, Experimental Brain Research.

[41]  Erin K. Cressman,et al.  Proprioceptive localization of the left and right hands , 2010, Experimental Brain Research.

[42]  Daniel M Wolpert,et al.  Computational principles of sensorimotor control that minimize uncertainty and variability , 2007, The Journal of physiology.

[43]  Angelo Quattrini,et al.  Posterior Corpus Callosum and Interhemispheric Transfer of Somatosensory Information: An fMRI and Neuropsychological Study of a Partially Callosotomized Patient , 2001, Journal of Cognitive Neuroscience.

[44]  S. Adamovich,et al.  Pointing in 3D space to remembered targets II: Effects of movement speed toward kinesthetically defined targets , 1999, Experimental Brain Research.

[45]  J. F. Soechting,et al.  Early stages in a sensorimotor transformation , 1992, Behavioral and Brain Sciences.

[46]  A. Gordon,et al.  Contribution of tactile information to accuracy in pointing movements , 2001, Experimental Brain Research.

[47]  Michael I. Jordan,et al.  Computational models of sensorimotor integration , 1997 .

[48]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[49]  Intermanual transfer of somaesthetic information: A two-point discrimination experiment , 1996, Neuropsychologia.

[50]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.