Multisensory Integration during Motor Planning

When planning goal-directed reaches, subjects must estimate the position of the arm by integrating visual and proprioceptive signals from the sensory periphery. These integrated position estimates are required at two stages of motor planning: first to determine the desired movement vector, and second to transform the movement vector into a joint-based motor command. We quantified the contributions of each sensory modality to the position estimate formed at each planning stage. Subjects made reaches in a virtual reality environment in which vision and proprioception were dissociated by shifting the location of visual feedback. The relative weighting of vision and proprioception at each stage was then determined using computational models of feedforward motor control. We found that the position estimate used for movement vector planning relies mostly on visual input, whereas the estimate used to compute the joint-based motor command relies more on proprioceptive signals. This suggests that when estimating the position of the arm, the brain selects different combinations of sensory input based on the computation in which the resulting estimate will be used.

[1]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[3]  Christopher A. Buneo,et al.  Direct visuomotor transformations for reaching , 2002, Nature.

[4]  J. Gordon,et al.  Accuracy of planar reaching movements , 1994, Experimental Brain Research.

[5]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[6]  James Gordon,et al.  Accuracy of planar reaching movements , 1994, Experimental Brain Research.

[7]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. , 1997, Journal of neurophysiology.

[8]  C. Prablanc,et al.  Automatic control during hand reaching at undetected two-dimensional target displacements. , 1992, Journal of neurophysiology.

[9]  D. Hoffman,et al.  Muscle and movement representations in the primary motor cortex. , 1999, Science.

[10]  Scott T. Grafton,et al.  Role of the posterior parietal cortex in updating reaching movements to a visual target , 1999, Nature Neuroscience.

[11]  J. Gordon,et al.  Learning a visuomotor transformation in a local area of work space produces directional biases in other areas. , 1995, Journal of neurophysiology.

[12]  Zoubin Ghahramani,et al.  Computation and psychophysics of sensorimotor integration , 1996 .

[13]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[14]  M. Latash,et al.  Effects of altering initial position on movement direction and extent. , 2003, Journal of neurophysiology.

[15]  J Paillard,et al.  Fast and slow feedback loops for the visual correction of spatial errors in a pointing task: a reappraisal. , 1996, Canadian journal of physiology and pharmacology.

[16]  E. Todorov Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[17]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[18]  D H Warren,et al.  On the plasticity of visual-proprioceptive bias effects. , 1978, Journal of experimental psychology. Human perception and performance.

[19]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[20]  I. Howard,et al.  Human Spatial Orientation , 1966 .

[21]  Michael I. Jordan,et al.  Obstacle Avoidance and a Perturbation Sensitivity Model for Motor Planning , 1997, The Journal of Neuroscience.

[22]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  R B Welch,et al.  An examination of the relationship between visual capture and prism adaptation , 1979, Perception & psychophysics.

[24]  R. J. van Beers,et al.  Integration of proprioceptive and visual position-information: An experimentally supported model. , 1999, Journal of neurophysiology.

[25]  Paul B. Johnson,et al.  Premotor and parietal cortex: corticocortical connectivity and combinatorial computations. , 1997, Annual review of neuroscience.

[26]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[27]  E. Fetz,et al.  Functional classes of primate corticomotoneuronal cells and their relation to active force. , 1980, Journal of neurophysiology.

[28]  M. Goodale,et al.  The visual brain in action , 1995 .

[29]  M S Graziano,et al.  Coding the location of the arm by sight. , 2000, Science.

[30]  Julie Messier,et al.  Differential effect of task conditions on errors of direction and extent of reaching movements , 1997, Experimental Brain Research.

[31]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[32]  C. Prablanc,et al.  Vectorial coding of movement: vision, proprioception, or both? , 1995, Journal of neurophysiology.

[33]  A. Bahill,et al.  Determining ideal baseball bat weights using muscle force-velocity relationships , 1989, Biological Cybernetics.

[34]  D. Wolpert,et al.  The effect of visuomotor displacements on arm movement paths , 1999, Experimental Brain Research.

[35]  J. F. Soechting,et al.  Invariant characteristics of a pointing movement in man , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  J. F. Soechting,et al.  Errors in pointing are due to approximations in sensorimotor transformations. , 1989, Journal of neurophysiology.

[37]  C. Atkeson,et al.  Kinematic features of unrestrained vertical arm movements , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  C. Colby,et al.  Spatial representations for action in parietal cortex. , 1996, Brain research. Cognitive brain research.

[39]  M. Graziano Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Anne C. Sittig,et al.  The precision of proprioceptive position sense , 1998, Experimental Brain Research.

[41]  Melvyn A. Goodale,et al.  The dissociation between perception and action in the Ebbinghaus illusion Nonillusory effects of pictorial cues on grasp , 2001, Current Biology.

[42]  M. Goodale,et al.  Size-contrast illusions deceive the eye but not the hand , 1995, Current Biology.

[43]  S. Scott,et al.  Reaching movements with similar hand paths but different arm orientations. II. Activity of individual cells in dorsal premotor cortex and parietal area 5. , 1997, Journal of neurophysiology.

[44]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.