Decoding position, velocity, or goal: does it matter for brain-machine interfaces?

Arm end-point position, end-point velocity, and the intended final location or 'goal' of a reach have all been decoded from cortical signals for use in brain-machine interface (BMI) applications. These different aspects of arm movement can be decoded from the brain and used directly to control the position, velocity, or movement goal of a device. However, these decoded parameters can also be remapped to control different aspects of movement, such as using the decoded position of the hand to control the velocity of a device. People easily learn to use the position of a joystick to control the velocity of an object in a videogame. Similarly, in BMI systems, the position, velocity, or goal of a movement could be decoded from the brain and remapped to control some other aspect of device movement. This study evaluates how easily people make transformations between position, velocity, and reach goal in BMI systems. It also evaluates how different amounts of decoding error impact on device control with and without these transformations. Results suggest some remapping options can significantly improve BMI control. This study provides guidance on what remapping options to use when various amounts of decoding error are present.

[1]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[2]  F. Mussa-Ivaldi,et al.  Do neurons in the motor cortex encode movement direction? An alternative hypothesis , 1988, Neuroscience Letters.

[3]  A. Georgopoulos,et al.  Static spatial effects in motor cortex and area 5: Quantitative relations in a two-dimensional space , 1984, Experimental Brain Research.

[4]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[5]  E. Todorov.  Direct cortical control of muscle activation in voluntary arm movements: a model , 2000, Nature Neuroscience.

[6]  R. Andersen,et al.  Dorsal Premotor Neurons Encode the Relative Position of the Hand, Eye, and Goal during Reach Planning , 2006, Neuron.

[7]  Michael J. Black,et al.  Closed-loop neural control of cursor motion using a Kalman filter , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[9]  T. Ebner,et al.  Temporal encoding of movement kinematics in the discharge of primate primary motor and premotor neurons. , 1995, Journal of neurophysiology.

[10]  G E Alexander,et al.  Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[11]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[12]  J. Kalaska,et al.  A comparison of movement direction-related versus load direction- related activity in primate motor cortex, using a two-dimensional reaching task , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  A. P. Georgopoulos,et al.  Movement parameters and neural activity in motor cortex and area 5. , 1994, Cerebral cortex.

[14]  J. Ashe.  Force and the motor cortex , 1997, Behavioural Brain Research.

[15]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  E. Evarts,et al.  Relation of pyramidal tract activity to force exerted during voluntary movement. , 1968, Journal of neurophysiology.

[17]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.

[18]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[19]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[20]  J. Kalaska,et al.  Changes in the temporal pattern of primary motor cortex activity in a directional isometric force versus limb movement task. , 1998, Journal of neurophysiology.

[21]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[22]  Nicholas Hatsopoulos,et al.  Decoding continuous and discrete motor behaviors using motor and premotor cortical ensembles. , 2004, Journal of neurophysiology.

[23]  G E Alexander,et al.  Movement-related neuronal activity selectively coding either direction or muscle pattern in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[24]  M. Nicolelis,et al.  Optimizing a Linear Algorithm for Real-Time Robotic Control using Chronic Cortical Ensemble Recordings in Monkeys , 2004, Journal of Cognitive Neuroscience.

[25]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. III. Positional gradients and population coding of movement direction from various movement origins , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  M. M. Morrow,et al.  Prediction of muscle activity by populations of sequentially recorded primary motor cortex neurons. , 2003, Journal of neurophysiology.

[27]  D. Hoffman,et al.  Muscle and movement representations in the primary motor cortex. , 1999, Science.

[28]  A. Georgopoulos,et al.  The motor cortex and the coding of force. , 1992, Science.

[29]  R Caminiti,et al.  Making arm movements within different parts of space: the premotor and motor cortical representation of a coordinate system for reaching to visual targets , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[31]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[32]  A. Georgopoulos,et al.  On the relations between single cell activity in the motor cortex and the direction and magnitude of three-dimensional static isometric force , 2004, Experimental Brain Research.

[33]  E. Fetz,et al.  Control of forelimb muscle activity by populations of corticomotoneuronal and rubromotoneuronal cells. , 1989, Progress in brain research.

[34]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[35]  Wei Wu,et al.  Neural Decoding of Cursor Motion Using a Kalman Filter , 2002, NIPS.