Neural control of finger movement via intracortical brain–machine interface

OBJECTIVE Intracortical brain-machine interfaces (BMIs) are a promising source of prosthesis control signals for individuals with severe motor disabilities. Previous BMI studies have primarily focused on predicting and controlling whole-arm movements; precise control of hand kinematics, however, has not been fully demonstrated. Here, we investigate the continuous decoding of precise finger movements in rhesus macaques. APPROACH In order to elicit precise and repeatable finger movements, we have developed a novel behavioral task paradigm which requires the subject to acquire virtual fingertip position targets. In the physical control condition, four rhesus macaques performed this task by moving all four fingers together in order to acquire a single target. This movement was equivalent to controlling the aperture of a power grasp. During this task performance, we recorded neural spikes from intracortical electrode arrays in primary motor cortex. MAIN RESULTS Using a standard Kalman filter, we could reconstruct continuous finger movement offline with an average correlation of ρ  =  0.78 between actual and predicted position across four rhesus macaques. For two of the monkeys, this movement prediction was performed in real-time to enable direct brain control of the virtual hand. Compared to physical control, neural control performance was slightly degraded; however, the monkeys were still able to successfully perform the task with an average target acquisition rate of 83.1%. The monkeys' ability to arbitrarily specify fingertip position was also quantified using an information throughput metric. During brain control task performance, the monkeys achieved an average 1.01 bits s-1 throughput, similar to that achieved in previous studies which decoded upper-arm movements to control computer cursors using a standard Kalman filter. SIGNIFICANCE This is, to our knowledge, the first demonstration of brain control of finger-level fine motor skills. We believe that these results represent an important step towards full and dexterous control of neural prosthetic devices.

[1]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[2]  Lee E Miller,et al.  Prediction of upper limb muscle activity from motor cortical discharge during reaching , 2007, Journal of neural engineering.

[3]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[4]  John P. Cunningham,et al.  Single-trial dynamics of motor cortex and their applications to brain-machine interfaces , 2015, Nature Communications.

[5]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[6]  Marc H Schieber,et al.  Human finger independence: limitations due to passive mechanical coupling versus active neuromuscular control. , 2004, Journal of neurophysiology.

[7]  B. Greger,et al.  Decoding Dexterous Finger Movements in a Neural Prosthesis Model Approaching Real-World Conditions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[9]  Kwabena Boahen,et al.  Design and validation of a real-time spiking-neural-network decoder for brain–machine interfaces , 2013, Journal of neural engineering.

[10]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[11]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.

[12]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[13]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[14]  Lee E Miller,et al.  Movement representation in the primary motor cortex and its contribution to generalizable EMG predictions. , 2013, Journal of neurophysiology.

[15]  Nitish V. Thakor,et al.  Cortical decoding of individual finger and wrist kinematics for an upper-limb neuroprosthesis , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Dominique M. Durand,et al.  Motion control of musculoskeletal systems with redundancy , 2008, Biological Cybernetics.

[17]  Adam G. Rouse,et al.  A four-dimensional virtual hand brain–machine interface using active dimension selection , 2016, Journal of neural engineering.

[18]  Nicolas Y. Masse,et al.  Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface , 2015, Science Translational Medicine.

[19]  Bijan Pesaran,et al.  A training platform for many-dimensional prosthetic devices using a virtual reality environment , 2015, Journal of Neuroscience Methods.

[20]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[21]  M. M. Morrow,et al.  Direct comparison of the task-dependent discharge of M1 in hand space and muscle space. , 2007, Journal of neurophysiology.

[22]  M. Schieber Individuated finger movements of rhesus monkeys: a means of quantifying the independence of the digits. , 1991, Journal of neurophysiology.

[23]  Z T Irwin,et al.  Chronic recording of hand prosthesis control signals via a regenerative peripheral nerve interface in a rhesus macaque. , 2016, Journal of neural engineering.

[24]  Vikash Gilja,et al.  A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces. , 2011, Journal of neurophysiology.

[25]  H. Scherberger,et al.  Musculoskeletal Representation of a Large Repertoire of Hand Grasping Actions in Primates , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Mandayam A. Srinivasan,et al.  The Muscle Activation Method: An Approach to Impedance Control of Brain-Machine Interfaces Through a Musculoskeletal Model of the Arm , 2007, IEEE Transactions on Biomedical Engineering.

[27]  Hugo L. Fernandes,et al.  Primary motor cortical discharge during force field adaptation reflects muscle-like dynamics. , 2013, Journal of neurophysiology.

[28]  Hansjörg Scherberger,et al.  Representation of continuous hand and arm movements in macaque areas M1, F5, and AIP: a comparative decoding study , 2015, Journal of neural engineering.

[29]  R. Davoodi,et al.  Cortical control of reach and grasp kinematics in a virtual environment using musculoskeletal modeling software , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[30]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[31]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[32]  Luca Mainardi,et al.  Performance measurement for brain–computer or brain–machine interfaces: a tutorial , 2014, Journal of neural engineering.

[33]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[34]  Rahman Davoodi,et al.  Model-Based Development of Neural Prostheses for Movement , 2007, IEEE Transactions on Biomedical Engineering.

[35]  L R Hochberg,et al.  Efficient Decoding With Steady-State Kalman Filter in Neural Interface Systems , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Marc H Schieber,et al.  State-based decoding of hand and finger kinematics using neuronal ensemble and LFP activity during dexterous reach-to-grasp movements. , 2013, Journal of neurophysiology.

[37]  A Pouget,et al.  Decoding M1 neurons during multiple finger movements. , 2007, Journal of neurophysiology.