A Comparison of Intention Estimation Methods for Decoder Calibration in Intracortical Brain–Computer Interfaces

<italic>Objective</italic>: Recent reports indicate that making better assumptions about the user's intended movement can improve decoder calibration for intracortical brain–computer interfaces. Several methods now exist for estimating user intent, including an optimal feedback control model, a piecewise-linear feedback control model, ReFIT, and other heuristics. Which of these methods yields the best decoding performance? <italic>Methods </italic>: Using data from the BrainGate2 pilot clinical trial, we measured how a steady-state velocity Kalman filter decoder was affected by the choice of intention estimation method. We examined three separate components of the Kalman filter: dimensionality reduction, temporal smoothing, and output gain (speed scaling). <italic>Results</italic>: The decoder's dimensionality reduction properties were largely unaffected by the intention estimation method (the unsmoothed velocity vectors differed by <inline-formula><tex-math notation="LaTeX">$< \text{5}\% $</tex-math> </inline-formula> in terms of how accurately they pointed at the target and how their speeds decreased near the target). In contrast, the smoothing and gain properties of the decoder were greatly affected (<inline-formula> <tex-math notation="LaTeX">$> \text{50}\% $</tex-math></inline-formula> difference in average values). Surprisingly, simulation results show that these differences in gain and smoothing values were largely arbitrary, as all methods failed to optimize the gain and smoothing values to match the task parameters. <italic>Conclusion</italic>: Our results show that, gain and smoothing differences aside, current intention estimation methods yield nearly equivalent decoders and that simple models of user intent, such as a position error vector (target position minus cursor position), perform comparably to more elaborate models. Our results also highlight that current calibration methods yield arbitrary differences in gain and smoothing properties that can confound decoder comparisons.

[1]  Paul Nuyujukian,et al.  Intention estimation in brain–machine interfaces , 2014, Journal of neural engineering.

[2]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[3]  Christine H. Blabe,et al.  Signal-independent noise in intracortical brain–computer interfaces causes movement time properties inconsistent with Fitts’ law , 2017, Journal of neural engineering.

[4]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[5]  Nicolas Y. Masse,et al.  Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface , 2015, Science Translational Medicine.

[6]  Joseph T. Francis,et al.  Towards a Naturalistic Brain-Machine Interface: Hybrid Torque and Position Control Allows Generalization to Novel Dynamics , 2013, PloS one.

[7]  Jose M. Carmena,et al.  Designing Dynamical Properties of Brain–Machine Interfaces to Optimize Task-Specific Performance , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[9]  Francis R. Willett,et al.  Continuous decoding of intended movements with a hybrid kinetic and kinematic brain machine interface , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Jose M. Carmena,et al.  Robust Brain-Machine Interface Design Using Optimal Feedback Control Modeling and Adaptive Point Process Filtering , 2016, PLoS Comput. Biol..

[11]  Anish A. Sarma,et al.  Clinical translation of a high-performance neural prosthesis , 2015, Nature Medicine.

[12]  Stephen I. Ryu,et al.  A High-Performance Keyboard Neural Prosthesis Enabled by Task Optimization , 2015, IEEE Transactions on Biomedical Engineering.

[13]  David Sussillo,et al.  A recurrent neural network for closed-loop intracortical brain–machine interface decoders , 2012, Journal of neural engineering.

[14]  Nicolas Y. Masse,et al.  Advantages of closed-loop calibration in intracortical brain–computer interfaces for people with tetraplegia , 2013, Journal of neural engineering.

[15]  Chethan Pandarinath,et al.  Feedback control policies employed by people using intracortical brain–computer interfaces , 2017, Journal of neural engineering.

[16]  Amar R. Marathe,et al.  The impact of command signal power distribution, processing delays, and speed scaling on neurally-controlled devices , 2015, Journal of neural engineering.

[17]  Francis R. Willett,et al.  High performance communication by people with paralysis using an intracortical brain-computer interface , 2017, eLife.

[18]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[19]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[20]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[21]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[22]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[23]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[24]  M. Nicolelis,et al.  Unscented Kalman Filter for Brain-Machine Interfaces , 2009, PloS one.

[25]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.

[26]  N.G. Hatsopoulos,et al.  Kinetic Trajectory Decoding Using Motor Cortical Ensembles , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Nicholas G Hatsopoulos,et al.  Improving brain–machine interface performance by decoding intended future movements , 2013, Journal of neural engineering.

[28]  J. M. Carmena,et al.  Closed-Loop Decoder Adaptation on Intermediate Time-Scales Facilitates Rapid BMI Performance Improvements Independent of Decoder Initialization Conditions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Francis R. Willett,et al.  Restoration of reaching and grasping in a person with tetraplegia through brain-controlled muscle stimulation: a proof-of-concept demonstration , 2017, The Lancet.

[30]  David Sussillo,et al.  Making brain–machine interfaces robust to future neural variability , 2016, Nature communications.

[31]  D. Humphrey,et al.  CORTICAL CONTROL OF A ROBOT USING A TIME-DELAY NEURAL NETWORK , 1997 .

[32]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[33]  Ziv M. Williams,et al.  A Real-Time Brain-Machine Interface Combining Motor Target and Trajectory Intent Using an Optimal Feedback Control Design , 2013, PloS one.

[34]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[35]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[36]  Robert E. Kass,et al.  2009 Special Issue: Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain-computer interface algorithms , 2009 .