A Study on Decoding Models for the Reconstruction of Hand Trajectories from the Human Magnetoencephalography

Decoding neural signals into control outputs has been a key to the development of brain-computer interfaces (BCIs). While many studies have identified neural correlates of kinematics or applied advanced machine learning algorithms to improve decoding performance, relatively less attention has been paid to optimal design of decoding models. For generating continuous movements from neural activity, design of decoding models should address how to incorporate movement dynamics into models and how to select a model given specific BCI objectives. Considering nonlinear and independent speed characteristics, we propose a hybrid Kalman filter to decode the hand direction and speed independently. We also investigate changes in performance of different decoding models (the linear and Kalman filters) when they predict reaching movements only or predict both reach and rest. Our offline study on human magnetoencephalography (MEG) during point-to-point arm movements shows that the performance of the linear filter or the Kalman filter is affected by including resting states for training and predicting movements. However, the hybrid Kalman filter consistently outperforms others regardless of movement states. The results demonstrate that better design of decoding models is achieved by incorporating movement dynamics into modeling or selecting a model according to decoding objectives.

[1]  Yehezkel Yeshurun,et al.  Multiple lines of evidence link the SMA proper to Encoding of speed and direction of movement in the human supplementary motor area Laboratory investigation , 2022 .

[2]  Matthew Fellows,et al.  Robustness of neuroprosthetic decoding algorithms , 2003, Biological Cybernetics.

[3]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[4]  Mark L. Homer,et al.  Sensors and decoding for intracortical brain computer interfaces. , 2013, Annual review of biomedical engineering.

[5]  Masa-aki Sato,et al.  Reconstruction of two-dimensional movement trajectories from selected magnetoencephalography cortical currents by combined sparse Bayesian methods , 2011, NeuroImage.

[6]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[7]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[8]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[9]  José Carlos Príncipe,et al.  Bimodal brain-machine interface for motor control of robotic prosthetic , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Sherwin S Chan,et al.  Motor cortical representation of position and velocity during reaching. , 2007, Journal of neurophysiology.

[11]  Cuntai Guan,et al.  Brain-Computer Interface in Stroke Rehabilitation , 2013, J. Comput. Sci. Eng..

[12]  A. P. Georgopoulos,et al.  Movement parameters and neural activity in motor cortex and area 5. , 1994, Cerebral cortex.

[13]  H. Yokoi,et al.  Electrocorticographic control of a prosthetic arm in paralyzed patients , 2012, Annals of neurology.

[14]  Ronald N. Goodman,et al.  Neural decoding of treadmill walking from noninvasive electroencephalographic signals. , 2011, Journal of neurophysiology.

[15]  June Sic Kim,et al.  Estimation of the velocity and trajectory of three-dimensional reaching movements from non-invasive magnetoencephalography signals , 2013, Journal of neural engineering.

[16]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[17]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[18]  Nicholas G Hatsopoulos,et al.  The science of neural interface systems. , 2009, Annual review of neuroscience.

[19]  R G Radwin,et al.  Evaluation of a modified Fitts law brain–computer interface target acquisition task in able and motor disabled individuals , 2009, Journal of neural engineering.

[20]  Ethan R. Buch,et al.  Think to Move: a Neuromagnetic Brain-Computer Interface (BCI) System for Chronic Stroke , 2008, Stroke.

[21]  Michael J. Black,et al.  Point-and-Click Cursor Control With an Intracortical Neural Interface System by Humans With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  N. Birbaumer,et al.  On the Usage of Linear Regression Models to Reconstruct Limb Kinematics from Low Frequency EEG Signals , 2013, PloS one.

[23]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[24]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[25]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[26]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[27]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[28]  Michael J. Black,et al.  Decoding Complete Reach and Grasp Actions from Local Primary Motor Cortex Populations , 2010, The Journal of Neuroscience.

[29]  José Carlos Príncipe,et al.  Sequential Monte Carlo Point-Process Estimation of Kinematics from Neural Spiking Activity for Brain-Machine Interfaces , 2009, Neural Computation.

[30]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[31]  Yoram Singer,et al.  Spikernels: Predicting Arm Movements by Embedding Population Spike Rate Patterns in Inner-Product Spaces , 2005, Neural Computation.

[32]  Byron M. Yu,et al.  Mixture of Trajectory Models for Neural Decoding of Goal-directed Movements a Computational Model of Craving and Obsession Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe Encoding Contribution of Individual Retinal Ganglion Cell Responses to Velocity and Acceleration , 2008 .

[33]  John P. Donoghue,et al.  Connecting cortex to machines: recent advances in brain interfaces , 2002, Nature Neuroscience.

[34]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[35]  N. Hatsopoulos,et al.  Encoding of Coordinated Reach and Grasp Trajectories in Primary Motor Cortex , 2012, The Journal of Neuroscience.

[36]  S. Taulu,et al.  Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements , 2006, Physics in medicine and biology.

[37]  Karla Felix Navarro,et al.  A Comprehensive Survey of Brain Interface Technology Designs , 2007, Annals of Biomedical Engineering.

[38]  J. Peters,et al.  Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery , 2011, Journal of neural engineering.

[39]  Ad Aertsen,et al.  fNIRS Exhibits Weak Tuning to Hand Movement Direction , 2012, PloS one.

[40]  Takeshi Sakurada,et al.  A BMI-based occupational therapy assist suit: asynchronous control by SSVEP , 2013, Front. Neurosci..

[41]  Andrew B Schwartz,et al.  Cortical neural prosthetics. , 2004, Annual review of neuroscience.

[42]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[43]  Teresa H. Y. Meng,et al.  Model-based neural decoding of reaching movements: a maximum likelihood approach , 2004, IEEE Transactions on Biomedical Engineering.

[44]  I. Scott MacKenzie,et al.  Accuracy measures for evaluating computer pointing devices , 2001, CHI.

[45]  Dimitrios Pantazis,et al.  Coherent neural representation of hand speed in humans revealed by MEG imaging , 2007, Proceedings of the National Academy of Sciences.

[46]  Eran Stark,et al.  Distinct movement parameters are represented by different neurons in the motor cortex , 2007, The European journal of neuroscience.

[47]  Robin C. Ashmore,et al.  An Electrocorticographic Brain Interface in an Individual with Tetraplegia , 2013, PloS one.