Decoding the timing and target locations of saccadic eye movements from neuronal activity in macaque oculomotor areas

OBJECTIVE The control of movement timing has been a significant challenge for brain-machine interfaces (BMIs). As a first step toward developing a timing-based BMI, we aimed to decode movement timing and target locations in a visually guided saccadic eye movement task using the activity of neurons in the primate frontal eye field (FEF) and supplementary eye field (SEF). APPROACH For this purpose, we developed a template-matching method that could recruit a variety of neurons in these areas. MAIN RESULTS As a result, we were able to achieve a favorable estimation of saccade onset: for example, data from 20 randomly sampled FEF neurons or 40 SEF neurons achieved a median estimation error of ∼10 ms with an interquartile range less than 50 ms (± ∼25 ms). In the best case, seven simultaneously recorded SEF neurons using a multi-electrode array achieved a comparable accuracy (10 ± 30 ms). The method was significantly better than a heuristic method that used only a group of movement cells with sharp discharges at the onset of saccades. The estimation of target location was less accurate but still favorable, especially when we estimated target location at a timing of 200 ms after the onset of saccade: the method was able to discriminate 16 targets with an accuracy of 90%, which differed not only in their directions (eight directions) but also in amplitude (10/20°) when we used data from 61 randomly sampled FEF neurons. SIGNIFICANCE The results show that the timing, amplitude and direction of saccades can be decoded from neuronal activity in the FEF and SEF and further suggest that timing-based BMIs can be developed by decoding timing information using the template-matching method.

[1]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[2]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[3]  O. Hikosaka,et al.  Role of monkey cerebellar nuclei in skill for sequential movement. , 1998, Journal of neurophysiology.

[4]  J.P. Donoghue,et al.  Reliability of signals from a chronically implanted, silicon-based electrode array in non-human primate primary motor cortex , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  M. Tanaka,et al.  Neuronal responses related to smooth pursuit eye movements in the periarcuate cortical area of monkeys. , 1998, Journal of neurophysiology.

[6]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[7]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[8]  Jakob Heinzle,et al.  A Microcircuit Model of the Frontal Eye Fields , 2007, The Journal of Neuroscience.

[9]  Miguel A. L. Nicolelis,et al.  Actions from thoughts , 2001, Nature.

[10]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[11]  Andrew B. Schwartz,et al.  Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics , 2006, Neuron.

[12]  M. Nicolelis,et al.  Decoding of temporal intervals from cortical ensemble activity. , 2008, Journal of neurophysiology.

[13]  C. Pierrot-Deseilligny,et al.  Eye movement control by the cerebral cortex , 2004, Current opinion in neurology.

[14]  R. Andersen,et al.  Magnetic resonance image-guided implantation of chronic recording electrodes in the macaque intraparietal sulcus , 2003, Journal of Neuroscience Methods.

[15]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[16]  C R Olson,et al.  Object-centered direction selectivity in the macaque supplementary eye field , 1995, Science.

[17]  Vincent P. Ferrera,et al.  Microstimulation of the Dorsolateral Prefrontal Cortex Biases Saccade Target Selection , 2005, Journal of Cognitive Neuroscience.

[18]  O. Hikosaka,et al.  A Neural Correlate of Oculomotor Sequences in Supplementary Eye Field , 2002, Neuron.

[19]  V. Ferrera,et al.  On the gap effect for saccades evoked by electrical microstimulation of frontal eye fields in monkeys , 2001, Experimental Brain Research.

[20]  Tirin Moore,et al.  Selective Attention from Voluntary Control of Neurons in Prefrontal Cortex , 2011, Science.

[21]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[22]  S. Wise,et al.  Supplementary eye field contrasted with the frontal eye field during acquisition of conditional oculomotor associations. , 1995, Journal of neurophysiology.

[23]  H. Yokoi,et al.  Real-time control of a prosthetic hand using human electrocorticography signals. , 2011, Journal of neurosurgery.

[24]  Nicholas G Hatsopoulos,et al.  Improving brain–machine interface performance by decoding intended future movements , 2013, Journal of neural engineering.

[25]  R. Andersen,et al.  Movement Intention Is Better Predicted than Attention in the Posterior Parietal Cortex , 2006, The Journal of Neuroscience.

[26]  K U Smith,et al.  Delayed Visual Feedback and Behavior , 1960, Science.

[27]  S P Wise,et al.  Conditional oculomotor learning: population vectors in the supplementary eye field. , 1997, Journal of neurophysiology.

[28]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[29]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[30]  M. Schlag-Rey,et al.  Antisaccade performance predicted by neuronal activity in the supplementary eye field , 1997, Nature.

[31]  S. Kitazawa,et al.  Neuronal Activity Related to Reward Size and Rewarded Target Position in Primate Supplementary Eye Field , 2007, The Journal of Neuroscience.

[32]  Shogo Ohmae,et al.  Neuronal activity related to anticipated and elapsed time in macaque supplementary eye field , 2008, Experimental Brain Research.

[33]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[34]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[35]  Arnulf B. A. Graf,et al.  Inferring eye position from populations of lateral intraparietal neurons , 2014, eLife.

[36]  Emilio Salinas,et al.  Vector reconstruction from firing rates , 1994, Journal of Computational Neuroscience.

[37]  M. Schlag-Rey,et al.  Evidence for a supplementary eye field. , 1987, Journal of neurophysiology.

[38]  Waka Fujisaki,et al.  Effects of Delayed Visual Feedback on Grooved Pegboard Test Performance , 2012, Front. Psychology.

[39]  J. Marescaux,et al.  Transcontinental robot-assisted remote telesurgery: feasibility and potential applications. , 2002 .

[40]  J. Schall,et al.  Executive control of countermanding saccades by the supplementary eye field , 2006, Nature Neuroscience.