Real-time visuomotor behavior and electrophysiology recording setup for use with humans and monkeys

Large-scale network dynamics in multiple visuomotor areas is of great interest in the study of eye-hand coordination in both human and monkey. To explore this, it is essential to develop a setup that allows for precise tracking of eye and hand movements. It is desirable that it is able to generate mechanical or visual perturbations of hand trajectories so that eye-hand coordination can be studied in a variety of conditions. There are simple solutions that satisfy these requirements for hand movements performed in the horizontal plane while visual stimuli and hand feedback are presented in the vertical plane. However, this spatial dissociation requires cognitive rules for eye-hand coordination different from eye-hand movements performed in the same space, as is the case in most natural conditions. Here we present an innovative solution for the precise tracking of eye and hand movements in a single reference frame. Importantly, our solution allows behavioral explorations under normal and perturbed conditions in both humans and monkeys. It is based on the integration of two noninvasive commercially available systems to achieve online control and synchronous recording of eye (EyeLink) and hand (KINARM) positions during interactive visuomotor tasks. We also present an eye calibration method compatible with different eye trackers that compensates for nonlinearities caused by the system's geometry. Our setup monitors the two effectors in real time with high spatial and temporal resolution and simultaneously outputs behavioral and neuronal data to an external data acquisition system using a common data format. NEW & NOTEWORTHY We developed a new setup for studying eye-hand coordination in humans and monkeys that monitors the two effectors in real time in a common reference frame. Our eye calibration method allows us to track gaze positions relative to visual stimuli presented in the horizontal workspace of the hand movements. This method compensates for nonlinearities caused by the system’s geometry and transforms kinematics signals from the eye tracker into the same coordinate system as hand and targets.

[1]  Craig T. Nordhausen,et al.  Single unit recording capabilities of a 100 microelectrode array , 1996, Brain Research.

[2]  Timothy D. Griffiths,et al.  Individually customisable non-invasive head immobilisation system for non-human primates with an option for voluntary engagement , 2016, Journal of Neuroscience Methods.

[3]  Katarzyna Harezlak,et al.  Guidelines for the Eye Tracker Calibration Using Points of Regard , 2014 .

[4]  Thomas Brochier,et al.  Does the Processing of Sensory and Reward-Prediction Errors Involve Common Neural Resources? Evidence from a Frontocentral Negative Potential Modulated by Movement Execution Errors , 2014, The Journal of Neuroscience.

[5]  David J. Freedman,et al.  High-performance execution of psychophysical tasks with complex visual stimuli in MATLAB. , 2013, Journal of neurophysiology.

[6]  Patricia F Sayegh,et al.  Differences in spectral profiles between rostral and caudal premotor cortex when hand-eye actions are decoupled. , 2013, Journal of neurophysiology.

[7]  Hansjörg Scherberger,et al.  Predicting Reaction Time from the Neural State Space of the Premotor and Parietal Grasping Network , 2015, The Journal of Neuroscience.

[8]  J. Anthony Movshon,et al.  Comparison of Recordings from Microelectrode Arrays and Single Electrodes in the Visual Cortex , 2007, The Journal of Neuroscience.

[9]  Leah Scott,et al.  A non‐invasive method for studying an index of pupil diameter and visual performance in the rhesus monkey , 2006, Journal of medical primatology.

[10]  Katarzyna Harezlak,et al.  Towards Accurate Eye Tracker Calibration - Methods and Procedures , 2014, KES.

[11]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[12]  Kevin A. Brown,et al.  Large-scale spatiotemporal spike patterning consistent with wave propagation in motor cortex , 2015, Nature Communications.

[13]  G. Magenes,et al.  Eye-head-hand coordination in pointing at visual targets: spatial and temporal analysis , 2004, Experimental Brain Research.

[14]  R Caminiti,et al.  Eye-hand coordination during reaching. II. An analysis of the relationships between visuomanual signals in parietal cortex and parieto-frontal association projections. , 2001, Cerebral cortex.

[15]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[16]  K. Cheung.  Implantable microscale neural interfaces , 2007, Biomedical microdevices.

[17]  Sonja Grün,et al.  Local field potentials in primate motor cortex encode grasp kinetic parameters , 2015, NeuroImage.

[18]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[19]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[20]  J. DiCarlo,et al.  Comparison of Object Recognition Behavior in Human and Monkey , 2014, The Journal of Neuroscience.

[21]  A. Riehle,et al.  Mapping the spatio-temporal structure of motor cortical LFP and spiking activities during reach-to-grasp movements , 2013, Front. Neural Circuits.

[22]  G. Orban,et al.  Extracting 3D from Motion: Differences in Human and Monkey Intraparietal Cortex , 2002, Science.

[23]  Bradley Greger,et al.  Acute human brain responses to intracortical microelectrode arrays: challenges and future prospects , 2014, Front. Neuroeng..

[24]  B. Fischer,et al.  Reaction times of the eye and the hand of the monkey in a visual reach task , 1985, Neuroscience Letters.

[25]  J Douglas Crawford,et al.  Decoupling the actions of the eyes from the hand alters beta and gamma synchrony within SPL. , 2014, Journal of neurophysiology.

[26]  Tarkeshwar Singh,et al.  A geometric method for computing ocular kinematics and classifying gaze events using monocular remote eye tracking in a robotic environment , 2016, Journal of NeuroEngineering and Rehabilitation.

[27]  Andrew B Schwartz,et al.  Eye-hand coupling during closed-loop drawing: evidence of shared motor planning? , 2003, Human movement science.

[28]  F Bremmer,et al.  Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. , 1998, Journal of neurophysiology.

[29]  Stephanie Westendorff,et al.  Implementation of Spatial Transformation Rules for Goal-Directed Reaching via Gain Modulation in Monkey Parietal and Premotor Cortex , 2009, The Journal of Neuroscience.

[30]  R. Guillemaud,et al.  A modular 256-channel Micro Electrode Array platform for in vitro and in vivo neural stimulation and recording: BioMEA™ , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[31]  D. Amit,et al.  The eye and the hand: neural mechanisms and network models for oculomanual coordination in parietal cortex. , 2003, Cerebral cortex.

[32]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[33]  A. Schwartz,et al.  Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex. , 2012, Journal of neurophysiology.

[34]  Joshua A. Granek,et al.  Extensive video-game experience alters cortical networks for complex visuomotor transformations , 2010, Cortex.

[35]  Diana J. Gorbet,et al.  Brain mechanisms for preparing increasingly complex sensory to motor transformations , 2004, NeuroImage.

[36]  H. Neumann,et al.  The Role of Attention in Figure-Ground Segregation in Areas V1 and V4 of the Visual Cortex , 2012, Neuron.

[37]  C. Prablanc,et al.  Error-correcting mechanisms in large saccades , 1978, Vision Research.

[38]  Lawrence H Snyder,et al.  Movement order and saccade direction affect a common measure of eye-hand coordination in bimanual reaching. , 2014, Journal of neurophysiology.

[39]  R. Caminiti,et al.  Cortical mechanisms for online control of hand movement trajectory: the role of the posterior parietal cortex. , 2009, Cerebral cortex.

[40]  S P Wise,et al.  The premotor cortex and nonstandard sensorimotor mapping. , 1996, Canadian journal of physiology and pharmacology.

[41]  Stephen H. Scott,et al.  Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reaching , 1999, Journal of Neuroscience Methods.

[42]  K. Horch,et al.  A silicon-based, three-dimensional neural interface: manufacturing processes for an intracortical electrode array , 1991, IEEE Transactions on Biomedical Engineering.

[43]  D. B. Henson,et al.  Investigation into corrective saccadic eye movements for refixation amplitudes of 10 degrees and below , 1979, Vision Research.

[44]  M. Nicolelis,et al.  Reconstructing the Engram: Simultaneous, Multisite, Many Single Neuron Recordings , 1997, Neuron.

[45]  J. Douglas Crawford,et al.  Neural Activity in Superior Parietal Cortex during Rule-based Visual-motor Transformations , 2013, Journal of Cognitive Neuroscience.

[46]  Ravi S. Menon,et al.  A comparison of frontoparietal fMRI activation during anti-saccades and anti-pointing. , 2000, Journal of neurophysiology.

[47]  Wei Wang,et al.  Collaborative Approach in the Development of High‐Performance Brain–Computer Interfaces for a Neuroprosthetic Arm: Translation from Animal Models to Human Control , 2014, Clinical and translational science.

[48]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[49]  D. Sandwell.  BIHARMONIC SPLINE INTERPOLATION OF GEOS-3 AND SEASAT ALTIMETER DATA , 1987 .

[50]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[51]  R. E. Crist,et al.  Multielectrode Recording in Behaving Monkeys , 2008 .

[52]  Eric A. Yttri,et al.  The parietal reach region is limb specific and not involved in eye-hand coordination. , 2014, Journal of neurophysiology.