Linking Objects to Actions: Encoding of Target Object and Grasping Strategy in Primate Ventral Premotor Cortex

Neural activity in ventral premotor cortex (PMv) has been associated with the process of matching perceived objects with the motor commands needed to grasp them. It remains unclear how PMv networks can flexibly link percepts of objects affording multiple grasp options into a final desired hand action. Here, we use a relational encoding approach to track the functional state of PMv neuronal ensembles in macaque monkeys through the process of passive viewing, grip planning, and grasping movement execution. We used objects affording multiple possible grip strategies. The task included separate instructed delay periods for object presentation and grip instruction. This approach allowed us to distinguish responses elicited by the visual presentation of the objects from those associated with selecting a given motor plan for grasping. We show that PMv continuously incorporates information related to object shape and grip strategy as it becomes available, revealing a transition from a set of ensemble states initially most closely related to objects, to a new set of ensemble patterns reflecting unique object-grip combinations. These results suggest that PMv dynamically combines percepts, gradually navigating toward activity patterns associated with specific volitional actions, rather than directly mapping perceptual object properties onto categorical grip representations. Our results support the idea that PMv is part of a network that dynamically computes motor plans from perceptual information. SIGNIFICANCE STATEMENT The present work demonstrates that the activity of groups of neurons in primate ventral premotor cortex reflects information related to visually presented objects, as well as the motor strategy used to grasp them, linking individual objects to multiple possible grips. PMv could provide useful control signals for neuroprosthetic assistive devices designed to interact with objects in a flexible way.

[1]  G. Rizzolatti,et al.  Functional organization of inferior area 6 in the macaque monkey , 1988, Experimental Brain Research.

[2]  G. Rizzolatti,et al.  Coding of peripersonal space in inferior premotor cortex (area F4). , 1996, Journal of neurophysiology.

[3]  Hansjörg Scherberger,et al.  Decoding a Wide Range of Hand Configurations from Macaque Motor, Premotor, and Parietal Cortices , 2015, The Journal of Neuroscience.

[4]  J. Donoghue,et al.  Failure mode analysis of silicon-based intracortical microelectrode arrays in non-human primates , 2013, Journal of neural engineering.

[5]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[6]  Pierpaolo Pani,et al.  Three-dimensional Shape Coding in Grasping Circuits: A Comparison between the Anterior Intraparietal Area and Ventral Premotor Area F5a , 2013, Journal of Cognitive Neuroscience.

[7]  John P. Donoghue,et al.  Automated spike sorting using density grid contour clustering and subtractive waveform decomposition , 2007, Journal of Neuroscience Methods.

[8]  Maria Alessandra Umiltà,et al.  Cortical control of grasp in non-human primates , 2007, Current Opinion in Neurobiology.

[9]  Hansjörg Scherberger,et al.  Context-Specific Grasp Movement Representation in Macaque Ventral Premotor Cortex , 2010, The Journal of Neuroscience.

[10]  D. Boussaoud,et al.  Parietal inputs to dorsal versus ventral premotor areas in the macaque monkey: evidence for largely segregated visuomotor pathways , 2002, Experimental Brain Research.

[11]  T Brochier,et al.  Simultaneous recording of macaque premotor and primary motor cortex neuronal populations reveals different functional contributions to visuomotor grasp. , 2007, Journal of neurophysiology.

[12]  J. Victor,et al.  Nature and precision of temporal coding in visual cortex: a metric-space analysis. , 1996, Journal of neurophysiology.

[13]  Lyle N. Long,et al.  Deep Blue Cannot Play Checkers: The Need for Generalized Intelligence for Mobile Robots , 2010, J. Robotics.

[14]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[15]  G. Rizzolatti,et al.  The Cortical Motor System , 2001, Neuron.

[16]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[17]  L. Fogassi,et al.  Functional properties of grasping-related neurons in the ventral premotor area F5 of the macaque monkey. , 2006, Journal of neurophysiology.

[18]  L. Fogassi,et al.  Decoding the activity of grasping neurons recorded from the ventral premotor area F5 of the macaque monkey , 2011, Neuroscience.

[19]  H. Sakata,et al.  Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area AIP. , 2000, Journal of neurophysiology.

[20]  Wim Vanduffel,et al.  Grasping-Related Functional Magnetic Resonance Imaging Brain Responses in the Macaque Monkey , 2011, The Journal of Neuroscience.

[21]  G. Rizzolatti,et al.  Object representation in the ventral premotor cortex (area F5) of the monkey. , 1997, Journal of neurophysiology.

[22]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[23]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[24]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[25]  Sidney R. Lehky,et al.  Population Coding and the Labeling Problem: Extrinsic Versus Intrinsic Representations , 2013, Neural Computation.

[26]  R. Lemon,et al.  Behaviour of neurons in monkey peri-arcuate and precentral cortex before and during visually guided arm and hand movements , 2004, Experimental Brain Research.

[27]  Lemon Rn,et al.  The G. L. Brown Prize Lecture. Cortical control of the primate hand , 1993 .

[28]  J.P. Donoghue,et al.  Reliability of signals from a chronically implanted, silicon-based electrode array in non-human primate primary motor cortex , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Marzio Gerbella,et al.  Multimodal architectonic subdivision of the rostral part (area F5) of the macaque ventral premotor cortex , 2009, The Journal of comparative neurology.

[30]  O. Hikosaka,et al.  Learning of sequential movements in the monkey: process of learning and retention of memory. , 1995, Journal of neurophysiology.

[31]  C. Gross,et al.  Coding of visual space by premotor neurons. , 1994, Science.

[32]  G. Rizzolatti,et al.  Cortical mechanism for the visual guidance of hand grasping movements in the monkey: A reversible inactivation study. , 2001, Brain : a journal of neurology.

[33]  J. Tanji,et al.  Premotor cortex neurons in macaques: activity before distal and proximal forelimb movements , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[35]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[36]  A. Murata,et al.  Largely segregated parietofrontal connections linking rostral intraparietal cortex (areas AIP and VIP) and the ventral premotor cortex (areas F5 and F4) , 1999, Experimental Brain Research.

[37]  R N Lemon,et al.  The G. L. Brown Prize Lecture. Cortical control of the primate hand , 1993, Experimental physiology.

[38]  Erk Subasi,et al.  Grasp Movement Decoding from Premotor and Parietal Cortex , 2011, The Journal of Neuroscience.

[39]  G. Rizzolatti,et al.  Afferent properties of periarcuate neurons in macaque monkeys. I. Somatosensory responses , 1981, Behavioural Brain Research.

[40]  Michael J. Black,et al.  Spike Train SIMilarity Space (SSIMS): A Framework for Single Neuron and Ensemble Data Analysis , 2015, Neural Computation.

[41]  Pierpaolo Pani,et al.  Selectivity for Three-Dimensional Shape and Grasping-Related Activity in the Macaque Ventral Premotor Cortex , 2012, The Journal of Neuroscience.