Disentangling human grasping type from the object's intrinsic properties using low-frequency EEG signals

Abstract Grasping movements are known to activate the fronto-parietal brain networks both in human and non-human primates. However, it is unclear if these activations represent properties of the objects or hand postures or both at different stages of the movement. We manipulated the intrinsic properties of the objects and the grasping types in order to create twelve unique combinations of grasping movements and we investigated, in healthy adult humans, the low-frequency time-domain EEG representation of grasping over different stages of the movement. Next, we implemented two multiclass decoders for the grasp type and objects' properties and evaluated them over time. Furthermore, we investigated the similarity between these grasping EEG representations and categorical models that encode properties of the movement and intrinsic properties of the objects. We found that properties of the grasping movement (grasp types, number of fingers) and intrinsic object properties (shape and size) as represented in EEG are encoded in different brain areas throughout the movement stages. Both object properties and grasp types can be decoded significantly above chance level using low-frequency EEG activity during the planning and execution of the movement. Moreover, we found that this preferential time-wise encoding allows the decoding of object properties already from the observation stage, while the grasp type can also be accurately decoded at the object release stage. These findings contribute to the understanding of the grasping representation based on noninvasive EEG brain signals, and its evolution over the course of movement in relation to categorical models that describe the grasped object's properties or that encode properties of the grasping movement. Moreover, our multiclass grasping decoders are informative for the design and implementation of noninvasive motor control strategies.

[1]  Hansjörg Scherberger,et al.  Object vision to hand action in macaque parietal, premotor, and motor cortices , 2016, eLife.

[2]  Jason Omedes,et al.  Factors that affect error potentials during a grasping task: toward a hybrid natural movement decoding BCI , 2018, Journal of neural engineering.

[3]  Francis R. Willett,et al.  The Neural Representation of Force across Grasp Types in Motor Cortex of Humans with Tetraplegia , 2020, eNeuro.

[4]  Ricardo Chavarriaga,et al.  Human EEG reveals distinct neural correlates of power and precision grasping types , 2018, NeuroImage.

[5]  Abbas Erfanian,et al.  An online EEG-based brain-computer interface for controlling hand grasp using an adaptive probabilistic neural network. , 2010, Medical engineering & physics.

[6]  Sture Holm On multiple test procedures , 1980 .

[7]  J. Pereira,et al.  Decoding natural reach-and-grasp actions from human EEG , 2018, Journal of neural engineering.

[8]  M. Goodale,et al.  FMRI Reveals a Dissociation between Grasping and Perceiving the Size of Real 3D Objects , 2007, PloS one.

[9]  A. Milner,et al.  Grasping the past delay can improve visuomotor performance , 2001, Current Biology.

[10]  Roni O. Maimon-Mor,et al.  Expert Tool Users Show Increased Differentiation between Visual Representations of Hands and Tools , 2021, The Journal of Neuroscience.

[11]  Robert Volcic,et al.  Grasping movements toward seen and handheld objects , 2019, Scientific Reports.

[12]  Andreas Schulze-Bonhage,et al.  Decoding natural grasp types from human ECoG , 2012, NeuroImage.

[13]  Mohammad Madallh Alhabahba,et al.  Contrasting Computational Models of Mate Preference Integration Across 45 Countries , 2019, Scientific Reports.

[14]  G. Rizzolatti,et al.  Localization of grasp representations in humans by PET: 1. Observation versus execution , 1996, Experimental Brain Research.

[15]  Francis R. Willett,et al.  Restoration of reaching and grasping in a person with tetraplegia through brain-controlled muscle stimulation: a proof-of-concept demonstration , 2017, The Lancet.

[16]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[17]  Spencer Kellis,et al.  Hand Shape Representations in the Human Posterior Parietal Cortex , 2015, The Journal of Neuroscience.

[18]  E. Brenner,et al.  A new view on grasping. , 1999, Motor control.

[19]  Scott T. Grafton,et al.  Localization of grasp representations in humans by positron emission tomography , 1996, Experimental Brain Research.

[20]  Francis R. Willett,et al.  Neural Representation of Observed, Imagined, and Attempted Grasping Force in Motor Cortex of Individuals with Chronic Tetraplegia , 2020, Scientific Reports.

[21]  Prisca Stenneken,et al.  The human execution/observation matching system investigated with a complex everyday task: A functional near-infrared spectroscopy (fNIRS) study , 2012, Neuroscience Letters.

[22]  Dorothy V. M. Bishop,et al.  Journal of Neuroscience Methods , 2015 .

[23]  Dirk Koester,et al.  Neurophysiology of Grasping Actions: Evidence from ERPs , 2016, Front. Psychol..

[24]  Marcia Bockbrader,et al.  Upper limb sensorimotor restoration through brain–computer interface technology in tetraparesis , 2019, Current Opinion in Biomedical Engineering.

[25]  M. Davare,et al.  Interactions between dorsal and ventral streams for controlling skilled grasp , 2015, Neuropsychologia.

[26]  Mads Jochumsen,et al.  Detecting and classifying three different hand movement types through electroencephalography recordings for neurorehabilitation , 2015, Medical & Biological Engineering & Computing.

[27]  Martin N. Hebart,et al.  Human visual and parietal cortex encode visual choices independent of motor plans , 2012, NeuroImage.

[28]  Néstor J. Jarque-Bou,et al.  A calibrated database of kinematics and EMG of the forearm and hand during activities of daily living , 2019, Scientific Data.

[29]  A. Lingnau,et al.  Neural correlates of grasping , 2014, Front. Hum. Neurosci..

[30]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[31]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[32]  L. Jakobson,et al.  A neurological dissociation between perceiving objects and grasping them , 1991, Nature.

[33]  M. Arbib,et al.  Grasping objects: the cortical mechanisms of visuomotor transformation , 1995, Trends in Neurosciences.

[34]  Matthias Niemeier,et al.  Multivariate Analysis of Electrophysiological Signals Reveals the Temporal Properties of Visuomotor Computations for Precision Grips , 2019, The Journal of Neuroscience.

[35]  M. Jeannerod,et al.  Impairment of grasping movements following a bilateral posterior parietal lesion , 1994, Neuropsychologia.

[36]  J. Napier The prehensile movements of the human hand. , 1956, The Journal of bone and joint surgery. British volume.

[37]  Hansjörg Scherberger,et al.  Population coding of grasp and laterality-related information in the macaque fronto-parietal network , 2017, Scientific Reports.

[38]  U. Castiello The neuroscience of grasping , 2005, Nature Reviews Neuroscience.

[39]  Hans-Otto Karnath,et al.  Dorsal and Ventral Stream Interaction: Contributions from Optic Ataxia , 2005, Journal of Cognitive Neuroscience.

[40]  Gernot R Müller-Putz,et al.  Attempted Arm and Hand Movements can be Decoded from Low-Frequency EEG from Persons with Spinal Cord Injury , 2019, Scientific Reports.

[41]  C Dohle,et al.  Human anterior intraparietal area subserves prehension , 1998, Neurology.

[42]  Jody C. Culham,et al.  Human neuroimaging reveals the subcomponents of grasping, reaching and pointing actions , 2018, Cortex.

[43]  Ravi S. Menon,et al.  Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas , 2003, Experimental Brain Research.

[44]  Rhodri Cusack,et al.  Disentangling Representations of Object and Grasp Properties in the Human Brain , 2016, The Journal of Neuroscience.

[45]  Gernot R Müller-Putz,et al.  Exploring representations of human grasping in neural, muscle and kinematic signals , 2018, Scientific Reports.

[46]  H. Sakata,et al.  Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area AIP. , 2000, Journal of neurophysiology.

[47]  Norihiko Fujita,et al.  Movement-Related Desynchronization of the Cerebral Cortex Studied with Spatially Filtered Magnetoencephalography , 2000, NeuroImage.

[48]  Thomas Brochier,et al.  Modulations of EEG Beta Power during Planning and Execution of Grasping Movements , 2013, PloS one.

[49]  Andrew Y. Paek,et al.  Global cortical activity predicts shape of hand during grasping , 2015, Front. Neurosci..

[50]  G. Pellizzer,et al.  Power Modulations of ECoG Alpha/Beta and Gamma Bands Correlate With Time-Derivative of Force During Hand Grasp , 2020, Frontiers in Neuroscience.

[51]  Thomas Powell,et al.  Neural representations of haptic object size in the human brain revealed by multivoxel fMRI patterns. , 2020, Journal of neurophysiology.

[52]  Ethan R. Buch,et al.  Parietofrontal integrity determines neural modulation associated with grasping imagery after stroke. , 2012, Brain : a journal of neurology.

[53]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[54]  G. Rizzolatti,et al.  Grasping objects and grasping action meanings: the dual role of monkey rostroventral premotor cortex (area F5). , 1998, Novartis Foundation symposium.

[55]  Gernot R. Müller-Putz,et al.  Applying intuitive EEG-controlled grasp neuroprostheses in individuals with spinal cord injury: Preliminary results from the MoreGrasp clinical feasibility study , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[56]  J. Donoghue,et al.  Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. , 1998, Journal of neurophysiology.