Spatiotemporal dynamics in understanding hand—object interactions

Significance Combining EEG and transcranial magnetic stimulation techniques, we show that reactivation of visual areas plays a fundamental role for understanding conceptual object properties. We suggest that a similar top-down mechanism might also play a role in other higher-order cognitive functions. These results shed a new light on the basic mechanisms underlying perception. It is generally accepted that visual perception results from the activation of a feed-forward hierarchy of areas, leading to increasingly complex representations. Here we present evidence for a fundamental role of backward projections to the occipito-temporal region for understanding conceptual object properties. The evidence is based on two studies. In the first study, using high-density EEG, we showed that during the observation of how objects are used there is an early activation of occipital and temporal areas, subsequently reaching the pole of the temporal lobe, and a late reactivation of the visual areas. In the second study, using transcranial magnetic stimulation over the occipital lobe, we showed a clear impairment in the accuracy of recognition of how objects are used during both early activation and, most importantly, late occipital reactivation. These findings represent strong neurophysiological evidence that a top-down mechanism is fundamental for understanding conceptual object properties, and suggest that a similar mechanism might be also present for other higher-order cognitive functions.

[1]  Keiji Tanaka,et al.  Divergent backward projections from the anterior part of the inferotemporal cortex (area TE) in the macaque , 2000, The Journal of comparative neurology.

[2]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[3]  Guy A Orban,et al.  Higher order visual processing in macaque extrastriate cortex. , 2008, Physiological reviews.

[4]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[5]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[6]  Ehud Zohary,et al.  Two Phases of V1 Activity for Visual Recognition of Natural Images , 2010, Journal of Cognitive Neuroscience.

[7]  D Lehmann,et al.  EEG alpha map series: brain micro-states by space-oriented adaptive segmentation. , 1987, Electroencephalography and clinical neurophysiology.

[8]  Karl J. Friston,et al.  Prediction, perception and agency , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  H. Kennedy,et al.  A double-labeling investigation of the afferent connectivity to cortical areas V1 and V2 of the macaque monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  A. Damasio,et al.  A neural basis for lexical retrieval , 1996, Nature.

[11]  K. Tanaka,et al.  Mechanisms of visual object recognition studied in monkeys. , 2000, Spatial vision.

[12]  H. Liepmann Drei Aufsätze aus dem Apraxiegebiet , 1908 .

[13]  Juha Silvanto,et al.  The role of early visual cortex (V1/V2) in conscious and unconscious visual perception , 2010, NeuroImage.

[14]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[15]  S. Rossi,et al.  Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research , 2009, Clinical Neurophysiology.

[16]  Jared Rutter,et al.  Regulation of Clock and NPAS2 DNA Binding by the Redox State of NAD Cofactors , 2001, Science.

[17]  E Corthout,et al.  Timing of activity in early visual cortex as revealed by transcranial magnetic stimulation. , 1999, Neuroreport.

[18]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .

[19]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[20]  A. Caramazza,et al.  Conceptual Object Representations in Human Anterior Temporal Cortex , 2012, The Journal of Neuroscience.

[21]  Dietrich Lehmann,et al.  Mapping event-related brain potential microstates to sentence endings , 2005, Brain Topography.

[22]  K. Rockland,et al.  Direct temporal-occipital feedback connections to striate cortex (V1) in the macaque monkey. , 1994, Cerebral cortex.

[23]  Christoph M. Michel,et al.  Spatiotemporal Dynamics of Human Cognition. , 1999, News in physiological sciences : an international journal of physiology produced jointly by the International Union of Physiological Sciences and the American Physiological Society.

[24]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[25]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[26]  G. Orban,et al.  Comparative mapping of higher visual areas in monkeys and humans , 2004, Trends in Cognitive Sciences.

[27]  Denis Brunet,et al.  Topographic ERP Analyses: A Step-by-Step Tutorial Review , 2008, Brain Topography.

[28]  Christoph M. Michel,et al.  Spatiotemporal Analysis of Multichannel EEG: CARTOOL , 2011, Comput. Intell. Neurosci..

[29]  D. B. Bender,et al.  Visual Receptive Fields of Neurons in Inferotemporal Cortex of the Monkey , 1969, Science.

[30]  Jacob Jolij,et al.  Figure–ground segregation requires two distinct periods of activity in V1: a transcranial magnetic stimulation study , 2005, Neuroreport.

[31]  Na Na,et al.  Figure???ground segregation requires two distinct periods of activity in V1: a transcranial magnetic stimulation study: , 2006 .

[32]  Robin Laycock,et al.  Evidence for fast signals and later processing in human V1/V2 and V5/MT+: A TMS study of motion perception. , 2007, Journal of neurophysiology.

[33]  Robert Tibshirani,et al.  Cluster Validation by Prediction Strength , 2005 .

[34]  Leslie G. Ungerleider,et al.  Connections of inferior temporal areas TE and TEO with medial temporal- lobe structures in infant and adult monkeys , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  Juha Silvanto,et al.  Double dissociation of V1 and V5/MT activity in visual awareness. , 2005, Cerebral cortex.

[36]  N. Sen,et al.  Inositol polyphosphate multikinase is a transcriptional coactivator required for immediate early gene induction , 2013, Proceedings of the National Academy of Sciences.

[37]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[38]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[39]  A. Cowey,et al.  Striate cortex (V1) activity gates awareness of motion , 2005, Nature Neuroscience.

[40]  N. Kanwisher,et al.  Repetition blindness and illusory conjunctions: errors in binding visual types with visual tokens. , 1991, Journal of experimental psychology. Human perception and performance.

[41]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[42]  N. Kanwisher Functional specificity in the human brain: A window into the functional architecture of the mind , 2010, Proceedings of the National Academy of Sciences.

[43]  K. Heilman,et al.  Two forms of ideomotor apraxia , 1982, Neurology.

[44]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[45]  Salvatore Maria Aglioti,et al.  The Sound of Actions in Apraxia , 2008, Current Biology.

[46]  A. Arner,et al.  Inappropriate heat dissipation ignites brown fat thermogenesis in mice with a mutant thyroid hormone receptor α1 , 2013, Proceedings of the National Academy of Sciences.

[47]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[48]  D. Hubel,et al.  Early Exploration of the Visual Cortex , 1998, Neuron.

[49]  T. Kammer Visual masking by transcranial magnetic stimulation in the first 80 milliseconds , 2008, Advances in cognitive psychology.

[50]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[51]  K M Heilman,et al.  Pantomime comprehension and ideomotor apraxia. , 1985, Journal of neurology, neurosurgery, and psychiatry.

[52]  A. Pascual-Leone,et al.  Studies in Cognition: The Problems Solved and Created by Transcranial Magnetic Stimulation , 2003, Journal of Cognitive Neuroscience.

[53]  Á. Pascual-Leone,et al.  Fast Backprojections from the Motion to the Primary Visual Area Necessary for Visual Awareness , 2001, Science.

[54]  P. Goldman-Rakic,et al.  Preface: Cerebral Cortex Has Come of Age , 1991 .

[55]  Leslie G. Ungerleider Two cortical visual systems , 1982 .