Spatiotemporal Dynamics of Cortical Representations during and after Stimulus Presentation

Visual perception is a spatiotemporally complex process. In this study, we investigated cortical dynamics during and after stimulus presentation. We observed that visual category information related to the difference between faces and objects became apparent in the occipital lobe after 63 ms. Within the next 110 ms, activation spread out to include the temporal lobe before returning to residing mainly in the occipital lobe again. After stimulus offset, a peak in information was observed, comparable to the peak after stimulus onset. Moreover, similar processes, albeit not identical, seemed to underlie both peaks. Information about the categorical identity of the stimulus remained present until 677 ms after stimulus offset, during which period the stimulus had to be retained in working memory. Activation patterns initially resembled those observed during stimulus presentation. After about 200 ms, however, this representation changed and class-specific activity became more equally distributed over the four lobes. These results show that, although there are common processes underlying stimulus representation both during and after stimulus presentation, these representations change depending on the specific stage of perception and maintenance.

[1]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[2]  Brian Litt,et al.  Decoding the memorization of individual stimuli with direct human brain recordings , 2013, NeuroImage.

[3]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[4]  S. Thorpe,et al.  Seeking Categories in the Brain , 2001, Science.

[5]  Alfonso Caramazza,et al.  Unconscious processing dissociates along categorical lines , 2008, Proceedings of the National Academy of Sciences.

[6]  Margot J. Taylor Non-spatial attentional effects on P1 , 2002, Clinical Neurophysiology.

[7]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[8]  Kaia L. Vilberg,et al.  Memory retrieval and the parietal cortex: A review of evidence from a dual-process perspective , 2008, Neuropsychologia.

[9]  Tony W. Wilson,et al.  Spatiotemporal oscillatory dynamics during the encoding and maintenance phases of a visual working memory task , 2015, Cortex.

[10]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[11]  Melina R. Uncapher,et al.  Posterior parietal cortex and episodic retrieval: convergent and divergent effects of attention and memory. , 2009, Learning & memory.

[12]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[13]  Benjamin J. Shannon,et al.  Parietal lobe contributions to episodic memory retrieval , 2005, Trends in Cognitive Sciences.

[14]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[15]  Jean Régis,et al.  Ultra-Rapid Sensory Responses in the Human Frontal Eye Field Region , 2009, The Journal of Neuroscience.

[16]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[17]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[18]  B. Breitmeyer,et al.  Tracking the first two seconds: three stages of visual information processing? , 2013, Psychonomic bulletin & review.

[19]  C. Michel,et al.  Evidence for rapid face recognition from human scalp and intracranial electrodes , 1997, Neuroreport.

[20]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[21]  Bradford Z. Mahon,et al.  The Role of the Dorsal Visual Processing Stream in Tool Identification , 2010, Psychological science.

[22]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[23]  C. Degueldre,et al.  Regional brain activity during working memory tasks. , 1996, Brain : a journal of neurology.

[24]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[25]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[26]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[27]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[28]  Robert Oostenveld,et al.  Online and offline tools for head movement compensation in MEG , 2013, NeuroImage.

[29]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[30]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[31]  J. Duhamel,et al.  Differential Dynamics of Spatial Attention, Position, and Color Coding within the Parietofrontal Network , 2015, The Journal of Neuroscience.

[32]  Marcel van Gerven,et al.  MEG-based decoding of the spatiotemporal dynamics of visual category perception , 2013, NeuroImage.

[33]  Robert Oostenveld,et al.  Identifying Object Categories from Event-Related EEG: Toward Decoding of Conceptual Representations , 2010, PloS one.

[34]  Shinya Sakai,et al.  Does the Human Dorsal Stream Really Process a Category for Tools? , 2012, The Journal of Neuroscience.

[35]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[36]  S. Dehaene,et al.  Characterizing the dynamics of mental representations: the temporal generalization method , 2014, Trends in Cognitive Sciences.

[37]  L. Tyler,et al.  Predicting the Time Course of Individual Objects with MEG , 2014, Cerebral cortex.

[38]  Laurens van der Maaten,et al.  A New Benchmark Dataset for Handwritten Character Recognition , 2009 .

[39]  L. Leyman,et al.  The Karolinska Directed Emotional Faces: A validation study , 2008 .

[40]  David A. Tovar,et al.  Representational dynamics of object vision: the first 1000 ms. , 2013, Journal of vision.

[41]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[42]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[43]  Roberto D. Pascual-Marqui,et al.  Discrete, 3D distributed, linear imaging methods of electric neuronal activity. Part 1: exact, zero error localization , 2007, 0710.3341.

[44]  L. K. Hansen,et al.  Plurality and Resemblance in fMRI Data Analysis , 1999, NeuroImage.

[45]  T. Carlson,et al.  High temporal resolution decoding of object position and category. , 2011, Journal of vision.

[46]  Pavan Ramkumar,et al.  Feature-Specific Information Processing Precedes Concerted Activation in Human Visual Cortex , 2013, The Journal of Neuroscience.

[47]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[48]  Margot J. Taylor,et al.  N170 or N1? Spatiotemporal differences between object and face processing using ERPs. , 2004, Cerebral cortex.

[49]  Simon D Lilburn,et al.  Predicting Perceptual Decision Biases from Early Brain Activity , 2012, The Journal of Neuroscience.

[50]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[51]  Greg O. Horne,et al.  Controlling low-level image properties: The SHINE toolbox , 2010, Behavior research methods.

[52]  M. Brodeur,et al.  The Bank of Standardized Stimuli (BOSS), a New Set of 480 Normative Photos of Objects to Be Used as Visual Stimuli in Cognitive Research , 2010, PloS one.

[53]  S. Thorpe,et al.  The time course of visual processing: Backward masking and natural scene categorisation , 2005, Vision Research.

[54]  Joel Z. Leibo,et al.  The dynamics of invariant object recognition in the human visual system. , 2014, Journal of neurophysiology.

[55]  S. Dehaene,et al.  Distinct cortical codes and temporal dynamics for conscious and unconscious percepts , 2015, eLife.

[56]  W. Singer,et al.  Distributed Fading Memory for Stimulus Properties in the Primary Visual Cortex , 2009, PLoS biology.

[57]  Nikolaus Kriegeskorte,et al.  Pattern-information analysis: From stimulus decoding to computational-model testing , 2011, NeuroImage.