Dynamics of Brain Activation During an Explicit Word and Image Recognition Task: An Electrophysiological Study

Recent brain imaging studies suggest that semantic processing of words and images may share a common neural network, although modality-specific activation can also be observed. Other studies using event-related potentials (ERPs) report that brain responses to words and images may already differ at ~150 ms following stimulus presentation. The question thus remains, which differences are due to perceptual categorization processes and which differences are due to the semantic ones? Using ERP recordings and spatio-temporal source localization analysis, we investigated the dynamics of brain activation during a recognition task. The stimuli consisted of a randomized set of verbal (words vs. non-words) and pictorial items (line drawings of objects vs. scrambled drawings). After each stimulus, subjects had to decide whether it corresponds to a recognizable word or objects. ERP map series were first analyzed in terms of segments of quasi-stable map topography using a cluster analysis. This showed that verbal and pictorial stimuli elicited different field patterns in two time segments between ~190-400 ms. Before and after this period, map patterns were similar between verbal and pictorial conditions indicating that the same brain structures were engaged during the early and late steps of processing. Source localization analysis of map segments corresponding to the P100 and the N150 components first showed activation of posterior bilateral regions and then of left temporo-posterior areas. During the period differentiating conditions, other patterns of activation, involving mainly left anterior and posterior regions for words and bilateral posterior regions for images, were observed. These findings suggest that, while sharing an initial common network, recognition of verbal and pictorial stimuli subsequently engage different brain regions during time periods generally allocated to the semantic processing of stimuli.

[1]  Martha J. Farah,et al.  Associative Visual Agnosia and Alexia Without Prosopagnosia , 1994, Cortex.

[2]  S. Gonzalez-Andino,et al.  A critical analysis of linear inverse solutions to the neuroelectromagnetic inverse problem , 1998, IEEE Transactions on Biomedical Engineering.

[3]  C. Caltagirone,et al.  Associative Visual Agnosia Resulting from a Disconnection Between Intact Visual Memory and Semantic Systems , 1998, Cortex.

[4]  John J. Foxe,et al.  Activation Timecourse of Ventral Visual Stream Object-recognition Areas: High Density Electrical Mapping of Perceptual Closure Processes , 2000, Journal of Cognitive Neuroscience.

[5]  D Brandeis,et al.  Neuroelectric mapping reveals precursor of stop failures in children with attention deficits , 1998, Behavioural Brain Research.

[6]  D Lehmann,et al.  Event-related electric microstates of the brain differ between words with visual and abstract meaning. , 1998, Electroencephalography and clinical neurophysiology.

[7]  Christoph M. Michel,et al.  Spatiotemporal Dynamics of Human Cognition. , 1999, News in physiological sciences : an international journal of physiology produced jointly by the International Union of Physiological Sciences and the American Physiological Society.

[8]  P. Viviani,et al.  Internally driven vs. externally cued movement selection: a study on the timing of brain activity. , 2000, Brain research. Cognitive brain research.

[9]  Visual evoked potentials relating to imagery: Words for concrete objects versus absolute concepts , 1997, Brain Topography.

[10]  C. Michel,et al.  Unraveling the cerebral dynamics of mental imagery , 1997, Human brain mapping.

[11]  R. Salmelin,et al.  Dynamics of letter string perception in the human occipitotemporal cortex. , 1999, Brain : a journal of neurology.

[12]  M. Kutas,et al.  Neurophysiological evidence for visual perceptual categorization of words and faces within 150 ms. , 1998, Psychophysiology.

[13]  C M Michel,et al.  42-channel potential map series to visual contrast and stereo stimuli: perceptual and cognitive event-related segments. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  C C Wood,et al.  Mapping function in the human brain with magnetoencephalography, anatomical magnetic resonance imaging, and functional magnetic resonance imaging. , 1995, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[15]  D. Lehmann,et al.  Event-related potentials of the brain and cognitive processes: Approaches and applications , 1986, Neuropsychologia.

[16]  T Landis,et al.  Electrophysiological evidence for fast visual processing through the human koniocellular pathway when stimuli move. , 2000, Cerebral cortex.

[17]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  D. Lehmann,et al.  From Mapping to the Analysis and Interpretation of EEG/EP Maps , 1989 .

[19]  Gregor Thut,et al.  Evidence for interhemispheric motor-level transfer in a simple reaction time task: an EEG study , 1999, Experimental Brain Research.

[20]  Richard S. J. Frackowiak,et al.  Functional anatomy of a common semantic system for words and pictures , 1996, Nature.

[21]  L. Katz,et al.  Cerebral organization of component processes in reading. , 1996, Brain : a journal of neurology.

[22]  R D Pascual-Marqui,et al.  Differential effects of normal aging on sources of standard N1, target N1 and target P300 auditory event-related brain potentials revealed by low resolution electromagnetic tomography (LORETA). , 1998, Electroencephalography and clinical neurophysiology.

[23]  H. Begleiter,et al.  Visual object priming differs from visual word priming: an ERP study. , 1997, Electroencephalography and clinical neurophysiology.

[24]  M. Goodale Image and Brain: The Resolution of the Imagery Debate , 1995 .

[25]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[26]  C M Michel,et al.  Single doses of piracetam affect 42-channel event-related potential microstate maps in a cognitive paradigm. , 1993, Neuropsychobiology.

[27]  Mark D'Esposito,et al.  Cognitive Association Formation in Human Memory Revealed by Spatiotemporal Brain Imaging , 2001, Neuron.

[28]  R. Hari,et al.  Visual awareness of objects correlates with activity of right occipital cortex , 1996, Neuroreport.

[29]  R. Frackowiak,et al.  Demonstrating the implicit processing of visually presented words and pseudowords. , 1996, Cerebral cortex.

[30]  C. Michel,et al.  Dynamics of brain activation during a word and image recognition task: An electrophysiological study , 2001, NeuroImage.

[31]  C M Michel,et al.  Spatiotemporal EEG analysis and distributed source estimation in presurgical epilepsy evaluation. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[32]  Christoph M. Michel,et al.  New insights into the Stroop effect : a spatiotemporal analysis of electric brain activity , 2000 .

[33]  Stefano F. Cappa,et al.  Word and picture matching: a PET study of semantic category effects , 1999, Neuropsychologia.

[34]  Stephen M. Rao,et al.  Human Brain Language Areas Identified by Functional Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[35]  E. M. FletcheraTb,et al.  Estimation of interpolation errors in scalp topographic mapping , 2003 .

[36]  Richard S. J. Frackowiak,et al.  The anatomy of phonological and semantic processing in normal subjects. , 1992, Brain : a journal of neurology.

[37]  D A Pollen,et al.  On the neural correlates of visual perception. , 1999, Cerebral cortex.

[38]  D. Lehmann,et al.  Segmentation of brain electrical activity into microstates: model estimation and validation , 1995, IEEE Transactions on Biomedical Engineering.

[39]  C. C. Wood,et al.  Event-related potentials, lexical decision and semantic priming. , 1985, Electroencephalography and clinical neurophysiology.

[40]  J C Lind,et al.  Low‐resolution electrical tomography of the brain during psychometrically matched verbal and spatial cognitive tasks , 2001, Human brain mapping.

[41]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[42]  A. Fallgatter,et al.  A robust assessment of the NoGo-anteriorisation of P300 microstates in a cued Continuous Performance Test , 2005, Brain Topography.

[43]  T Landis,et al.  Spatio-temporal analysis of electric brain activity during semantic and phonological word processing. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[45]  R W Cox,et al.  Language processing is strongly left lateralized in both sexes. Evidence from functional MRI. , 1999, Brain : a journal of neurology.

[46]  D. Lehmann,et al.  Principles of spatial analysis , 1987 .

[47]  T. Allison,et al.  Word recognition in the human inferior temporal lobe , 1994, Nature.

[48]  Dietrich Lehmann,et al.  Mapping event-related brain potential microstates to sentence endings , 2005, Brain Topography.

[49]  W Skrandies,et al.  Evoked potential correlates of semantic meaning--A brain mapping study. , 1998, Brain research. Cognitive brain research.

[50]  Stephen M. Kosslyn,et al.  Encoding words and pictures: A positron emission tomography study , 1996, Neuropsychologia.

[51]  Jemett L. Desmond,et al.  Semantic encoding and retrieval in the left inferior prefrontal cortex: a functional MRI study of task difficulty and process specificity , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  C M Michel,et al.  The time course of semantic category processing in the cerebral hemispheres: an electrophysiological study. , 2001, Brain research. Cognitive brain research.