Time-Varying Effective Connectivity during Visual Object Naming as a Function of Semantic Demands

Accumulating evidence suggests that visual object understanding involves a rapid feedforward sweep, after which subsequent recurrent interactions are necessary. The extent to which recurrence plays a critical role in object processing remains to be determined. Recent studies have demonstrated that recurrent processing is modulated by increasing semantic demands. Differentially from previous studies, we used dynamic causal modeling to model neural activity recorded with magnetoencephalography while 14 healthy humans named two sets of visual objects that differed in the degree of semantic accessing demands, operationalized in terms of the values of basic psycholinguistic variables associated with the presented objects (age of acquisition, frequency, and familiarity). This approach allowed us to estimate the directionality of the causal interactions among brain regions and their associated connectivity strengths. Furthermore, to understand the dynamic nature of connectivity (i.e., the chronnectome; Calhoun et al., 2014) we explored the time-dependent changes of effective connectivity during a period (200–400 ms) where adding semantic-feature information improves modeling and classifying visual objects, at 50 ms increments. First, we observed a graded involvement of backward connections, that became active beyond 200 ms. Second, we found that semantic demands caused a suppressive effect in the backward connection from inferior frontal cortex (IFC) to occipitotemporal cortex over time. These results complement those from previous studies underscoring the role of IFC as a common source of top-down modulation, which drives recurrent interactions with more posterior regions during visual object recognition. Crucially, our study revealed the inhibitory modulation of this interaction in situations that place greater demands on the conceptual system.

[1]  J. Hodges,et al.  Non-verbal semantic impairment in semantic dementia , 2000, Neuropsychologia.

[2]  A. Woollams Apples are not the only fruit: the effects of concept typicality on semantic representation in the anterior temporal lobe , 2012, Front. Hum. Neurosci..

[3]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[4]  Karl J. Friston,et al.  EEG and MEG Data Analysis in SPM8 , 2011, Comput. Intell. Neurosci..

[5]  Tianfu Wang,et al.  Effective connectivity of brain regions related to visual word recognition: An fMRI study of Chinese reading , 2015, Human brain mapping.

[6]  L. Tyler,et al.  Object-Specific Semantic Coding in Human Perirhinal Cortex , 2014, The Journal of Neuroscience.

[7]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[8]  Matthew A. Lambon Ralph,et al.  Naming in semantic dementia—what matters? , 1998, Neuropsychologia.

[9]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[10]  Karl J. Friston,et al.  Comparing Families of Dynamic Causal Models , 2010, PLoS Comput. Biol..

[11]  Dwight J. Kravitz,et al.  The ventral visual pathway: an expanded neural framework for the processing of object quality , 2013, Trends in Cognitive Sciences.

[12]  Raymond J. Dolan,et al.  The Brain Ages Optimally to Model Its Environment: Evidence from Sensory Learning over the Adult Lifespan , 2014, PLoS Comput. Biol..

[13]  Karl J. Friston,et al.  Canonical Source Reconstruction for MEG , 2007, Comput. Intell. Neurosci..

[14]  R. Desimone,et al.  A backward progression of attentional effects in the ventral stream , 2009, Proceedings of the National Academy of Sciences.

[15]  Martin Kronbichler,et al.  Top‐down and bottom‐up influences on the left ventral occipito‐temporal cortex during visual word recognition: An analysis of effective connectivity , 2014, Human brain mapping.

[16]  Richard Coppola,et al.  Cross-frequency power coupling between hierarchically organized face-selective areas. , 2014, Cerebral cortex.

[17]  Nikolaus Kriegeskorte,et al.  The Emergence of Semantic Meaning in the Ventral Temporal Pathway , 2014, Journal of Cognitive Neuroscience.

[18]  D L Miglioretti,et al.  Temporal dynamics of verbal object comprehension. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[19]  David J. Jilk,et al.  Recurrent Processing during Object Recognition , 2011, Front. Psychol..

[20]  Andreas Keil,et al.  Time course of competition for visual processing resources between emotional pictures and foreground task. , 2008, Cerebral cortex.

[21]  Billi Randall,et al.  From perception to conception: how meaningful objects are processed over time. , 2013, Cerebral cortex.

[22]  A. W. Ellis,et al.  Traces of vocabulary acquisition in the brain: Evidence from covert object naming , 2006, NeuroImage.

[23]  Albert Costa,et al.  Tracking lexical access in speech production: electrophysiological correlates of word frequency and cognate effects. , 2010, Cerebral cortex.

[24]  Billi Randall,et al.  The perirhinal cortex and conceptual processing: Effects of feature-based statistics following damage to the anterior temporal lobes , 2015, Neuropsychologia.

[25]  Gregory Hickok,et al.  Neural correlates of word production stages delineated by parametric modulation of psycholinguistic variables , 2009, Human brain mapping.

[26]  J. Rodd,et al.  Anteromedial temporal cortex supports fine-grained differentiation among objects. , 2005, Cerebral cortex.

[27]  A. Friederici,et al.  Dynamic Causal Modeling of Subcortical Connectivity of Language , 2011, The Journal of Neuroscience.

[28]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[29]  Seppo P. Ahlfors,et al.  Direction of magnetoencephalography sources associated with feedback and feedforward contributions in a visual object recognition task , 2015, Neuroscience Letters.

[30]  Karl J. Friston,et al.  Dynamic causal modeling of evoked responses in EEG and MEG , 2006, NeuroImage.

[31]  Hugues Duffau,et al.  Toward a pluri-component, multimodal, and dynamic organization of the ventral semantic stream in humans: lessons from stimulation mapping in awake patients , 2013, Front. Syst. Neurosci..

[32]  Victor A F Lamme,et al.  Two critical periods in early visual cortex during figure–ground segregation , 2012, Brain and behavior.

[33]  Ehud Zohary,et al.  Two Phases of V1 Activity for Visual Recognition of Natural Images , 2010, Journal of Cognitive Neuroscience.

[34]  Karalyn Patterson,et al.  The reign of typicality in semantic memory , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[35]  M. Bar,et al.  Top-down facilitation of visual object recognition: object-based and context-based contributions. , 2006, Progress in brain research.

[36]  Karalyn Patterson,et al.  Anomia: A doubly typical signature of semantic dementia , 2008, Neuropsychologia.

[37]  Richard S. Frackowiak,et al.  Inhibition in early Alzheimer's disease: An fMRI-based study of effective connectivity , 2011, NeuroImage.

[38]  Karl J. Friston,et al.  Topological inference for EEG and MEG , 2010, 1011.2901.

[39]  M. Kutas,et al.  Neurophysiological evidence for two processing times for visual object identification , 2002, Neuropsychologia.

[40]  Peter Zeidman,et al.  Identifying Abnormal Connectivity in Patients Using Dynamic Causal Modeling of fMRI Responses , 2010, Front. Syst. Neurosci..

[41]  Riitta Salmelin,et al.  Neural representation of language: activation versus long-range connectivity , 2006, Trends in Cognitive Sciences.

[42]  Cathy J. Price,et al.  Inter- and Intrahemispheric Connectivity Differences When Reading Japanese Kanji and Hiragana , 2013, Cerebral cortex.

[43]  Karl J. Friston,et al.  Models of Effective Connectivity in Neural Systems , 2007 .

[44]  Mia Liljeström,et al.  MEG evoked responses and rhythmic activity provide spatiotemporally complementary measures of neural activity in language production , 2012, NeuroImage.

[45]  Pablo Campo,et al.  Visual object naming in patients with small lesions centered at the left temporopolar region , 2014, Brain Structure and Function.

[46]  Emily J. Mayberry,et al.  Coherent concepts are computed in the anterior temporal lobes , 2010, Proceedings of the National Academy of Sciences.

[47]  K. Amunts,et al.  Effective connectivity of the left BA 44, BA 45, and inferior temporal gyrus during lexical and phonological decisions identified with DCM , 2009, Human brain mapping.

[48]  David J. Freedman,et al.  A hierarchy of intrinsic timescales across primate cortex , 2014, Nature Neuroscience.

[49]  Eric Halgren,et al.  First-Pass Selectivity for Semantic Categories in Human Anteroventral Temporal Lobe , 2011, The Journal of Neuroscience.

[50]  Cathy J. Price,et al.  Lateralization is Predicted by Reduced Coupling from the Left to Right Prefrontal Cortex during Semantic Decisions on Written Words , 2010, Cerebral cortex.

[51]  M. G. Tana,et al.  Frequency-based approach to the study of semantic brain networks connectivity , 2013, Journal of Neuroscience Methods.

[52]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[53]  Angel Fernandez,et al.  A set of 254 Snodgrass-Vanderwart pictures standardized for Spanish: Norms for name agreement, image agreement, familiarity, and visual complexity , 1996 .

[54]  J. F. Kalaska,et al.  Attention in hierarchical models of object recognition , 2007 .

[55]  M. Hallett,et al.  Transient Interhemispheric Neuronal Synchrony Correlates with Object Recognition , 2001, The Journal of Neuroscience.

[56]  W. Levelt,et al.  Semantic Category Interference in Overt Picture Naming: Sharpening Current Density Localization by PCA , 2002, Journal of Cognitive Neuroscience.

[57]  Cyril Poupon,et al.  Anatomical Connections of the Visual Word Form Area , 2014, The Journal of Neuroscience.

[58]  Joshua B. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2001, Cogn. Sci..

[59]  C. Gerlach,et al.  Visual complexity exerts opposing effects on object categorization and identification , 2014 .

[60]  I. Olson,et al.  Dissecting the uncinate fasciculus: disorders, controversies and a hypothesis. , 2013, Brain : a journal of neurology.

[61]  Haline E. Schendan,et al.  Object knowledge during entry-level categorization is activated and modified by implicit memory after 200 ms , 2009, NeuroImage.

[62]  Giovanni Berlucchi,et al.  Visual interhemispheric communication and callosal connections of the occipital lobes , 2014, Cortex.

[63]  F Cuetos,et al.  Naming times for the Snodgrass and Vanderwart pictures in Spanish , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[64]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[65]  David J. Freedman,et al.  A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization , 2003, The Journal of Neuroscience.

[66]  A. Papanicolaou,et al.  Estimation of Regional Activation Maps and Interdependencies from Minimum Norm Estimates of Magnetoencephalography (MEG) Data , 2014 .

[67]  Roy W Jones,et al.  Comprehension of concrete and abstract words in semantic dementia. , 2009, Neuropsychology.

[68]  Elaine Funnell,et al.  Those old, familiar things: age of acquisition, familiarity and lexical access in progressive aphasia , 1995, Journal of Neurolinguistics.

[69]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[70]  Pablo Campo,et al.  Anterobasal Temporal Lobe Lesions Alter Recurrent Functional Connectivity within the Ventral Pathway during Naming , 2013, The Journal of Neuroscience.

[71]  M. Catani,et al.  A diffusion tensor imaging tractography atlas for virtual in vivo dissections , 2008, Cortex.

[72]  Guy B. Williams,et al.  Atrophy, hypometabolism and white matter abnormalities in semantic dementia tell a coherent story. , 2011, Brain : a journal of neurology.

[73]  Karl J. Friston,et al.  Multiple sparse priors for the M/EEG inverse problem , 2008, NeuroImage.

[74]  Joseph R. Madsen,et al.  Spatiotemporal Dynamics Underlying Object Completion in Human Ventral Visual Cortex , 2014, Neuron.

[75]  Karl J. Friston,et al.  Free Energy, Precision and Learning: The Role of Cholinergic Neuromodulation , 2013, The Journal of Neuroscience.

[76]  M. Mishkin,et al.  Role of inferior temporal cortex in interhemispheric transfer , 1979, Brain Research.

[77]  M. Bar,et al.  The effects of priming on frontal-temporal communication , 2008, Proceedings of the National Academy of Sciences.

[78]  Reza Ebrahimpour,et al.  The importance of visual features in generic vs. specialized object recognition: a computational study , 2014, Front. Comput. Neurosci..

[79]  Karl J. Friston,et al.  Forward and backward connections in the brain: A DCM study of functional asymmetries , 2009, NeuroImage.

[80]  Michèle Fabre-Thorpe,et al.  At 120 msec You Can Spot the Animal but You Don't Yet Know It's a Dog , 2015, Journal of Cognitive Neuroscience.

[81]  Christopher K. Kovach,et al.  Rapid Interactions between the Ventral Visual Stream and Emotion-Related Structures Rely on a Two-Pathway Architecture , 2008, The Journal of Neuroscience.

[82]  Roy W Jones,et al.  The degraded concept representation system in semantic dementia: damage to pan-modal hub, then visual spoke. , 2012, Brain : a journal of neurology.

[83]  Jean K. Gordon,et al.  A Neural Signature of Phonological Access: Distinguishing the Effects of Word Frequency from Familiarity and Length in Overt Picture Naming , 2007, Journal of Cognitive Neuroscience.

[84]  Pascale Tremblay,et al.  Beyond the arcuate fasciculus: consensus and controversy in the connectional anatomy of language. , 2012, Brain : a journal of neurology.

[85]  Dwight J. Kravitz,et al.  Task context impacts visual object processing differentially across the cortex , 2014, Proceedings of the National Academy of Sciences.

[86]  Riitta Hari,et al.  Removal of magnetoencephalographic artifacts with temporal signal‐space separation: Demonstration with single‐trial auditory‐evoked responses , 2009, Human brain mapping.

[87]  Michael S C Thomas,et al.  Multiple Routes from Occipital to Temporal Cortices during Reading , 2011, The Journal of Neuroscience.

[88]  Moshe Bar,et al.  Visual predictions in the orbitofrontal cortex rely on associative content. , 2014, Cerebral cortex.

[89]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[90]  S. Thompson-Schill,et al.  Reworking the language network , 2014, Trends in Cognitive Sciences.

[91]  Jacob Jolij,et al.  Figure–ground segregation requires two distinct periods of activity in V1: a transcranial magnetic stimulation study , 2005, Neuroreport.

[92]  W. Penny,et al.  Reading Front to Back: MEG Evidence for Early Feedback Effects During Word Recognition , 2012, Cerebral cortex.

[93]  Nikolaus Kriegeskorte,et al.  Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation , 2014, PLoS Comput. Biol..

[94]  H. Spekreijse,et al.  FigureGround Segregation in a Recurrent Network Architecture , 2002, Journal of Cognitive Neuroscience.

[95]  Karl J. Friston,et al.  A DCM study of spectral asymmetries in feedforward and feedback connections between visual areas V1 and V4 in the monkey , 2015, NeuroImage.

[96]  Karl J. Friston,et al.  Ten simple rules for dynamic causal modeling , 2010, NeuroImage.

[97]  Alex Clarke,et al.  The Evolution of Meaning: Spatio-temporal Dynamics of Visual Object Recognition , 2011, Journal of Cognitive Neuroscience.

[98]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[99]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[100]  Karl J. Friston,et al.  Attentional Enhancement of Auditory Mismatch Responses: a DCM/MEG Study , 2015, Cerebral cortex.

[101]  Nikos Makris,et al.  Large-scale brain networks of the human left temporal pole: a functional connectivity MRI study. , 2015, Cerebral cortex.

[102]  V. Calhoun,et al.  The Chronnectome: Time-Varying Connectivity Networks as the Next Frontier in fMRI Data Discovery , 2014, Neuron.

[103]  S. Thompson-Schill,et al.  Conceptual Penetration of Visual Processing , 2010, Psychological science.

[104]  Karl J. Friston,et al.  Top-down Modulations in the Visual Form Pathway Revealed with Dynamic Causal Modeling , 2010, Cerebral cortex.

[105]  F. Dick,et al.  Convergent and Divergent fMRI Responses in Children and Adults to Increasing Language Production Demands , 2014, Cerebral cortex.

[106]  Danling Peng,et al.  Top-Down Modulations from Dorsal Stream in Lexical Recognition: An Effective Connectivity fMRI Study , 2012, PloS one.

[107]  L. Tyler,et al.  Predicting the Time Course of Individual Objects with MEG , 2014, Cerebral cortex.

[108]  Karl J. Friston,et al.  Evoked brain responses are generated by feedback loops , 2007, Proceedings of the National Academy of Sciences.

[109]  C. Gilbert,et al.  Top-down influences on visual processing , 2013, Nature Reviews Neuroscience.

[110]  Craig G. Richter,et al.  Interareal oscillatory synchronization in top-down neocortical processing , 2015, Current Opinion in Neurobiology.

[111]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[112]  M. Bar,et al.  Prediction, context, and competition in visual recognition , 2015, Annals of the New York Academy of Sciences.

[113]  Myrna F. Schwartz,et al.  The Philadelphia Naming Test: Scoring and Rationale , 1996 .

[114]  Karl J. Friston Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[115]  A. Turken,et al.  The Neural Architecture of the Language Comprehension Network: Converging Evidence from Lesion and Connectivity Analyses , 2011, Front. Syst. Neurosci..

[116]  Joshua Kahan,et al.  Comments and Controversies Understanding Dcm: Ten Simple Rules for the Clinician , 2022 .

[117]  Marieke Mur What's the Difference between a Tiger and a Cat? From Visual Object to Semantic Concept via the Perirhinal Cortex , 2014, The Journal of Neuroscience.

[118]  P. Dupont,et al.  Similarity of fMRI Activity Patterns in Left Perirhinal Cortex Reflects Semantic Similarity between Words , 2013, The Journal of Neuroscience.

[119]  Tianzi Jiang,et al.  Connectivity-based parcellation of the human temporal pole using diffusion tensor imaging. , 2014, Cerebral cortex.

[120]  Nikolaus Kriegeskorte,et al.  What's there, distinctly, when and where? , 2014, Nature Neuroscience.