Language networks associated with computerized semantic indices

Tests of generative semantic verbal fluency are widely used to study organization and representation of concepts in the human brain. Previous studies demonstrated that clustering and switching behavior during verbal fluency tasks is supported by multiple brain mechanisms associated with semantic memory and executive control. Previous work relied on manual assessments of semantic relatedness between words and grouping of words into semantic clusters. We investigated a computational linguistic approach to measuring the strength of semantic relatedness between words based on latent semantic analysis of word co-occurrences in a subset of a large online encyclopedia. We computed semantic clustering indices and compared them to brain network connectivity measures obtained with task-free fMRI in a sample consisting of healthy participants and those differentially affected by cognitive impairment. We found that semantic clustering indices were associated with brain network connectivity in distinct areas including fronto-temporal, fronto-parietal and fusiform gyrus regions. This study shows that computerized semantic indices complement traditional assessments of verbal fluency to provide a more complete account of the relationship between brain and verbal behavior involved organization and retrieval of lexical information from memory.

[1]  Francisco Pereira,et al.  Using Wikipedia to learn semantic feature representations of concrete concepts in neuroimaging experiments , 2013, Artif. Intell..

[2]  M. Lezak,et al.  Neuropsychological assessment, 4th ed. , 2004 .

[3]  Philip Resnik,et al.  Semantic Similarity in a Taxonomy: An Information-Based Measure and its Application to Problems of Ambiguity in Natural Language , 1999, J. Artif. Intell. Res..

[4]  E. Tangalos,et al.  The short test of mental status. Correlations with standardized psychometric testing. , 1991, Archives of neurology.

[5]  Lori Buchanan,et al.  Grounding co-occurrence: Identifying features in a lexical co-occurrence model of semantic memory , 2009, Behavior research methods.

[6]  Jean-François Dartigues,et al.  Clustering and switching processes in semantic verbal fluency in the course of Alzheimer's disease subjects: Results from the PAQUID longitudinal study , 2008, Cortex.

[7]  David T. Jones,et al.  Age-related changes in the default mode network are more advanced in Alzheimer disease , 2011, Neurology.

[8]  David P. Salmon,et al.  Cortical and subcortical influences on clustering and switching in the performance of verbal fluency tasks , 1998, Neuropsychologia.

[9]  Ted Pedersen,et al.  WordNet::Similarity - Measuring the Relatedness of Concepts , 2004, NAACL.

[10]  Michael E. Lesk,et al.  Automatic sense disambiguation using machine readable dictionaries: how to tell a pine cone from an ice cream cone , 1986, SIGDOC '86.

[11]  R. Petersen Mild cognitive impairment as a diagnostic entity , 2004, Journal of internal medicine.

[12]  W. K. Estes,et al.  Learning Theory and Intelligence. , 1974 .

[13]  Thierry Poibeau,et al.  Towards Unrestricted, Large-Scale Acquisition of Feature-Based Conceptual Representations from Corpus Data , 2009 .

[14]  M. Herrmann,et al.  Differential prefrontal and frontotemporal oxygenation patterns during phonemic and semantic verbal fluency , 2012, Neuropsychologia.

[15]  David P. Salmon,et al.  Dimensionality and clustering in the semantic network of patients with Alzheimer's disease. , 1993 .

[16]  K. Patterson,et al.  Disrupted temporal lobe connections in semantic dementia , 1998, NeuroImage.

[17]  Ted Pedersen,et al.  Measures of semantic similarity and relatedness in the biomedical domain , 2007, J. Biomed. Informatics.

[18]  J. Henry,et al.  Verbal fluency performance in dementia of the Alzheimer’s type: a meta-analysis , 2004, Neuropsychologia.

[19]  D. Salmon,et al.  The deterioration of semantic memory in Alzheimer's disease. , 1999, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[20]  David W. Conrath,et al.  Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy , 1997, ROCLING/IJCLCLP.

[21]  G. Miller,et al.  Semantic networks of english , 1991, Cognition.

[22]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[23]  J. Hodges,et al.  Clinicopathological correlates in frontotemporal dementia , 2004, Annals of neurology.

[24]  J. Pekar,et al.  A method for making group inferences from functional MRI data using independent component analysis , 2001, Human brain mapping.

[25]  Liina Pylkkänen,et al.  The Representation of Polysemy: MEG Evidence , 2006, Journal of Cognitive Neuroscience.

[26]  Chaogan Yan,et al.  DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI , 2010, Front. Syst. Neurosci..

[27]  C. Kelly,et al.  Correction for Roberts et al., Isocyanic acid in the atmosphere and its possible link to smoke-related health effects , 2011, Proceedings of the National Academy of Sciences.

[28]  Gabriella Vigliocco,et al.  Integrating experiential and distributional data to learn semantic representations. , 2009, Psychological review.

[29]  W. Rosen,et al.  Verbal fluency in aging and dementia , 1980 .

[30]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[31]  Elsdon Storey,et al.  Semantic verbal fluency strategies in amnestic mild cognitive impairment. , 2012, Neuropsychology.

[32]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[33]  Sharon L. Thompson-Schill,et al.  Predicting judged similarity of natural categories from their neural representations , 2009, Neuropsychologia.

[34]  Ted Pedersen,et al.  Using WordNet-based Context Vectors to Estimate the Semantic Relatedness of Concepts , 2006 .

[35]  Alex Martin,et al.  Neural systems supporting lexical search guided by letter and semantic category cues: A self-paced overt response fMRI study of verbal fluency , 2010, NeuroImage.

[36]  B. Postle,et al.  Superior Parietal Cortex Is Critical for the Manipulation of Information in Working Memory , 2009, The Journal of Neuroscience.

[37]  J. Hodges,et al.  Is semantic memory consistently impaired early in the course of Alzheimer's disease? Neuroanatomical and diagnostic implications , 1995, Neuropsychologia.

[38]  Joaquín Goñi,et al.  The semantic organization of the animal category: evidence from semantic verbal fluency and network theory , 2011, Cognitive Processing.

[39]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[40]  F. Craik,et al.  Hemispheric encoding/retrieval asymmetry in episodic memory: positron emission tomography findings. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Philip Resnik,et al.  Using Information Content to Evaluate Semantic Similarity in a Taxonomy , 1995, IJCAI.

[42]  David P. Salmon,et al.  Abnormal Semantic Network for “Animals” But not “Tools” in Patients with Alzheimer's Disease , 2001, Cortex.

[43]  Alessandro Lenci,et al.  Distributional Memory: A General Framework for Corpus-Based Semantics , 2010, CL.

[44]  Roy Rada,et al.  Development and application of a metric on semantic nets , 1989, IEEE Trans. Syst. Man Cybern..

[45]  C. Bell DSM-IV: Diagnostic and Statistical Manual of Mental Disorders , 1994 .

[46]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[47]  Sophie Schwartz,et al.  Role of frontal versus temporal cortex in verbal fluency as revealed by voxel-based lesion symptom mapping , 2006, Journal of the International Neuropsychological Society.

[48]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[49]  Serguei V. S. Pakhomov,et al.  A computational linguistic measure of clustering behavior on semantic verbal fluency task predicts risk of future dementia in the Nun Study , 2014, Cortex.

[50]  Nathaniel Mercaldo,et al.  Development of methodology for conducting clinical trials in frontotemporal lobar degeneration. , 2008, Brain : a journal of neurology.

[51]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[52]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[53]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[54]  Guy B. Williams,et al.  What the left and right anterior fusiform gyri tell us about semantic memory. , 2010, Brain : a journal of neurology.

[55]  Pentti Kanerva,et al.  Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random Vectors , 2009, Cognitive Computation.

[56]  M. Freedman,et al.  Clustering and switching on verbal fluency tests in Alzheimer's and Parkinson's disease , 1998, Journal of the International Neuropsychological Society.

[57]  Marcus Meinzer,et al.  Neural Signatures of Semantic and Phonemic Fluency in Young and Old Adults , 2009, Journal of Cognitive Neuroscience.

[58]  M. Fox,et al.  The global signal and observed anticorrelated resting state brain networks. , 2009, Journal of neurophysiology.

[59]  Xi-Nian Zuo,et al.  REST: A Toolkit for Resting-State Functional Magnetic Resonance Imaging Data Processing , 2011, PloS one.

[60]  Mirella Lapata,et al.  Dependency-Based Construction of Semantic Space Models , 2007, CL.

[61]  Patrick Dupont,et al.  Right fusiform response patterns reflect visual object identity rather than semantic similarity , 2013, NeuroImage.

[62]  Takashi Tsukiura,et al.  Distinguishing the Neural Correlates of Episodic Memory Encoding and Semantic Memory Retrieval , 2007, Psychological science.

[63]  G. Sandini,et al.  Graph theoretical analysis of magnetoencephalographic functional connectivity in Alzheimer's disease. , 2009, Brain : a journal of neurology.

[64]  Norihiro Sadato,et al.  Frontoparietal network involved in successful retrieval from episodic memory. Spatial and temporal analyses using fMRI and ERP. , 2006, Cerebral cortex.

[65]  Murray Grossman,et al.  Frontotemporal dementia: A review , 2002, Journal of the International Neuropsychological Society.

[66]  A. Lerner,et al.  Network Graph Analysis of Category Fluency Testing , 2009, Cognitive and behavioral neurology : official journal of the Society for Behavioral and Cognitive Neurology.

[67]  Suzie El-Saden,et al.  Basal ganglia structures differentially contribute to verbal fluency: Evidence from Human Immunodeficiency Virus (HIV)-infected adults , 2012, Neuropsychologia.

[68]  N. Filippini,et al.  Group comparison of resting-state FMRI data using multi-subject ICA and dual regression , 2009, NeuroImage.

[69]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[70]  C. Stam,et al.  Small-world networks and functional connectivity in Alzheimer's disease. , 2006, Cerebral cortex.

[71]  M. Folstein,et al.  Clinical diagnosis of Alzheimer's disease , 1984, Neurology.

[72]  Daniel L. Rubin,et al.  Network Analysis of Intrinsic Functional Brain Connectivity in Alzheimer's Disease , 2008, PLoS Comput. Biol..

[73]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[74]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[75]  D. Delis,et al.  Retrieval from semantic memory in Alzheimer-type dementia. , 1986, Journal of clinical and experimental neuropsychology.

[76]  A. Caramazza,et al.  Predicting Conceptual Processing Capacity from Spontaneous Neuronal Activity of the Left Middle Temporal Gyrus , 2012, The Journal of Neuroscience.

[77]  Giuseppe Sartori,et al.  Semantic relevance explains category effects in medial fusiform gyri , 2006, NeuroImage.

[78]  Massimo Poesio,et al.  Strudel: A Corpus-Based Semantic Model Based on Properties and Types , 2010, Cogn. Sci..

[79]  B. Tversky,et al.  Objects, parts, and categories. , 1984 .

[80]  G. Winocur,et al.  Clustering and switching as two components of verbal fluency: evidence from younger and older healthy adults. , 1997, Neuropsychology.

[81]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[82]  Ronald C Petersen,et al.  Comparison of the short test of mental status and the mini-mental state examination in mild cognitive impairment. , 2003, Archives of neurology.

[83]  A. Troyer Normative Data for Clustering and Switching on Verbal Fluency Tasks , 2000, Journal of clinical and experimental neuropsychology.

[84]  A. Caramazza,et al.  The organisation of conceptual knowledge in the brain: The future's past and some future directions , 2006, Cognitive neuropsychology.

[85]  J. Hodges,et al.  Generating ‘tiger’ as an animal name or a word beginning with T: differences in brain activation , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[86]  Bradford Z. Mahon,et al.  Concepts and categories: a cognitive neuropsychological perspective. , 2009, Annual review of psychology.

[87]  L. Lacritz,et al.  Comparative analysis of qualitative verbal fluency performance in normal elderly and demented populations. , 1999, Journal of clinical and experimental neuropsychology.

[88]  Serguei V. S. Pakhomov,et al.  Automated semantic indices related to cognitive function and rate of cognitive decline , 2012, Neuropsychologia.

[89]  A Chatterjee,et al.  Neurocognitive contributions to verbal fluency deficits in frontotemporal lobar degeneration , 2009, Neurology.

[90]  Michael S. Beauchamp,et al.  Automatic Priming of Semantically Related Words Reduces Activity in the Fusiform Gyrus , 2005, Journal of Cognitive Neuroscience.

[91]  William C. Herndon,et al.  Graph theoretical analysis of water clusters , 1991 .

[92]  Rupert Lanzenberger,et al.  Correlations and anticorrelations in resting-state functional connectivity MRI: A quantitative comparison of preprocessing strategies , 2009, NeuroImage.

[93]  A. Turken,et al.  The Neural Architecture of the Language Comprehension Network: Converging Evidence from Lesion and Connectivity Analyses , 2011, Front. Syst. Neurosci..

[94]  David T. Jones,et al.  Non-Stationarity in the “Resting Brain’s” Modular Architecture , 2012, PloS one.

[95]  Tülay Adali,et al.  Comparison of multi‐subject ICA methods for analysis of fMRI data , 2010, Human brain mapping.

[96]  Manel Salamero,et al.  Clustering and switching in semantic fluency: predictors of the development of Alzheimer's disease , 2008, International journal of geriatric psychiatry.

[97]  F W Bylsma,et al.  Longitudinal analysis of phonemic clustering and switching during word-list generation in Huntington's disease. , 1999, Neuropsychology.

[98]  J. Quesada Creating Your Own LSA Spaces , 2007 .

[99]  Susan T. Dumais,et al.  The latent semantic analysis theory of knowledge , 1997 .