Semantic Diversity Accounts for the “Missing” Word Frequency Effect in Stroke Aphasia: Insights Using a Novel Method to Quantify Contextual Variability in Meaning

Word frequency is a powerful predictor of language processing efficiency in healthy individuals and in computational models. Puzzlingly, frequency effects are often absent in stroke aphasia, challenging the assumption that word frequency influences the behavior of any computational system. To address this conundrum, we investigated divergent effects of frequency in two comprehension-impaired patient groups. Patients with semantic dementia have degraded conceptual knowledge as a consequence of anterior temporal lobe atrophy and show strong frequency effects. Patients with multimodal semantic impairments following stroke (semantic aphasia [SA]), in contrast, show little or no frequency effect. Their deficits arise from impaired control processes that bias activation toward task-relevant aspects of knowledge. We hypothesized that high-frequency words exert greater demands on cognitive control because they are more semantically diverse—they tend to appear in a broader range of linguistic contexts and have more variable meanings. Using latent semantic analysis, we developed a new measure of semantic diversity that reflected the variability of a word's meaning across different context. Frequency, but not diversity, was a significant predictor of comprehension in semantic dementia, whereas diversity was the best predictor of performance in SA. Most importantly, SA patients did show typical frequency effects but only when the influence of diversity was taken into account. These results are consistent with the view that higher-frequency words place higher demands on control processes, so that when control processes are damaged the intrinsic processing advantages associated with higher-frequency words are masked.

[1]  E. Warrington Quarterly Journal of Experimental Psychology the Selective Impairment of Semantic Memory the Selective Impairment of Semantic Memory , 2022 .

[2]  Matthew H. Davis,et al.  The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity. , 2005, Cerebral cortex.

[3]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[4]  John Duncan,et al.  Attentional functions of parietal and frontal cortex. , 2005, Cerebral cortex.

[5]  Daniel Mirman,et al.  Attractor Dynamics and Semantic Neighborhood Density: Processing Is Slowed by near Neighbors and Speeded by Distant Neighbors We Thank Ann Kulikowski for Her Help with Data Collection And , 2022 .

[6]  Karalyn Patterson,et al.  Anomia: A doubly typical signature of semantic dementia , 2008, Neuropsychologia.

[7]  Remco J. Renken,et al.  Semantic ambiguity processing in sentence context: Evidence from event-related fMRI , 2007, NeuroImage.

[8]  B. M.,et al.  Representational Aspects of Word Imageability and Word Frequency as Assessed Through Word Association , 2001 .

[9]  E. Warrington,et al.  Category specific access dysphasia. , 2002, Brain : a journal of neurology.

[10]  D. Neary,et al.  Semantic dementia: a form of circumscribed cerebral atrophy , 1995 .

[11]  W. Marslen-Wilson,et al.  Making Sense of Semantic Ambiguity: Semantic Competition in Lexical Access , 2002 .

[12]  J Richard Hanley,et al.  Concreteness and word production , 2012, Memory & Cognition.

[13]  Elizabeth Jefferies,et al.  Exploring multimodal semantic control impairments in semantic aphasia: Evidence from naturalistic object use , 2009, Neuropsychologia.

[14]  H. Goodglass,et al.  Deep dysphasia: Analysis of a rare form of repetition disorder , 1990, Brain and Language.

[15]  Cyrus Shaoul,et al.  Word frequency effects in high-dimensional co-occurrence models: A new approach , 2006, Behavior research methods.

[16]  A. D. Groot,et al.  Representational aspects of word imageability and word frequency as assessed through word association , 1989 .

[17]  John Duncan,et al.  Frontoparietal Activity with Minimal Decision and Control , 2006, The Journal of Neuroscience.

[18]  M. L. Lambon Ralph,et al.  Category-Specific versus Category-General Semantic Impairment Induced by Transcranial Magnetic Stimulation , 2010, Current Biology.

[19]  T. Rogers,et al.  Semantic diversity: A measure of semantic ambiguity based on variability in the contextual usage of words , 2012, Behavior Research Methods.

[20]  P. Hoffman,et al.  Ventrolateral Prefrontal Cortex Plays an Executive Regulation Role in Comprehension of Abstract Words: Convergent Neuropsychological and Repetitive TMS Evidence , 2010, The Journal of Neuroscience.

[21]  David C. Plaut,et al.  Deep Dyslexia: A Case Study of , 1993 .

[22]  Gabriel Recchia,et al.  More data trumps smarter algorithms: Comparing pointwise mutual information with latent semantic analysis , 2009, Behavior research methods.

[23]  J. Raven Coloured progressive matrices : sets A, Ab, B , 1956 .

[24]  W. K. Simmons,et al.  The anterior temporal lobes and the functional architecture of semantic memory , 2009, Journal of the International Neuropsychological Society.

[25]  Gordon D. A. Brown,et al.  Contextual Diversity, Not Word Frequency, Determines Word-Naming and Lexical Decision Times , 2006, Psychological science.

[26]  William D. Marslen-Wilson,et al.  Lexical Representation and Process , 1991 .

[27]  Max Coltheart,et al.  The MRC Psycholinguistic Database , 1981 .

[28]  R. W. Stowe,et al.  Context availability and lexical decisions for abstract and concrete words , 1988 .

[29]  Elizabeth Jefferies,et al.  The Differential Contributions of pFC and Temporo-parietal Cortex to Multimodal Semantic Control: Exploring Refractory Effects in Semantic Aphasia , 2012, Journal of Cognitive Neuroscience.

[30]  R. C. Oldfield Things, Words and the Brain* , 1966, The Quarterly journal of experimental psychology.

[31]  Roy W Jones,et al.  Presemantic Cognition in Semantic Dementia: Six Deficits in Search of an Explanation , 2006 .

[32]  Elizabeth Jefferies,et al.  Different impairments of semantic cognition in semantic dementia and semantic aphasia: evidence from the non-verbal domain. , 2009, Brain : a journal of neurology.

[33]  L. Rapport,et al.  Validation of the Warrington theory of visual processing and the Visual Object and Space Perception Battery. , 1998, Journal of clinical and experimental neuropsychology.

[34]  Mark Steyvers,et al.  Topics in semantic representation. , 2007, Psychological review.

[35]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[36]  D. Balota,et al.  Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. , 1984, Journal of experimental psychology. Human perception and performance.

[37]  Lynne M. Reder,et al.  A semantic interpretation of encoding specificity , 1974 .

[38]  David Badre,et al.  Semantic retrieval, mnemonic control, and prefrontal cortex. , 2002, Behavioral and cognitive neuroscience reviews.

[39]  P. Hoffman,et al.  Remembering ‘zeal’ but not ‘thing’: Reverse frequency effects as a consequence of deregulated semantic processing , 2011, Neuropsychologia.

[40]  Lori Buchanan,et al.  WINDSOR: Windsor improved norms of distance and similarity of representations of semantics , 2008, Behavior research methods.

[41]  T Shallice,et al.  Semantic access dyslexia. , 1979, Brain : a journal of neurology.

[42]  Matthew A. Lambon Ralph,et al.  Naming in semantic dementia—what matters? , 1998, Neuropsychologia.

[43]  Shula Chiat,et al.  When Ottoman is Easier than Chair: An Inverse Frequency Effect in Jargon Aphasia , 2001, Cortex.

[44]  K. Patterson,et al.  Deficits of knowledge vs . executive control in semantic cognition : Insights from cued naming , 2008 .

[45]  K. Forster,et al.  Lexical Access and Naming Time. , 1973 .

[46]  D. Howard,et al.  Aphasic naming: What matters? , 1995, Neuropsychologia.

[47]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[48]  S. Franklin Dissociations in auditory word comprehension; evidence from nine fluent aphasic patients , 1989 .

[49]  Roy W Jones,et al.  Comprehension of concrete and abstract words in semantic dementia. , 2009, Neuropsychology.

[50]  E. Funnell Objects and properties: a study of the breakdown of semantic memory. , 1995, Memory.

[51]  Gary S. Dell,et al.  The retrieval of phonological forms in production: tests of predictions from a connectionist model , 1988 .

[52]  Rainer Goebel,et al.  Functional MRI investigation of verbal selection mechanisms in lateral prefrontal cortex , 2008, NeuroImage.

[53]  R. Faber,et al.  Frontotemporal lobar degeneration: a consensus on clinical diagnostic criteria. , 1999, Neurology.

[54]  M. L. Lambon Ralph,et al.  Semantic impairment in stroke aphasia versus semantic dementia: a case-series comparison. , 2006, Brain : a journal of neurology.

[55]  P. Hoffman,et al.  Reverse concreteness effects are not a typical feature of semantic dementia: evidence for the hub-and-spoke model of conceptual representation. , 2011, Cerebral cortex.

[56]  E. Warrington,et al.  Semantic memory and reading abilities: A case report , 1995, Journal of the International Neuropsychological Society.

[57]  Judith F. Kroll,et al.  Lexical access for concrete and abstract words. , 1986 .

[58]  Elizabeth Jefferies,et al.  tegory-General Semantic Impairment Induced by Transcranial Magnetic Stimulation , 2010 .

[59]  Michael W. Berry,et al.  GTP (General Text Parser) Software for Text Mining , 2003 .

[60]  Murray Grossman,et al.  Neural Basis of Semantic Memory: Process and content in semantic memory , 2007 .

[61]  L. Wittgenstein Philosophical investigations = Philosophische Untersuchungen , 1958 .

[62]  D. Plaut,et al.  The impact of synaptic depression following brain damage: A connectionist account of “access/refractory” and “degraded-store” semantic impairments , 2002, Cognitive, affective & behavioral neuroscience.

[63]  J. R. Firth,et al.  Studies in Linguistic Analysis. , 1974 .

[64]  E. Jefferies,et al.  Refractory effects in stroke aphasia: A consequence of poor semantic control , 2007, Neuropsychologia.

[65]  Rutvik H. Desai,et al.  Parkinson’s disease disrupts both automatic and controlled processing of action verbs , 2013, Brain and Language.

[66]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[67]  D. Norris A quantitative multiple-levels model of reading aloud. , 1994 .

[68]  Stephen R. Welbourne,et al.  Exploring the impact of plasticity-related recovery after brain damage in a connectionist model of single-word reading , 2005, Cognitive, affective & behavioral neuroscience.

[69]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[70]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[71]  E. Warrington,et al.  Abstract and concrete concepts have structurally different representational frameworks. , 2005, Brain : a journal of neurology.

[72]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[73]  P. Garrard,et al.  Lost in semantic space: a multi-modal, non-verbal assessment of feature knowledge in semantic dementia. , 2006, Brain : a journal of neurology.

[74]  M. Freedman,et al.  Frontotemporal lobar degeneration , 1998, Neurology.

[75]  Michael A. Kraut,et al.  Neural Basis of Semantic Memory: Insights from Electrophysiology , 2007 .

[76]  O Bosnes,et al.  Wechsler Memory Scale-Revised (WMS-R)anvendt på barn i Norge. , 2000 .

[77]  Elizabeth Jefferies,et al.  Semantic Processing in the Anterior Temporal Lobes: A Meta-analysis of the Functional Neuroimaging Literature , 2010, Journal of Cognitive Neuroscience.

[78]  D L Nelson,et al.  What is this thing called frequency? , 2000, Memory & cognition.

[79]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[80]  C. T. James The Role of Semantic Information in Lexical Decisions. , 1975 .

[81]  J. Macoir Is a plum a memory problem? Longitudinal study of the reversal of concreteness effect in a patient with semantic dementia , 2009, Neuropsychologia.

[82]  David C. Plaut,et al.  Structure and Function in the Lexical System: Insights from Distributed Models of Word Reading and Lexical Decision , 1997 .

[83]  E. Stein,et al.  A parametric manipulation of central executive functioning. , 2000, Cerebral cortex.

[84]  Elizabeth Jefferies,et al.  Elucidating the Nature of Deregulated Semantic Cognition in Semantic Aphasia: Evidence for the Roles of Prefrontal and Temporo-parietal Cortices , 2010, Journal of Cognitive Neuroscience.

[85]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[86]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[87]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[88]  James L. McClelland,et al.  Structure and deterioration of semantic memory: a neuropsychological and computational investigation. , 2004, Psychological review.

[89]  E. Shoben,et al.  Differential Context Effects in the Comprehension of Abstract and Concrete Verbal Materials , 1983 .

[90]  J. Hodges,et al.  Non-verbal semantic impairment in semantic dementia , 2000, Neuropsychologia.

[91]  E. Jefferies The neural basis of semantic cognition: Converging evidence from neuropsychology, neuroimaging and TMS , 2013, Cortex.

[92]  E. Warrington,et al.  Word comprehension. The distinction between refractory and storage impairments. , 1996, Brain : a journal of neurology.

[93]  G. Kavé,et al.  Characteristics of noun retrieval in picture descriptions across the adult lifespan , 2012 .

[94]  R. Poldrack,et al.  Recovering Meaning Left Prefrontal Cortex Guides Controlled Semantic Retrieval , 2001, Neuron.

[95]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[96]  H. Coslett,et al.  Reversal of the concreteness effect in a patient with semantic dementia , 1994 .

[97]  Costanza Papagno,et al.  Reversed concreteness effect for nouns in a subject with semantic dementia , 2009, Neuropsychologia.

[98]  Curt Burgess,et al.  Characterizing semantic space: Neighborhood effects in word recognition , 2001, Psychonomic bulletin & review.

[99]  J. Bullinaria,et al.  Extracting semantic representations from word co-occurrence statistics: A computational study , 2007, Behavior research methods.

[100]  E. Jefferies,et al.  Deficits of semantic control produce absent or reverse frequency effects in comprehension: Evidence from neuropsychology and dual task methodology , 2012, Neuropsychologia.