Reduced visual and frontal cortex activation during visual working memory in grapheme-colour synaesthetes relative to young and older adults

The sensory recruitment model envisages visual working memory (VWM) as an emergent property that is encoded and maintained in sensory (visual) regions. The model implies that enhanced sensory-perceptual functions, as in synaesthesia, entail a dedicated VWM-system, showing reduced visual cortex activity as a result of neural specificity. By contrast, sensory-perceptual decline, as in old age, is expected to show enhanced visual cortex activity as a result of neural broadening. To test this model, young grapheme-colour synaesthetes, older adults and young controls engaged in a delayed pair-associative retrieval and a delayed matching-to-sample task, consisting of achromatic fractal stimuli that do not induce synaesthesia. While a previous analysis of this dataset (Pfeifer et al., 2016) has focused on cued retrieval and recognition of pair-associates (i.e. long-term memory), the current study focuses on visual working memory and considers, for the first time, the crucial delay period in which no visual stimuli are present, but working memory processes are engaged. Participants were trained to criterion and demonstrated comparable behavioural performance on VWM tasks. Whole-brain and region-of-interest-analyses revealed significantly lower activity in synaesthetes’ middle frontal gyrus and visual regions (cuneus, inferior temporal cortex) respectively, suggesting greater neural efficiency relative to young and older adults in both tasks. The results support the sensory recruitment model and can explain age and individual WM-differences based on neural specificity in visual cortex.

[1]  R. Cabeza,et al.  Que PASA? The posterior-anterior shift in aging. , 2008, Cerebral cortex.

[2]  D. Bressler,et al.  Negative BOLD fMRI Response in the Visual Cortex Carries Precise Stimulus-Specific Information , 2007, PloS one.

[3]  Jamie Ward,et al.  Synaesthesia: The Prevalence of Atypical Cross-Modal Experiences , 2006, Perception.

[4]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[5]  Marcia K. Johnson,et al.  Neuroimaging a Single Thought: Dorsolateral PFC Activity Associated with Refreshing Just-Activated Information , 2002, NeuroImage.

[6]  Adam C. Riggall,et al.  The Relationship between Working Memory Storage and Elevated Activity as Measured with Functional Magnetic Resonance Imaging , 2012, The Journal of Neuroscience.

[7]  Paul C. Fletcher,et al.  Anterior prefrontal cortex and the recollection of contextual information , 2005, Neuropsychologia.

[8]  Vincent Walsh,et al.  Enhanced sensory perception in synaesthesia , 2009, Experimental Brain Research.

[9]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[10]  Morgan D. Barense,et al.  Age‐related impairment in a complex object discrimination task that engages perirhinal cortex , 2012, Hippocampus.

[11]  Gereon R. Fink,et al.  When visual perception causes feeling: Enhanced cross-modal processing in grapheme-color synesthesia , 2005, NeuroImage.

[12]  Alan Cowey,et al.  Enhanced Cortical Excitability in Grapheme-Color Synesthesia and Its Modulation , 2011, Current Biology.

[13]  Chris I. Baker,et al.  Multi-Voxel Decoding and the Topography of Maintained Information During Visual Working Memory , 2016, Front. Syst. Neurosci..

[14]  P. Hagoort,et al.  Behavioral/systems/cognitive Effective Connectivity Determines the Nature of Subjective Experience in Grapheme-color Synesthesia , 2022 .

[15]  Dimitris Samaras,et al.  Multi-voxel pattern analysis of selective representation of visual working memory in ventral temporal and occipital regions , 2013, NeuroImage.

[16]  Natasha Sigala,et al.  Representational Account of Memory: Insights from Aging and Synesthesia , 2016, Journal of Cognitive Neuroscience.

[17]  Olga A. Wudarczyk,et al.  Enhanced dimension-specific visual working memory in grapheme–color synesthesia☆ , 2013, Cognition.

[18]  Jamie Ward,et al.  Searching for Shereshevskii: What is superior about the memory of synaesthetes? , 2007, Quarterly journal of experimental psychology.

[19]  A. Cronin-Golomb,et al.  Superior Encoding Enhances Recall in Color-Graphemic Synesthesia , 2011, Perception.

[20]  Janneke F. M. Jehee,et al.  Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex , 2012, Neuron.

[21]  M. L. Lambon Ralph,et al.  Conceptual knowledge is underpinned by the temporal pole bilaterally: convergent evidence from rTMS. , 2009, Cerebral cortex.

[22]  S. Rétaux,et al.  Evolutionary Shift from Fighting to Foraging in Blind Cavefish through Changes in the Serotonin Network , 2013, Current Biology.

[23]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[24]  C. Ranganath Working memory for visual objects: Complementary roles of inferior temporal, medial temporal, and prefrontal cortex , 2006, Neuroscience.

[25]  Alex R. Wade,et al.  The Negative BOLD Signal Unmasked , 2002, Neuron.

[26]  Michael X. Cohen,et al.  Inferior Temporal, Prefrontal, and Hippocampal Contributions to Visual Working Memory Maintenance and Associative Memory Retrieval , 2004, The Journal of Neuroscience.

[27]  Mark D'Esposito,et al.  Distributed and Dynamic Storage of Working Memory Stimulus Information in Extrastriate Cortex , 2014, Journal of Cognitive Neuroscience.

[28]  P. Goldman-Rakic Cellular and circuit basis of working memory in prefrontal cortex of nonhuman primates. , 1990, Progress in brain research.

[29]  Adrian M Owen,et al.  Distinct roles for lateral and medial anterior prefrontal cortex in contextual recollection. , 2005, Journal of neurophysiology.

[30]  Lutz Jäncke,et al.  Brain size and grey matter volume in the healthy human brain , 2002, Neuroreport.

[31]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[32]  A. Seth,et al.  Automaticity and localisation of concurrents predicts colour area activity in grapheme-colour synaesthesia , 2016, Neuropsychologia.

[33]  John J. Foxe,et al.  Differences in early sensory-perceptual processing in synesthesia: A visual evoked potential study , 2008, NeuroImage.

[34]  Ryota Kanai,et al.  Grapheme-color and tone-color synesthesia is associated with structural brain changes in visual regions implicated in color, form, and motion , 2012, Cognitive neuroscience.

[35]  Anil K. Seth,et al.  Diagnosing synaesthesia with online colour pickers: Maximising sensitivity and specificity , 2013, Journal of Neuroscience Methods.

[36]  Adam Gazzaley,et al.  Diminished Top-Down Control Underlies a Visual Imagery Deficit in Normal Aging , 2011, The Journal of Neuroscience.

[37]  Romke Rouw,et al.  Neural Basis of Individual Differences in Synesthetic Experiences , 2010, The Journal of Neuroscience.

[38]  Denise C. Park,et al.  Neural Broadening or Neural Attenuation? Investigating Age-Related Dedifferentiation in the Face Network in a Large Lifespan Sample , 2012, The Journal of Neuroscience.

[39]  K. Norman,et al.  Memory Strength and Repetition Suppression: Multimodal Imaging of Medial Temporal Cortical Contributions to Recognition , 2005, Neuron.

[40]  D. Eagleman,et al.  A standardized test battery for the study of synesthesia , 2007, Journal of Neuroscience Methods.

[41]  Fabrice Crivello,et al.  Age- and sex-related effects on the neuroanatomy of healthy elderly , 2005, NeuroImage.

[42]  Ellen M. Migo,et al.  Associative memory and the medial temporal lobes , 2007, Trends in Cognitive Sciences.

[43]  Jan Gläscher,et al.  Visualization of Group Inference Data in Functional Neuroimaging , 2009, Neuroinformatics.

[44]  C. Curtis,et al.  Persistent activity in the prefrontal cortex during working memory , 2003, Trends in Cognitive Sciences.

[45]  Cyriel M. A. Pennartz,et al.  Modality-specific and modality-independent components of the human imagery system , 2010, NeuroImage.

[46]  Seana Coulson,et al.  Magnetoencephalography reveals early activation of V4 in grapheme-color synesthesia , 2010, NeuroImage.

[47]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[48]  J. Fuster Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. , 1973, Journal of neurophysiology.

[49]  B. Postle,et al.  The cognitive neuroscience of working memory. , 2007, Annual review of psychology.

[50]  J. Ward,et al.  Enhanced recognition memory in grapheme-color synaesthesia for different categories of visual stimuli , 2013, Front. Psychol..

[51]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[52]  S Baron-Cohen,et al.  The physiology of coloured hearing. A PET activation study of colour-word synaesthesia. , 1995, Brain : a journal of neurology.

[53]  Edward F. Ester,et al.  Parietal and Frontal Cortex Encode Stimulus-Specific Mnemonic Representations during Visual Working Memory , 2015, Neuron.

[54]  I. Toni,et al.  Shared Representations for Working Memory and Mental Imagery in Early Visual Cortex , 2013, Current Biology.

[55]  R. Henson,et al.  A familiarity signal in human anterior medial temporal cortex? , 2003, Hippocampus.

[56]  M. D’Esposito,et al.  Activity in fusiform face area modulated as a function of working memory load. , 2001, Brain research. Cognitive brain research.

[57]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[58]  Denise C. Park,et al.  Aging reduces neural specialization in ventral visual cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[59]  D. Stuss,et al.  Cognitive neuroscience. , 1993, Current opinion in neurobiology.

[60]  B. Postle Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[61]  R. Cabeza,et al.  Task-independent and task-specific age effects on brain activity during working memory, visual attention and episodic retrieval. , 2004, Cerebral cortex.

[62]  Juha Silvanto,et al.  Contrasting early visual cortical activation states causally involved in visual imagery and short‐term memory , 2009, The European journal of neuroscience.

[63]  Beat Meier,et al.  Grapheme–colour synaesthesia yields an ordinary rather than extraordinary memory advantage: Evidence from a group study , 2010, Memory.

[64]  Joaquín M. Fuster,et al.  Cortex and Memory: Emergence of a New Paradigm , 2009, Journal of Cognitive Neuroscience.

[65]  Geoffrey M. Boynton,et al.  Individual Differences among Grapheme-Color Synesthetes: Brain-Behavior Correlations , 2005, Neuron.

[66]  Romke Rouw,et al.  Brain areas involved in synaesthesia: a review. , 2011, Journal of neuropsychology.

[67]  Gereon R Fink,et al.  Grapheme-colour synaesthetes show increased grey matter volumes of parietal and fusiform cortex. , 2009, Brain : a journal of neurology.

[68]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[69]  J. Ward,et al.  Enhanced memory ability: Insights from synaesthesia , 2012, Neuroscience & Biobehavioral Reviews.

[70]  C. Sinke,et al.  Inside a synesthete's head: A functional connectivity analysis with grapheme-color synesthetes , 2012, Neuropsychologia.

[71]  Kaia L. Vilberg,et al.  Age differences in the neural correlates of recollection: transient versus sustained fMRI effects , 2012, Neurobiology of Aging.

[72]  Lutz Jäncke,et al.  The neuroanatomy of grapheme–color synesthesia , 2009, The European journal of neuroscience.

[73]  Michel Dojat,et al.  The neural bases of grapheme-color synesthesia are not localized in real color-sensitive areas. , 2012, Cerebral cortex.

[74]  John Duncan,et al.  Hierarchical coding for sequential task events in the monkey prefrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[75]  Mark D'Esposito,et al.  From cognitive to neural models of working memory , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[76]  Natasha Sigala,et al.  Associative memory advantage in grapheme-color synesthetes compared to older, but not young adults , 2014, Front. Psychol..

[77]  Francis Tuerlinckx,et al.  Increasing Transparency Through a Multiverse Analysis , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[78]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[79]  Clayton E. Curtis,et al.  Maintenance of Spatial and Motor Codes during Oculomotor Delayed Response Tasks , 2004, The Journal of Neuroscience.

[80]  J. Ward,et al.  Enhanced associative memory for colour (but not shape or location) in synaesthesia , 2013, Cognition.

[81]  Fiona N. Newell,et al.  Synaesthesia is associated with enhanced, self-rated visual imagery , 2008, Consciousness and Cognition.

[82]  Angela R Laird,et al.  Meta‐analyses of object naming: Effect of baseline , 2005, Human brain mapping.

[83]  Cheryl L. Dahle,et al.  Regional brain changes in aging healthy adults: general trends, individual differences and modifiers. , 2005, Cerebral cortex.

[84]  J. Silvanto,et al.  Distinct Causal Mechanisms of Attentional Guidance by Working Memory and Repetition Priming in Early Visual Cortex , 2012, The Journal of Neuroscience.

[85]  J. Simner,et al.  Beyond visual imagery: How modality-specific is enhanced mental imagery in synesthesia? , 2015, Consciousness and Cognition.

[86]  R. Malach,et al.  Negative BOLD Differentiates Visual Imagery and Perception , 2005, Neuron.

[87]  H. Scholte,et al.  Increased structural connectivity in grapheme-color synesthesia , 2007, Nature Neuroscience.

[88]  R. Cabeza Hemispheric asymmetry reduction in older adults: the HAROLD model. , 2002, Psychology and aging.

[89]  Juha Silvanto,et al.  The role of early visual cortex (V1/V2) in conscious and unconscious visual perception , 2010, NeuroImage.

[90]  Denis Schluppeck,et al.  The role of early visual cortex in visual short-term memory and visual attention , 2009, Vision Research.