How Transcranial Magnetic Stimulation over Early Visual Cortex impacts short-term memory precision and guess rate

Neuroimaging studies have demonstrated that activity patterns in early visual areas predict stimulus properties actively maintained in visual short-term memory. Yet, the mechanisms by which such information is represented remain largely unknown. In this study, observers remembered the orientations of 4 briefly presented gratings, one in each quadrant of the visual field. A 10Hz Transcranial Magnetic Stimulation (TMS) triplet was applied directly at stimulus offset, or midway through a 2-second delay, targeting early visual cortex corresponding retinotopically to a sample item in the lower hemifield. Memory for one of the four gratings was probed at random, and participants reported this orientation via method of adjustment. Replication errors were smaller when the visual field location targeted by TMS overlapped with that of the cued memory item, compared to errors for stimuli probed diagonally to TMS. This implied topographic storage of orientation information, and a memory-enhancing effect at the targeted location. Furthermore, early pulses impaired performance at all four locations, compared to late pulses. Next, response errors were fit empirically using a mixture model analysis to characterize memory precision and guess rates. Memory was more precise for items proximal to the pulse location, irrespective of pulse timing. Guesses were more probable with early TMS pulses, regardless of stimulus location. Thus, whereas TMS administered at the offset of the stimulus array might disrupt early-phase consolidation in a topographically unspecific manner, TMS also boosts the precise representation of an item at its targeted retinotopic location, perhaps by increasing attentional resources or by injecting a beneficial amount of noise.

[1]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[2]  A. Hollingworth Object-position binding in visual memory for natural scenes and object arrays. , 2007, Journal of experimental psychology. Human perception and performance.

[3]  Edward F. Ester,et al.  Spatially Global Representations in Human Primary Visual Cortex during Working Memory Maintenance , 2009, The Journal of Neuroscience.

[4]  Dwight J. Kravitz,et al.  Goal-dependent dissociation of visual and prefrontal cortices during working memory , 2013, Nature Neuroscience.

[5]  J. Rothwell,et al.  How does transcranial magnetic stimulation modify neuronal activity in the brain? Implications for studies of cognition , 2009, Cortex.

[6]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[7]  Adam C. Riggall,et al.  Distributed Patterns of Activity in Sensory Cortex Reflect the Precision of Multiple Items Maintained in Visual Short-Term Memory , 2013, The Journal of Neuroscience.

[8]  John Jonides,et al.  Processes of Working Memory in Mind and Brain , 2005 .

[9]  Timothy F. Brady,et al.  A probabilistic model of visual working memory: Incorporating higher order regularities into working memory capacity estimates. , 2013, Psychological review.

[10]  David Soto,et al.  Causal evidence for subliminal percept-to-memory interference in early visual cortex , 2012, NeuroImage.

[11]  Alexander T. Sack,et al.  The chronometry of visual perception: Review of occipital TMS masking studies , 2014, Neuroscience & Biobehavioral Reviews.

[12]  Juha Silvanto,et al.  Contrasting early visual cortical activation states causally involved in visual imagery and short‐term memory , 2009, The European journal of neuroscience.

[13]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[14]  M. Carrasco,et al.  Isoeccentric locations are not equivalent: The extent of the vertical meridian asymmetry , 2012, Vision Research.

[15]  Adam C. Riggall,et al.  The Relationship between Working Memory Storage and Elevated Activity as Measured with Functional Magnetic Resonance Imaging , 2012, The Journal of Neuroscience.

[16]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[17]  S. Rossi,et al.  Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research , 2009, Clinical Neurophysiology.

[18]  Karen R Dobkins,et al.  The face inversion effect in infants is driven by high, and not low, spatial frequencies. , 2014, Journal of vision.

[19]  V. Walsh,et al.  State-dependency in brain stimulation studies of perception and cognition , 2008, Trends in Cognitive Sciences.

[20]  Edward F. Ester,et al.  Parietal and Frontal Cortex Encode Stimulus-Specific Mnemonic Representations during Visual Working Memory , 2015, Neuron.

[21]  George A. Alvarez,et al.  Variability in the quality of visual working memory , 2012, Nature Communications.

[22]  A. Hollingworth Scene and position specificity in visual memory for objects. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[23]  G. Boynton,et al.  Feature-Based Attentional Modulations in the Absence of Direct Visual Stimulation , 2007, Neuron.

[24]  R. Blake,et al.  Dissociation of Neural Mechanisms Underlying Orientation Processing in Humans , 2009, Current Biology.

[25]  Rainer Goebel,et al.  Optimizing Functional Accuracy of TMS in Cognitive Studies: A Comparison of Methods , 2009, Journal of Cognitive Neuroscience.

[26]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[27]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[28]  Dag Alnæs,et al.  Short-term retention of visual information: Evidence in support of feature-based attention as an underlying mechanism , 2015, Neuropsychologia.

[29]  A. Sack,et al.  Posttraining Transcranial Magnetic Stimulation of Striate Cortex Disrupts Consolidation Early in Visual Skill Learning , 2012, The Journal of Neuroscience.

[30]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[31]  D Zaksas,et al.  Motion information is spatially localized in a visual working-memory task. , 2001, Journal of neurophysiology.

[32]  Frank Tong,et al.  Spatial specificity of working memory representations in the early visual cortex. , 2014, Journal of vision.

[33]  Daniel Zaksas,et al.  Stimulus specificity and temporal dynamics of working memory for visual motion. , 2003, Journal of neurophysiology.

[34]  Juha Silvanto,et al.  Transcranial magnetic stimulation reveals the content of visual short-term memory in the visual cortex , 2010, NeuroImage.

[35]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[36]  Geraint Rees,et al.  Stochastic Resonance Effects Reveal the Neural Mechanisms of Transcranial Magnetic Stimulation , 2011, The Journal of Neuroscience.

[37]  P. Bays Spikes not slots: noise in neural populations limits working memory , 2015, Trends in Cognitive Sciences.

[38]  Alexander T. Sack,et al.  Two distinct neural mechanisms in early visual cortex determine subsequent visual processing , 2014, Cortex.

[39]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[40]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[41]  Juha Silvanto,et al.  State-Dependency of Transcranial Magnetic Stimulation , 2008, Brain Topography.

[42]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[43]  R. Dell’Acqua,et al.  The Demonstration of Short-Term Consolidation , 1998, Cognitive Psychology.

[44]  Paul M Bays,et al.  Noise in Neural Populations Accounts for Errors in Working Memory , 2014, The Journal of Neuroscience.

[45]  Janneke F. M. Jehee,et al.  Sensory uncertainty decoded from visual cortex predicts behavior , 2015, Nature Neuroscience.

[46]  Pieter R. Roelfsema,et al.  A Growth-Cone Model for the Spread of Object-Based Attention during Contour Grouping , 2014, Current Biology.

[47]  Mark D'Esposito,et al.  Distributed and Dynamic Storage of Working Memory Stimulus Information in Extrastriate Cortex , 2014, Journal of Cognitive Neuroscience.

[48]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[49]  J. Sweatt,et al.  Memory-Associated Dynamic Regulation of the “Stable” Core of the Chromatin Particle , 2015, Neuron.

[50]  Colin W G Clifford,et al.  Improving Visual Sensitivity with Subthreshold Transcranial Magnetic Stimulation , 2011, The Journal of Neuroscience.

[51]  Alexander T. Sack,et al.  Time- and Task-Dependent Non-Neural Effects of Real and Sham TMS , 2013, PloS one.

[52]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[53]  Jesper Tegnér,et al.  Mechanism for top-down control of working memory capacity , 2009, Proceedings of the National Academy of Sciences.

[54]  G. Woodman,et al.  The time course of consolidation in visual working memory. , 2006, Journal of experimental psychology. Human perception and performance.

[55]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[56]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[57]  G. Rizzolatti,et al.  Binocularly Driven Neurons in Visual Cortex of Split-Chiasm Cats , 1968, Science.

[58]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[59]  Timothy F. Brady,et al.  Compression in visual working memory: using statistical regularities to form more efficient memory representations. , 2009, Journal of experimental psychology. General.

[60]  J Rovamo,et al.  Resolution of gratings oriented along and across meridians in peripheral vision. , 1982, Investigative ophthalmology & visual science.

[61]  Eyal Seidemann,et al.  Attentional Modulations Related to Spatial Gating but Not to Allocation of Limited Resources in Primate V1 , 2012, Neuron.

[62]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[63]  J. Silvanto,et al.  Distinct Causal Mechanisms of Attentional Guidance by Working Memory and Repetition Priming in Early Visual Cortex , 2012, The Journal of Neuroscience.

[64]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[65]  Edward K Vogel,et al.  Flexibility in visual working memory: Accurate change detection in the face of irrelevant variations in position , 2012, Visual cognition.

[66]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[67]  Eero P. Simoncelli,et al.  Metamers of the ventral stream , 2011, Nature Neuroscience.

[68]  A. Sack,et al.  Topographic Contribution of Early Visual Cortex to Short-Term Memory Consolidation: A Transcranial Magnetic Stimulation Study , 2012, The Journal of Neuroscience.

[69]  P. Matthews The effect of firing on the excitability of a model motoneurone and its implications for cortical stimulation , 1999, The Journal of physiology.

[70]  Mark D'Esposito,et al.  From cognitive to neural models of working memory , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[71]  M. Stokes ‘Activity-silent’ working memory in prefrontal cortex: a dynamic coding framework , 2015, Trends in Cognitive Sciences.

[72]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.