Visual Short-Term Memory for Coherent and Sequential Motion: A rTMS Investigation

We investigated the role of the human medio-temporal complex (hMT+) in the memory encoding and storage of a sequence of four coherently moving RDKs by applying repetitive transcranial magnetic stimulation (rTMS) during an early or late phase of the retention interval. Moreover, in a second experiment we also tested whether disrupting the functional integrity of hMT+ during the early phase impaired the precision of the encoded motion directions. Overall, results showed that both recognition accuracy and precision were worse in middle serial positions, suggesting the occurrence of primacy and recency effects. We found that rTMS delivered during the early (but not the late) phase of the retention interval was able to impair not only recognition of RDKs, but also the precision of the retained motion direction. However, such impairment occurred only for RDKs presented in middle positions along the presented sequence, where performance was already closer to chance level. Altogether these findings suggest an involvement of hMT+ in the memory encoding of visual motion direction. Given that both position sequence and rTMS modulated not only recognition but also precision of the stored information, these findings are in support of a model of visual short-term memory with a variable resolution of each stored item, consistent with the assigned amount of memory resources, and that such item-specific memory resolution is supported by the functional integrity of area hMT+.

[1]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[2]  T. Pasternak,et al.  The multiple roles of visual cortical areas MT/MST in remembering the direction of visual motion. , 2000, Cerebral cortex.

[3]  Alain F. Zuur,et al.  A protocol for conducting and presenting results of regression‐type analyses , 2016 .

[4]  Tomohiro Amemiya,et al.  Visual area V5/hMT+ contributes to perception of tactile motion direction: a TMS study , 2017, Scientific Reports.

[5]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[6]  E. Vogel,et al.  Shape and color conjunction stimuli are represented as bound objects in visual working memory , 2011, Neuropsychologia.

[7]  A. Cowey,et al.  Motion perception and perceptual learning studied by magnetic stimulation. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[8]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[9]  Semir Zeki,et al.  Area V5—a microcosm of the visual brain , 2015, Front. Integr. Neurosci..

[10]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[11]  D. J. McKeefry,et al.  Speed selectivity in visual short term memory for motion , 2007, Vision Research.

[12]  Paul M Bays,et al.  Temporal dynamics of encoding, storage, and reallocation of visual working memory. , 2011, Journal of vision.

[13]  K. Mullen,et al.  Reevaluating hMT+ and hV4 functional specialization for motion and static contrast using fMRI-guided repetitive transcranial magnetic stimulation. , 2019, Journal of vision.

[14]  Gianluca Campana,et al.  Priming of motion direction and area V5/MT: a test of perceptual memory. , 2002, Cerebral cortex.

[15]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[16]  Gianluca Campana,et al.  Common (and multiple) neural substrates for static and dynamic motion after-effects: A rTMS investigation , 2013, Cortex.

[17]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[18]  J P Thomas,et al.  Parallel processing in visual short-term memory. , 1996, Journal of experimental psychology. Human perception and performance.

[19]  Bahador Bahrami,et al.  Precision of working memory for visual motion sequences and transparent motion surfaces. , 2011, Journal of vision.

[20]  T. Pasternak,et al.  Microstimulation of cortical area MT affects performance on a visual working memory task. , 2001, Journal of neurophysiology.

[21]  Justin A. Harris,et al.  Accurate and Rapid Estimation of Phosphene Thresholds (REPT) , 2011, PloS one.

[22]  W. Ma,et al.  Factorial comparison of working memory models. , 2014, Psychological review.

[23]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[24]  Masud Husain,et al.  Causal Evidence for a Privileged Working Memory State in Early Visual Cortex , 2014, The Journal of Neuroscience.

[25]  Paul M Bays,et al.  Dynamic Updating of Working Memory Resources for Visual Objects , 2011, The Journal of Neuroscience.

[26]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[27]  D Zaksas,et al.  Motion information is spatially localized in a visual working-memory task. , 2001, Journal of neurophysiology.

[28]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[29]  A. Sack,et al.  Topographic Contribution of Early Visual Cortex to Short-Term Memory Consolidation: A Transcranial Magnetic Stimulation Study , 2012, The Journal of Neuroscience.

[30]  Lucia M. Vaina,et al.  The role of human extra-striate visual areas V5/MT and V2/V3 in the perception of the direction of global motion: a transcranial magnetic stimulation study , 2006, Experimental Brain Research.

[31]  Á. Pascual-Leone,et al.  Transcranial magnetic stimulation: studying the brain-behaviour relationship by induction of 'virtual lesions'. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[33]  E. Vogel,et al.  Interactions between attention and working memory , 2006, Neuroscience.

[34]  Timothy F. Brady,et al.  Modeling visual working memory with the MemToolbox. , 2013, Journal of vision.

[35]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[36]  Theodore P. Zanto,et al.  Neural correlates underlying the precision of visual working memory , 2019, Neuroscience.

[37]  C. Fiebach,et al.  Superior Intraparietal Sulcus Controls the Variability of Visual Working Memory Precision , 2016, The Journal of Neuroscience.

[38]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  Jutta S. Mayer,et al.  Impaired working memory for visual motion direction in schizophrenia: Absence of recency effects and association with psychopathology. , 2016, Neuropsychology.

[40]  Gianluca Campana,et al.  The neural basis of form and form-motion integration from static and dynamic translational Glass patterns: A rTMS investigation , 2017, NeuroImage.

[41]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[42]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[43]  George A. Alvarez,et al.  Variability in the quality of visual working memory , 2012, Nature Communications.

[44]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[45]  R. Blake,et al.  Memory for visual motion. , 1997, Journal of experimental psychology. Human perception and performance.

[46]  J. Maunsell,et al.  A Neuronal Population Measure of Attention Predicts Behavioral Performance on Individual Trials , 2010, The Journal of Neuroscience.

[47]  M. Greenlee,et al.  Visual short-term memory for global motion revealed by directional and speed-tuned masking , 2013, Neuropsychologia.

[48]  Donald A. Norman,et al.  A non-parametric analysis of recognition experiments , 1964 .

[49]  Dag Alnæs,et al.  Modulation of Activity in Human Visual Area V1 during Memory Masking , 2011, PloS one.

[50]  Gianluca Campana,et al.  Visual area V5/MT remembers "what" but not "where". , 2004, Cerebral cortex.

[51]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[52]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[53]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[54]  Lisa Koski,et al.  A double dissociation between striate and extrastriate visual cortex for pattern motion perception revealed using rTMS , 2009, Human brain mapping.

[55]  J. Deese,et al.  Serial effects in recall of unorganized and sequentially organized verbal material. , 1957, Journal of experimental psychology.

[56]  Alvaro Pascual-Leone,et al.  Transcranial magnetic stimulation and neuroplasticity , 1998, Neuropsychologia.

[57]  P. Rousseeuw,et al.  Alternatives to the Median Absolute Deviation , 1993 .

[58]  T. Pasternak,et al.  Working memory in primate sensory systems , 2005, Nature Reviews Neuroscience.

[59]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[60]  M. J. Morgan,et al.  Conditions for motion flow in dynamic visual noise , 1980, Vision Research.

[61]  M. Greenlee,et al.  Retention and disruption of motion information in visual short-term memory. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[62]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[63]  Mark W. Greenlee,et al.  Stimulus-specific mechanisms of visual short-term memory , 1991, Vision Research.

[64]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[65]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[66]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[67]  A. Milner,et al.  The role of V5/MT+ in the control of catching movements: an rTMS study , 2005, Neuropsychologia.

[68]  Kazuyuki Aihara,et al.  Human posterior parietal cortex maintains color, shape and motion in visual short-term memory , 2008, Brain Research.

[69]  Christophe Ley,et al.  Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median , 2013 .

[70]  Emma Y. Wu,et al.  Storage and binding of object features in visual working memory , 2011, Neuropsychologia.

[71]  Hing Yee Eng,et al.  Visual working memory for simple and complex visual stimuli. , 2010, Psychonomic bulletin & review.

[72]  Sally Andrews,et al.  To transform or not to transform: using generalized linear mixed models to analyse reaction time data , 2015, Front. Psychol..

[73]  Masud Husain,et al.  Flexibility of representational states in working memory , 2014, Front. Hum. Neurosci..

[74]  Warren D. Smith Clarification of sensitivity measure A , 1995 .

[75]  Frank Tong,et al.  The impact of early visual cortex transcranial magnetic stimulation on visual working memory precision and guess rate , 2017, PloS one.

[76]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[77]  Andrea Pavan,et al.  Action Video Games Improve Direction Discrimination of Parafoveal Translational Global Motion but Not Reaction Times , 2016, Perception.

[78]  Gianluca Campana,et al.  Detection of first- and second-order coherent motion in blindsight , 2011, Experimental Brain Research.

[79]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[80]  Robin Laycock,et al.  Evidence for fast signals and later processing in human V1/V2 and V5/MT+: A TMS study of motion perception. , 2007, Journal of neurophysiology.

[81]  Daniel Zaksas,et al.  Stimulus specificity and temporal dynamics of working memory for visual motion. , 2003, Journal of neurophysiology.

[82]  Walter Paulus,et al.  Modulation of moving phosphene thresholds by transcranial direct current stimulation of V1 in human , 2003, Neuropsychologia.

[83]  W. Newsome,et al.  A selective impairment of motion perception following lesions of the middle temporal visual area (MT) , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[84]  Murdock,et al.  The serial position effect of free recall , 1962 .

[85]  A. Cowey,et al.  Striate cortex (V1) activity gates awareness of motion , 2005, Nature Neuroscience.

[86]  A. Cowey,et al.  Task–specific impairments and enhancements induced by magnetic stimulation of human visual area V5 , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[87]  Paul M. Bays,et al.  Rapid Forgetting Prevented by Retrospective Attention Cues , 2012, Journal of experimental psychology. Human perception and performance.

[88]  Alain F. Zuur,et al.  A protocol for data exploration to avoid common statistical problems , 2010 .

[89]  Jeffrey S. Johnson,et al.  Assessing the Effect of Early Visual Cortex Transcranial Magnetic Stimulation on Working Memory Consolidation , 2017, Journal of Cognitive Neuroscience.