Object-based attention underlies the rehearsal of feature binding in visual working memory.

Feature binding is a core concept in many research fields, including the study of working memory (WM). Over the past decade, it has been debated whether keeping the feature binding in visual WM consumes more visual attention than the constituent single features. Previous studies have only explored the contribution of domain-general attention or space-based attention in the binding process; no study so far has explored the role of object-based attention in retaining binding in visual WM. We hypothesized that object-based attention underlay the mechanism of rehearsing feature binding in visual WM. Therefore, during the maintenance phase of a visual WM task, we inserted a secondary mental rotation (Experiments 1-3), transparent motion (Experiment 4), or an object-based feature report task (Experiment 5) to consume the object-based attention available for binding. In line with the prediction of the object-based attention hypothesis, Experiments 1-5 revealed a more significant impairment for binding than for constituent single features. However, this selective binding impairment was not observed when inserting a space-based visual search task (Experiment 6). We conclude that object-based attention underlies the rehearsal of binding representation in visual WM.

[1]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[2]  Alan D Baddeley,et al.  Feature binding and attention in working memory: A resolution of previous contradictory findings , 2012, Quarterly journal of experimental psychology.

[3]  Hans-Jochen Heinze,et al.  Object-based attention involves the sequential activation of feature-specific cortical modules , 2014, Nature Neuroscience.

[4]  Taiji Ueno,et al.  What goes through the gate? Exploring interference with visual feature binding , 2011, Neuropsychologia.

[5]  Margaret C. Jackson,et al.  Frontal and parietal theta burst TMS impairs working memory for visual-spatial conjunctions , 2013, Brain Stimulation.

[6]  Axel Cleeremans,et al.  Feature bindings are maintained in visual short-term memory without sustained focused attention. , 2010, Experimental psychology.

[7]  R. Marois,et al.  Distinct Capacity Limits for Attention and Working Memory , 2006, Psychological science.

[8]  A. Mecklinger,et al.  Event-related potentials reveal topographical and temporal distinct neuronal activation patterns for spatial and object working memory. , 1996, Brain research. Cognitive brain research.

[9]  Anna Christina Nobre,et al.  Orienting attention to locations in mental representations , 2012, Attention, perception & psychophysics.

[10]  Seth E. Bouvier,et al.  Visual Feature Binding Requires Reentry , 2010, Psychological science.

[11]  J. Duncan,et al.  Competitive brain activity in visual attention , 1997, Current Opinion in Neurobiology.

[12]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[13]  Melissa R. Beck,et al.  Attention shifts or volatile representations: What causes binding deficits in visual working memory? , 2012 .

[14]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[15]  George A. Alvarez,et al.  Overwriting and rebinding: Why feature-switch detection tasks underestimate the binding capacity of visual working memory , 2009 .

[16]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[17]  Michi Matsukura,et al.  Interference between object-based attention and object-based memory , 2009, Psychonomic bulletin & review.

[18]  F. Tong,et al.  Neural mechanisms of object-based attention. , 2015, Cerebral cortex.

[19]  Lynn C. Robertson,et al.  Attenuating illusory binding with TMS of the right parietal cortex , 2007, NeuroImage.

[20]  Snehlata Jaswal,et al.  Feature binding in visual short-term memory is unaffected by task-irrelevant changes of location, shape, and color , 2011, Memory & cognition.

[21]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[22]  Mowei Shen,et al.  The perceptual root of object-based storage: an interactive model of perception and visual working memory. , 2011, Journal of experimental psychology. Human perception and performance.

[23]  A Treisman,et al.  Feature binding, attention and object perception. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[24]  Jeffrey S. Johnson,et al.  The role of attention in the maintenance of feature bindings in visual short-term memory. , 2008, Journal of experimental psychology. Human perception and performance.

[25]  Pierre Jolicoeur,et al.  Mental Rotation Requires Visual Short-term Memory: Evidence from Human Electric Cortical Activity , 2010, Journal of Cognitive Neuroscience.

[26]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[27]  Jeffrey M. Zacks,et al.  Transformations of visuospatial images. , 2005, Behavioral and cognitive neuroscience reviews.

[28]  A. Baddeley,et al.  Is the binding of visual features in working memory resource-demanding? , 2006, Journal of experimental psychology. General.

[29]  P. Reuter-Lorenz,et al.  Object-based attention and object working memory: overlapping processes revealed by selective interference effects in humans. , 2001, Progress in brain research.

[30]  M. Husain,et al.  Attention is Required for Maintenance of Feature Binding in Visual Working Memory , 2014, Quarterly journal of experimental psychology.

[31]  Zaifeng Gao,et al.  Coarse-to-fine encoding of spatial frequency information into visual short-term memory for faces but impartial decay. , 2011, Journal of experimental psychology. Human perception and performance.

[32]  Andrew Hollingworth,et al.  The strategic retention of task-relevant objects in visual working memory. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[33]  A. Hollingworth,et al.  Journal of Experimental Psychology : Human Perception and Performance Selective Maintenance in Visual Working Memory Does Not Require Sustained Visual Attention , 2012 .

[34]  A. Baddeley,et al.  Investigating the episodic buffer , 2010 .

[35]  M. Farah,et al.  Does visual attention select objects or locations? , 1994, Journal of experimental psychology. General.

[36]  John H Reynolds,et al.  Object-based attention to one of two superimposed surfaces alters responses in human early visual cortex. , 2011, Journal of neurophysiology.

[37]  Zhe Chen Object-based attention: A tutorial review , 2012, Attention, Perception, & Psychophysics.

[38]  Candice C Morey,et al.  Visual short-term memory always requires general attention , 2012, Psychonomic Bulletin & Review.

[39]  M. Chun Visual working memory as visual attention sustained internally over time , 2011, Neuropsychologia.

[40]  J. Duncan Cooperating brain systems in selective perception and action. , 1996 .

[41]  Mitchell Valdes-Sosa,et al.  Attentional shifts between surfaces: effects on detection and early brain potentials , 2001, Vision Research.

[42]  J. Wolfe,et al.  Delineating the Neural Signatures of Tracking Spatial Position and Working Memory during Attentive Tracking , 2011, The Journal of Neuroscience.

[43]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[44]  M. Valdés-Sosa,et al.  Transparent motion and object-based attention , 1998, Cognition.

[45]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[46]  U. Neisser VISUAL SEARCH. , 1964, Scientific American.

[47]  John H. R. Maunsell,et al.  Feature-based attention in visual cortex , 2006, Trends in Neurosciences.

[48]  Takatsune Kumada,et al.  Visual search and memory search engage extensive overlapping cerebral cortices: an fMRI study , 2004, NeuroImage.

[49]  M Corbetta,et al.  Attentional modulation of neural processing of shape, color, and velocity in humans. , 1990, Science.

[50]  Jukka Hyönä,et al.  Dynamic binding of identity and location information: A serial model of multiple identity tracking , 2008, Cognitive Psychology.

[51]  M. Shen,et al.  Contralateral delay activity tracks object identity information in visual short term memory , 2011, Brain Research.

[52]  Juha Silvanto,et al.  Visual feature binding: The critical time windows of V1/V2 and parietal activity , 2012, NeuroImage.

[53]  G. Humphreys A multi-stage account of binding in vision: Neuropsychological evidence , 2001 .

[54]  Chris M. Fiacconi,et al.  Visual memory for feature bindings: The disruptive effect of responding to new perceptual input , 2013, Quarterly journal of experimental psychology.

[55]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[56]  Object-based selection from spatially-invariant representations: evidence from a feature-report task , 2011, Attention, perception & psychophysics.

[57]  Stephen M. Emrich,et al.  Competition increases binding errors in visual working memory. , 2012, Journal of vision.

[58]  Jon Driver,et al.  Covert Orienting in the Split Brain Reveals Hemispheric Specialization for Object-Based Attention , 1994 .

[59]  T. Egner,et al.  Working memory as internal attention: Toward an integrative account of internal and external selection processes , 2012, Psychonomic Bulletin & Review.

[60]  E. Vogel,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004 .

[61]  Vincent Di Lollo The feature-binding problem is an ill-posed problem. , 2012, Trends in cognitive sciences.

[62]  R. Marois,et al.  Attentive tracking disrupts feature binding in visual working memory , 2009, Visual cognition.

[63]  Leanne Boucher,et al.  Visual–spatial attention aids the maintenance of object representations in visual working memory , 2013, Memory & cognition.

[64]  Helen M. Morgan,et al.  Strategic resource allocation in the human brain supports cognitive coordination of object and spatial working memory , 2010, Human brain mapping.

[65]  G. Woodman,et al.  The time course of consolidation in visual working memory. , 2006, Journal of experimental psychology. Human perception and performance.

[66]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[67]  J. Jonides,et al.  Rehearsal in spatial working memory. , 1998, Journal of experimental psychology. Human perception and performance.

[68]  G. Humphreys,et al.  The role of reentrant processes in feature binding: Evidence from neuropsychology and TMS on late onset illusory conjunctions , 2009 .

[69]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[70]  R. Logie The Functional Organization and Capacity Limits of Working Memory , 2011 .

[71]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[72]  P. Jansen,et al.  Mental rotation performance in soccer players and gymnasts in an object-based mental rotation task , 2013, Advances in cognitive psychology.

[73]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[74]  A. Baddeley,et al.  Evidence for two attentional components in visual working memory. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[75]  Zhang Wei-Wei,et al.  Features and conjunctions in visual working memory , 2012 .

[76]  A. Baddeley,et al.  Binding in visual working memory: The role of the episodic buffer , 2011, Neuropsychologia.

[77]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[78]  E. Awh,et al.  Evidence for Two Components of Object-Based Selection , 2001, Psychological science.

[79]  Edward K Vogel,et al.  Fractionating Working Memory , 2005, Psychological science.

[80]  Otmar Bock,et al.  Mental rotation of letters, body parts and complex scenes: separate or common mechanisms? , 2012, Human movement science.

[81]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[82]  R. Rafal,et al.  Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. , 1994, Journal of experimental psychology. General.

[83]  J. Duncan Selective attention and the organization of visual information , 1984 .

[84]  Edward F. Ester,et al.  Spatially Global Representations in Human Primary Visual Cortex during Working Memory Maintenance , 2009, The Journal of Neuroscience.

[85]  Geoffrey F. Woodman,et al.  The cost of accessing an object's feature stored in visual working memory , 2011, Visual cognition.

[86]  J-M Hopf,et al.  Dynamics of feature binding during object-selective attention , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[87]  Mowei Shen,et al.  Dissociated Mechanisms of Extracting Perceptual Information into Visual Working Memory , 2010, PloS one.

[88]  Joo-Seok Hyun,et al.  Visual working memory as the substrate for mental rotation. , 2010, Psychonomic bulletin & review.

[89]  Juha Silvanto,et al.  Relationship between visual binding, reentry and awareness , 2011, Consciousness and Cognition.

[90]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[91]  M. Valdés-Sosa,et al.  Attention to object files defined by transparent motion. , 2000, Journal of experimental psychology. Human perception and performance.

[92]  Liqiang Huang,et al.  What is the unit of visual attention? Object for selection, but Boolean map for access. , 2010, Journal of experimental psychology. General.

[93]  Alan D Baddeley,et al.  Disruption of visual feature binding in working memory , 2011, Memory & cognition.

[94]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[95]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[96]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.