Binding of intrinsic and extrinsic features in working memory.

There is ongoing debate concerning the mechanisms of feature binding in working memory. In particular, there is controversy regarding the extent to which these binding processes are automatic. The present article demonstrates that binding mechanisms differ depending on whether the to-be-integrated features are perceived as forming a coherent object. We presented a series of experiments that investigated the binding of color and shape, whereby color was either an intrinsic feature of the shape or an extrinsic feature of the shape's background. Results show that intrinsic color affected shape recognition, even when it was incidentally studied and irrelevant for the recognition task. In contrast, extrinsic color did not affect shape recognition, even when the association of color and shape was encoded and retrievable on demand. This strongly suggests that binding of intrinsic intra-item information but not extrinsic contextual information is obligatory in visual working memory. We highlight links to perception as well as implicit and explicit long-term memory, which suggest that the intrinsic-extrinsic dimension is a principle relevant to multiple domains of human cognition.

[1]  Harold Bekkering,et al.  Visual search near threshold: Some features are more equal than others. , 2006, Journal of vision.

[2]  N. Cohen,et al.  Amnesia is a Deficit in Relational Memory , 2000, Psychological science.

[3]  J. Dunn Remember-know: a matter of confidence. , 2004, Psychological review.

[4]  Faraneh Vargha-Khadem,et al.  Is the hippocampus necessary for visual and verbal binding in working memory? , 2010, Neuropsychologia.

[5]  Louise A. Brown,et al.  The Role of Attention in Binding Visual Features in Working Memory: Evidence from Cognitive Ageing , 2009, Quarterly journal of experimental psychology.

[6]  Lila Davachi,et al.  Object Unitization and Associative Memory Formation Are Supported by Distinct Brain Regions , 2010, The Journal of Neuroscience.

[7]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[8]  A. Yonelinas The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[9]  S. Lewandowsky,et al.  Forgetting in immediate serial recall: decay, temporal distinctiveness, or interference? , 2008, Psychological review.

[10]  Nelson Cowan,et al.  Life-span development of visual working memory: when is feature binding difficult? , 2006, Developmental psychology.

[11]  F. Craik,et al.  The effect of divided attention on memory for items and their context. , 2000, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[12]  Daniel A. Gajewski,et al.  Feature bindings endure without attention: Evidence from an explicit recall task , 2006, Psychonomic bulletin & review.

[13]  Ullrich K. H. Ecker,et al.  Remembering perceptual features unequally bound in object and episodic tokens: Neural mechanisms and their electrophysiological correlates , 2010, Neuroscience & Biobehavioral Reviews.

[14]  Kavitha Srinivas,et al.  Orientation Effects in Amnesics' Recognition Memory: Familiarity-Based Access to Object Attributes , 2000 .

[15]  Tim Curran,et al.  ERP correlates of familiarity and recollection processes in visual associative recognition , 2007, Brain Research.

[16]  R. Kessels,et al.  Spatial and non-spatial contextual working memory in patients with diencephalic or hippocampal dysfunction , 2007, Brain Research.

[17]  Gordon D. A. Brown,et al.  A temporal ratio model of memory. , 2007, Psychological review.

[18]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[19]  A. Baddeley,et al.  Cross-modal binding and working memory , 2009 .

[20]  R. O’Reilly,et al.  Conjunctive representations in learning and memory: principles of cortical and hippocampal function. , 2001, Psychological review.

[21]  John S. Duncan,et al.  Challenging the classical distinction between long-term and short-term memory: reconsidering the role of the hippocampus , 2011 .

[22]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[23]  K Lamberts,et al.  A feature-sampling account of the time course of old-new recognition judgments. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[24]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[25]  J. Theeuwes Endogenous and Exogenous Control of Visual Selection , 1994, Perception.

[26]  R. M. Boynton,et al.  Independence of memory for categorically different colors and shapes , 1986, Perception & psychophysics.

[27]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[28]  I. Neath,et al.  Short- vs. Long-Term Memory , 2008 .

[29]  N. Cowan An embedded-processes model of working memory , 1999 .

[30]  Zsuzsa Kaldy,et al.  A new method for calibrating perceptual salience across dimensions in infants: the case of color vs. luminance. , 2006, Developmental science.

[31]  G. Humphrey,et al.  The Effect of Colour Congruency on Shape Discriminations of Novel Objects , 2004, Perception.

[32]  F ATTNEAVE,et al.  The quantitative study of shape and pattern perception. , 1956, Psychological bulletin.

[33]  Simon Farrell,et al.  Short-Term Memory: New Data and a Model , 2008 .

[34]  Ingrid R. Olson,et al.  Working Memory for Conjunctions Relies on the Medial Temporal Lobe , 2006, The Journal of Neuroscience.

[35]  Yaoda Xu Understanding the object benefit in visual short-term memory: The roles of feature proximity and connectedness , 2006, Perception & Psychophysics.

[36]  J. G. Snodgrass,et al.  Pragmatics of measuring recognition memory: applications to dementia and amnesia. , 1988, Journal of experimental psychology. General.

[37]  Klaus Oberauer,et al.  Which Working Memory Functions Predict Intelligence , 2008 .

[38]  Klaus Oberauer,et al.  Individual differences in working memory capacity and reasoning ability , 2007 .

[39]  M. Humphreys,et al.  A context noise model of episodic word recognition. , 2001, Psychological review.

[40]  Catherine E. Myers,et al.  Selective hippocampal lesions disrupt a novel cue effect but fail to eliminate blocking in rabbit eyeblink conditioning , 2002, Cognitive, affective & behavioral neuroscience.

[41]  M. Verfaellie,et al.  Implicit memory for novel conceptual associations in amnesia , 2006, Cognitive, affective & behavioral neuroscience.

[42]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[43]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[44]  K. Oberauer Binding and inhibition in working memory: individual and age differences in short-term recognition. , 2005, Journal of experimental psychology. General.

[45]  A. Treisman,et al.  Location and binding in visual working memory , 2006, Memory & cognition.

[46]  E. D. de Haan,et al.  What Was Where? Memory for Object Locations , 1996, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[47]  Richard L. Lewis,et al.  The mind and brain of short-term memory. , 2008, Annual review of psychology.

[48]  Lynne M. Reder,et al.  Models of recognition: A review of arguments in favor of a dual-process account , 2006, Psychonomic bulletin & review.

[49]  Hubert D. Zimmer,et al.  Visual and spatial working memory: From boxes to networks , 2008, Neuroscience & Biobehavioral Reviews.

[50]  M Corbetta,et al.  Attentional modulation of neural processing of shape, color, and velocity in humans. , 1990, Science.

[51]  G. Mandler Recognizing: The judgment of previous occurrence. , 1980 .

[52]  Yaoda Xu,et al.  Encoding color and shape from different parts of an object in visual short-term memory , 2002, Perception & psychophysics.

[53]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[54]  W. R. Garner The Processing of Information and Structure , 1974 .

[55]  Mortimer Mishkin,et al.  Preserved Recognition in a Case of Developmental Amnesia: Implications for the Acaquisition of Semantic Memory? , 2001, Journal of Cognitive Neuroscience.

[56]  David I. Donaldson,et al.  Electrophysiological evidence for the influence of unitization on the processes engaged during episodic retrieval: Enhancing familiarity based remembering , 2007, Neuropsychologia.

[57]  I. Izquierdo,et al.  Separate mechanisms for short- and long-term memory , 1999, Behavioural Brain Research.

[58]  Hubert D. Zimmer,et al.  Electrophysiological Correlates of Specific Feature Binding in Remembering - Introducing a Neurocognitive Model of Human Memory , 2004 .

[59]  Jennifer D Ryan,et al.  A comparison and evaluation of the predictions of relational and conjunctive accounts of hippocampal function , 2006, Hippocampus.

[60]  Jeffery A. Jones,et al.  Feature head-start: Conjunction search following progressive feature disclosure , 2009, Vision Research.

[61]  G W Humphreys,et al.  Neural representation of objects in space: a dual coding account. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[62]  Charan Ranganath,et al.  Opinion TRENDS in Cognitive Sciences Vol.9 No.8 August 2005 Doubts about double dissociations between short- and long-term memory , 2022 .

[63]  A. Mecklinger,et al.  Event-related potentials reveal topographical and temporal distinct neuronal activation patterns for spatial and object working memory. , 1996, Brain research. Cognitive brain research.

[64]  A. Baddeley,et al.  Is the binding of visual features in working memory resource-demanding? , 2006, Journal of experimental psychology. General.

[65]  Neil Burgess,et al.  The hippocampus, space, and viewpoints in episodic memory , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[66]  Ullrich K. H. Ecker,et al.  Color and context: An ERP study on intrinsic and extrinsic feature binding in episodic memory , 2007, Memory & cognition.

[67]  Jonathan T. Mall,et al.  Individual differences in working memory capacity , 2013 .

[68]  M. Chun,et al.  Memory deficits for implicit contextual information in amnesic subjects with hippocampal damage , 1999, Nature Neuroscience.

[69]  Jason P. Mitchell,et al.  Multiple routes to memory: Distinct medial temporal lobe processes build item and source memories , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[70]  Lila Davachi,et al.  Are Representations in Working Memory Distinct From Representations in Long-Term Memory? , 2010, Psychological science.

[71]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[72]  Ellen M. Migo,et al.  Associative memory and the medial temporal lobes , 2007, Trends in Cognitive Sciences.

[73]  Anjan Chatterjee,et al.  Visual Working Memory Is Impaired when the Medial Temporal Lobe Is Damaged , 2006, Journal of Cognitive Neuroscience.

[74]  Dylan M. Jones,et al.  Binding of verbal and spatial features in auditory working memory , 2009 .

[75]  R. Ratcliff,et al.  Time course of item and associative information: implications for global memory models. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[76]  Koen Lamberts,et al.  A feature-sampling account of the time course of old-new recognition judgments. , 2000 .

[77]  D L Schacter,et al.  Implicit memory: what must theories of amnesia explain? , 1997, Memory.

[78]  Daeyeol Lee,et al.  What are the units of visual short-term memory, objects or spatial locations? , 2001, Perception & psychophysics.

[79]  John Ceraso,et al.  Perceptual organization affects both the learning and integration of object properties , 1990 .

[80]  J. Ceraso,et al.  Unit Formation in Perception and Memory , 1985 .

[81]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[82]  Kyle R Cave,et al.  Roles of salience and strategy in conjunction search. , 2002, Journal of experimental psychology. Human perception and performance.

[83]  Yuhong V. Jiang,et al.  Is visual short-term memory object based? Rejection of the “strong-object” hypothesis , 2002, Perception & psychophysics.

[84]  E. Tulving,et al.  Event-related brain potential correlates of two states of conscious awareness in memory. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[85]  R N Wilton,et al.  The Structure of Memory: Evidence concerning the Recall of Surface and Background Colour of Shapes , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[86]  Charles A. Collin,et al.  Using Matlab to generate families of similar Attneave shapes , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[87]  R. Kessels,et al.  Dissociating the Neural Correlates of Intra-Item and Inter-Item Working-Memory Binding , 2010, PloS one.

[88]  L. Reder,et al.  A mechanistic account of the mirror effect for word frequency: a computational model of remember-know judgments in a continuous recognition paradigm. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[89]  Lila Davachi,et al.  Selective and Shared Contributions of the Hippocampus and Perirhinal Cortex to Episodic Item and Associative Encoding , 2008, Journal of Cognitive Neuroscience.

[90]  Hubert D. Zimmer,et al.  ERP Evidence for Flexible Adjustment of Retrieval Orientation and Its Influence on Familiarity , 2009, Journal of Cognitive Neuroscience.

[91]  L L Jacoby,et al.  Isolating the contributions of familiarity and source information to item recognition: a time course analysis. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[92]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[93]  K. Fernow New York , 1896, American Potato Journal.

[94]  Klaus Oberauer,et al.  Design for a working memory. , 2009 .

[95]  F. Parmentier,et al.  Short article: Is verbal–spatial binding in working memory impaired by a concurrent memory load? , 2009, Quarterly journal of experimental psychology.

[96]  Rachel A Diana,et al.  The effects of unitization on familiarity-based source memory: testing a behavioral prediction derived from neuroimaging data. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[97]  Axel Mecklinger,et al.  Context effects on familiarity are familiarity effects of context - an electrophysiological study. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[98]  Neal J Cohen,et al.  Evaluating the neuropsychological dissociation evidence for multiple memory systems , 2003, Cognitive, affective & behavioral neuroscience.

[99]  Hubert D. Zimmer,et al.  Has the butcher on the bus dyed his hair? When color changes modulate ERP correlates of familiarity and recollection , 2006, NeuroImage.

[100]  S. Gronlund,et al.  Global matching models of recognition memory: How the models match the data , 1996, Psychonomic bulletin & review.

[101]  John J. Foxe,et al.  Object‐based attention is multisensory: co‐activation of an object's representations in ignored sensory modalities , 2007, The European journal of neuroscience.

[102]  Andrew R. A. Conway,et al.  Variation in working memory , 2008 .

[103]  Marcia K. Johnson,et al.  Feature memory and binding in young and older adults , 1996, Memory & cognition.

[104]  Guillén Fernández,et al.  The hippocampus supports encoding of between-domain associations within working memory. , 2009, Learning & memory.

[105]  K. Lamberts,et al.  Modeling the time course of feature perception and feature information retrieval , 2006 .

[106]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[107]  R. Melara,et al.  Selective attention to Stroop dimensions: Effects of baseline discriminability, response mode, and practice , 1993, Memory & cognition.

[108]  Jane E Herron,et al.  Strategic influences on recollection in the exclusion task: Electrophysiological evidence , 2003, Psychonomic bulletin & review.

[109]  Yaoda Xu,et al.  Limitations of object-based feature encoding in visual short-term memory. , 2002, Journal of experimental psychology. Human perception and performance.

[110]  J. Hart,et al.  Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. , 2003, Brain research. Cognitive brain research.

[111]  M. Goodale,et al.  The objects of action and perception , 1998, Cognition.

[112]  Ullrich K. H. Ecker,et al.  Verbal predicates foster conscious recollection but not familiarity of a task-irrelevant perceptual feature – An ERP study , 2009, Consciousness and Cognition.

[113]  Mario A. Parra,et al.  Age and binding within-dimension features in visual short-term memory , 2009, Neuroscience Letters.

[114]  Guillén Fernández,et al.  The right hippocampus participates in short-term memory maintenance of object–location associations , 2006, NeuroImage.

[115]  Snehlata Jaswal,et al.  Feature binding in visual short-term memory is unaffected by task-irrelevant changes of location, shape, and color , 2011, Memory & cognition.

[116]  Pierre Maquet,et al.  Brain activity underlying encoding and retrieval of source memory. , 2002, Cerebral cortex.

[117]  N. Hunkin,et al.  Relative sparing of item recognition memory in a patient with adult‐onset damage limited to the hippocampus , 2002, Hippocampus.

[118]  M Mishkin,et al.  Brain activity evidence for recognition without recollection after early hippocampal damage , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[119]  Hubert D. Zimmer,et al.  The influence of object and background color manipulations on the electrophysiological indices of recognition memory , 2007, Brain Research.

[120]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[121]  Raymond Bruyer,et al.  Does visual short‐term memory store bound features? , 2004 .

[122]  Hippocampus, context, and conditioning. , 1991, Behavioral neuroscience.

[123]  C. Sattler,et al.  Boundaries of the relation between conscious recollection and source memory for perceptual details , 2007, Consciousness and Cognition.

[124]  E. E. Johns,et al.  What information underlies correct rejections in short-term recognition memory? , 2002, Memory & cognition.

[125]  K. Oberauer Access to information in working memory: exploring the focus of attention. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[126]  Solomon E. Asch,et al.  Perceptual conditions of association. , 1960 .

[127]  Jos B. T. M. Roerdink,et al.  Perceptual dependencies in information visualization assessed by complex visual search , 2008, TAP.

[128]  Neal J. Cohen,et al.  The Long and the Short of It: Relational Memory Impairments in Amnesia, Even at Short Lags , 2006, The Journal of Neuroscience.

[129]  Lisa Cuthbert,et al.  Remembering Visual Feature Conjunctions: Visual Memory for Shape-Colour Associations is Object-based , 1998 .

[130]  J. Wixted Dual-process theory and signal-detection theory of recognition memory. , 2007, Psychological review.

[131]  Alan D Baddeley,et al.  Binding across space and time in visual working memory , 2010, Memory & cognition.