Stages of Processing in Associative Recognition: Evidence from Behavior, EEG, and Classification

In this study, we investigated the stages of information processing in associative recognition. We recorded EEG data while participants performed an associative recognition task that involved manipulations of word length, associative fan, and probe type, which were hypothesized to affect the perceptual encoding, retrieval, and decision stages of the recognition task, respectively. Analyses of the behavioral and EEG data, supplemented with classification of the EEG data using machine-learning techniques, provided evidence that generally supported the sequence of stages assumed by a computational model developed in the Adaptive Control of Thought-Rational cognitive architecture. However, the results suggested a more complex relationship between memory retrieval and decision-making than assumed by the model. Implications of the results for modeling associative recognition are discussed. The study illustrates how a classifier approach, in combination with focused manipulations, can be used to investigate the timing of processing stages.

[1]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[2]  E. Wilding.  In what way does the parietal ERP old/new effect index recollection? , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[3]  G. Zipf,et al.  The Psycho-Biology of Language , 1936 .

[4]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[5]  T. Curran,et al.  Behavioral/systems/cognitive Dissociation of Familiarity and Recollection , 2022 .

[6]  T. Curran.  Effects of attention and confidence on the hypothesized ERP correlates of recollection and familiarity , 2004, Neuropsychologia.

[7]  Michael D. Rugg,et al.  The relationship between electrophysiological correlates of recollection and amount of information retrieved , 2006, Brain Research.

[8]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[9]  M. Rugg,et al.  Event-related potentials and recognition memory , 2007, Trends in Cognitive Sciences.

[10]  S. Luck,et al.  The Oxford handbook of event-related potential components , 2011 .

[11]  Roger Ratcliff,et al.  A note on modeling accumulation of information when the rate of accumulation changes over time , 1980 .

[12]  Simon Dennis,et al.  ERP ‘old/new’ effects: memory strength and decisional factor(s) , 2002, Neuropsychologia.

[13]  F. Pulvermüller,et al.  Effects of word length and frequency on the human event-related potential , 2004, Clinical Neurophysiology.

[14]  Sydney S. Cash,et al.  Decoding word and category-specific spatiotemporal representations from MEG and EEG , 2011, NeuroImage.

[15]  G. Humphreys,et al.  Differential effects of word length and visual contrast in the fusiform and lingual gyri during , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[16]  John R. Anderson,et al.  Eye Movements Do Not Reflect Retrieval Processes , 2004, Psychological science.

[17]  Lynne M. Reder,et al.  Models of recognition: A review of arguments in favor of a dual-process account , 2006, Psychonomic bulletin & review.

[18]  John R. Anderson.  Retrieval of propositional information from long-term memory , 1974 .

[19]  Barak A. Pearlmutter,et al.  Linear Spatial Integration for Single-Trial Detection in Encephalography , 2002, NeuroImage.

[20]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[21]  E. Tulving,et al.  Event-related brain potential correlates of two states of conscious awareness in memory. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[22]  F Rösler,et al.  Topographically distinct cortical activation in episodic long-term memory: The retrieval of spatial versus verbal information , 1996, Memory & cognition.

[23]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[24]  Hiroki R. Hayama,et al.  Electrophysiological dissociation of the neural correlates of recollection and familiarity , 2006, Brain Research.

[25]  A. Yonelinas.  The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[26]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[27]  Pat Gunn,et al.  A rational account of memory predicts left prefrontal activation during controlled retrieval. , 2008, Cerebral cortex.

[28]  J. Haynes.  Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[29]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[30]  Kaia L. Vilberg,et al.  Functional significance of retrieval‐related activity in lateral parietal cortex: Evidence from fMRI and ERPs , 2009, Human brain mapping.

[31]  K Lamberts,et al.  A feature-sampling account of the time course of old-new recognition judgments. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[32]  Joseph Dien,et al.  The neurocognitive basis of reading single words as seen through early latency ERPs: A model of converging pathways , 2009, Biological Psychology.

[33]  Martin Eimer,et al.  The Lateralized Readiness Potential , 2003 .

[34]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[35]  Jian Yang,et al.  Using brain imaging to track problem solving in a complex state space , 2012, NeuroImage.

[36]  John R. Anderson,et al.  The role of practice in fact retrieval. , 1985 .

[37]  William D. Marslen-Wilson,et al.  The time course of visual word recognition as revealed by linear regression analysis of ERP data , 2006, NeuroImage.

[38]  Frank Rösler,et al.  Topography of brain electrical activity dissociates the retrieval of spatial versus verbal information from episodic long-term memory in humans , 1997, Neuroscience Letters.

[39]  T. Curran,et al.  Semantic and perceptual effects on recognition memory: Evidence from ERP , 2009, Brain Research.

[40]  R. Shiffrin,et al.  List-strength effect: I. Data and discussion. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[41]  Robert T. Wilkinson,et al.  EEG event-related potentials and signal detection , 1978, Biological Psychology.

[42]  Michael Burke,et al.  Topography and Dynamics of Associative Long-term Memory Retrieval in Humans , 2007, Journal of Cognitive Neuroscience.

[43]  F. Rösler,et al.  Material-specific long-term memory representations of faces and spatial positions: Evidence from slow event-related brain potentials , 2005, Neuropsychologia.

[44]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[45]  John R. Anderson,et al.  The fan effect: New results and new theories. , 1999 .

[46]  S. Sternberg.  The discovery of processing stages , 1969 .

[47]  S Sutton,et al.  Event-related potentials in a two-interval forced-choice detection task , 1982, Perception & psychophysics.

[48]  Miguel P. Eckstein,et al.  Predicting variations of perceptual performance across individuals from neural activity using pattern classifiers , 2010, NeuroImage.

[49]  M. Kutas,et al.  Interactions between sentence context and word frequencyinevent-related brainpotentials , 1990, Memory & cognition.

[50]  Shawn Betts,et al.  Tracking children's mental states while solving algebra equations , 2012, Human brain mapping.

[51]  J. Wixted,et al.  On the difference between strength-based and frequency-based mirror effects in recognition memory. , 1998, Journal of experimental psychology. Learning, memory, and cognition.

[52]  G. Āllport.  The Psycho-Biology of Language. , 1936 .

[53]  Jens Frahm,et al.  Equivalent Responses to Lexical and Nonlexical Visual Stimuli in Occipital Cortex: A Functional Magnetic Resonance Imaging Study , 1997, NeuroImage.

[54]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .

[55]  Tim Curran,et al.  ERP correlates of familiarity and recollection processes in visual associative recognition , 2007, Brain Research.

[56]  Friedemann Pulvermüller,et al.  Early influences of word length and frequency: a group study using MEG , 2003, Neuroreport.

[57]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[58]  Michael A. Ford,et al.  Can I have a quick word? Early electrophysiological manifestations of psycholinguistic processes revealed by event-related regression analysis of the EEG , 2009, Biological Psychology.

[59]  Riitta Salmelin,et al.  Tracking neural coding of perceptual and semantic features of concrete nouns , 2012, NeuroImage.

[60]  C. Lebiere,et al.  An integrated theory of list memory. , 1998 .

[61]  Michael Wilson.  MRC Psycholinguistic Database , 2001 .

[62]  T. Curran.  Brain potentials of recollection and familiarity , 2000, Memory & cognition.

[63]  F. Donders.  On the speed of mental processes. , 1969, Acta psychologica.

[64]  Gert Pfurtscheller,et al.  Mining multi-channel EEG for its information content: an ANN-based method for a brain-computer interface , 1998, Neural Networks.

[65]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[66]  Darryl W. Schneider,et al.  Modeling fan effects on the time course of associative recognition , 2012, Cognitive Psychology.

[67]  John R. Anderson,et al.  The discovery of processing stages: Analyzing EEG data with hidden semi-Markov models , 2015, NeuroImage.

[68]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[69]  John R. Anderson,et al.  Using fMRI to Test Models of Complex Cognition , 2008, Cogn. Sci..

[70]  John R. Anderson,et al.  Competition and representation during memory retrieval: Roles of the prefrontal cortex and the posterior parietal cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[71]  M. Coles.  Modern mind-brain reading: psychophysiology, physiology, and cognition. , 1989, Psychophysiology.